00000100:00080000:2.0:1788572884.131891:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788572884.131895:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360785280:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788572884.514953:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788572884.515053:0:14038:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788572885.539001:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788572885.539147:0:14038:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788572886.562953:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788572886.562983:0:14038:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788572887.586994:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788572887.587046:0:14038:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788572888.610986:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788572888.611028:0:14038:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788572889.251149:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360785408:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788572889.251259:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360785536:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788572889.251293:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360785664:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788572889.251317:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360785792:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788572889.251339:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360785920:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788572889.251362:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360786048:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788572889.251375:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360786176:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788572889.635001:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788572889.635108:0:14038:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788572890.658974:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788572890.659063:0:14038:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788572891.683024:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788572891.683138:0:14038:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788572892.323415:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788572889/real 1788572892]  req@ffff8dc005dc0000 x1875453360786048/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788572914 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788572892.323444:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0000 x1875453360786048/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788572914 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788572892.323458:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788572892.323464:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788572892.323470:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360786048:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788572892.323480:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788572889/real 1788572892]  req@ffff8dc005dc1c00 x1875453360786176/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788572914 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788572892.323491:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453360786176/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788572914 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788572892.323498:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788572892.323501:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788572892.323504:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360786176:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788572892.323573:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788572889/real 1788572892]  req@ffff8dc005dc3b80 x1875453360785536/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788572914 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788572892.323587:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360785536/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788572914 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788572892.323597:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788572892.323602:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788572892.323605:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360785536:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788572892.323617:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788572889/real 1788572892]  req@ffff8dc005dc3800 x1875453360785664/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788572914 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788572892.323627:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453360785664/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788572914 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788572892.323635:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788572892.323639:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788572892.323642:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360785664:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788572892.323649:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788572889/real 1788572892]  req@ffff8dc005dc1500 x1875453360785792/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788572914 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788572892.323660:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360785792/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788572914 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788572892.323667:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788572892.323671:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788572892.323675:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360785792:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788572892.323682:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788572889/real 1788572892]  req@ffff8dc005dc0700 x1875453360785920/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788572914 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788572892.323693:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453360785920/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788572914 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788572892.323702:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788572892.323706:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788572892.323709:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360785920:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788572892.323717:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788572889/real 1788572892]  req@ffff8dc005dc1180 x1875453360785408/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788572914 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788572892.323732:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360785408/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788572914 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788572892.323739:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788572892.323742:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788572892.323745:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360785408:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788572892.706992:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788572892.707099:0:14038:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788572893.731002:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788572893.731100:0:14038:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788572894.371152:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360786304:192.168.202.140@tcp:250:kworker.0
00000800:00000100:2.0:1788572894.371252:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788572894.371331:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788572894/real 1788572894]  req@ffff8dc005dc2d80 x1875453360786304/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788572919 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788572894.371357:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360786304/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788572919 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788572894.371372:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788572894.371377:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788572894.371382:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360786304:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788572894.371391:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360786432:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788572894.371418:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788572894.371432:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788572894/real 1788572894]  req@ffff8dc005dc0a80 x1875453360786432/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788572919 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788572894.371441:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453360786432/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788572919 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788572894.371448:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788572894.371450:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788572894.371453:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360786432:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788572894.371485:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360786560:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788572894.371513:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788572894.371524:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788572894/real 1788572894]  req@ffff8dc005dc1180 x1875453360786560/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788572919 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788572894.371536:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360786560/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788572919 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788572894.371544:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788572894.371548:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788572894.371551:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360786560:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788572894.371556:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360786688:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788572894.371577:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788572894.371588:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788572894/real 1788572894]  req@ffff8dc005dc0700 x1875453360786688/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788572919 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788572894.371599:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453360786688/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788572919 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788572894.371608:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788572894.371611:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788572894.371614:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360786688:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788572894.371620:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360786816:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788572894.371641:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788572894.371652:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788572894/real 1788572894]  req@ffff8dc005dc1500 x1875453360786816/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788572919 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788572894.371662:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360786816/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788572919 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788572894.371672:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788572894.371675:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788572894.371678:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360786816:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788572894.371684:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360786944:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788572894.371704:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788572894.371715:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788572894/real 1788572894]  req@ffff8dc005dc3800 x1875453360786944/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788572919 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788572894.371726:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453360786944/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788572919 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788572894.371733:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788572894.371736:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788572894.371740:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360786944:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788572894.371746:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360787072:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788572894.371764:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788572894.371774:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788572894/real 1788572894]  req@ffff8dc005dc3b80 x1875453360787072/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788572919 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788572894.371785:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360787072/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788572919 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788572894.371793:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788572894.371796:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788572894.371799:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360787072:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788572894.755005:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788572894.755110:0:14038:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788572895.779000:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788572895.779106:0:14038:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788572896.803014:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788572896.803092:0:14038:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788572897.826990:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788572898.851051:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00080000:2.0:1788572899.491043:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788572899.491056:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788572899.491063:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788572899.491078:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1245
00000100:00080000:2.0:1788572899.491092:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788572899.491102:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788572899.491156:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453360787200/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788572899.491197:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788572899.491201:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788572899.491203:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788572899.491209:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1245
00000100:00080000:2.0:1788572899.491215:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788572899.491221:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788572899.491236:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788572899.491261:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453360787328/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788572899.491277:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788572899.491282:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788572899.491284:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788572899.491289:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1245
00000100:00080000:2.0:1788572899.491295:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788572899.491301:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788572899.491312:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788572899.491334:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453360787456/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788572899.491350:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788572899.491381:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788572899.491386:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788572899.491392:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1245
00000100:00080000:2.0:1788572899.491401:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788572899.491412:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788572899.491424:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788572899.491453:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453360787584/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788572899.491474:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788572899.491480:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788572899.491483:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788572899.491491:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1245
00000100:00080000:2.0:1788572899.491503:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788572899.491516:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788572899.491537:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788572899.491570:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453360787712/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788572899.491597:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788572899.491602:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788572899.491605:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788572899.491613:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1245
00000100:00080000:2.0:1788572899.491618:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788572899.491629:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788572899.491636:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788572899.491656:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453360787840/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788572899.491686:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788572899.491696:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788572899.491699:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788572899.491711:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1245
00000100:00080000:2.0:1788572899.491719:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788572899.491729:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788572899.491741:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788572899.491769:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453360787968/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788572899.875032:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788572900.899071:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788572901.922967:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788572902.947004:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788572903.970946:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788572904.994938:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788572906.019033:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788572907.043037:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788572908.066937:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788572909.091041:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00080000:2.0:1788572909.730990:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788572909.731008:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788572909.731013:0:38:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788572909.731045:0:38:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1255
00000100:00080000:2.0:1788572909.731057:0:38:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788572909.731065:0:38:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788572909.731118:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497800 x1875453360788992/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788572909.731149:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788572909.731152:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788572909.731159:0:38:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788572909.731162:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1255
00000100:00080000:2.0:1788572909.731166:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788572909.731169:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788572909.731181:0:38:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788572909.731193:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453360789120/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788572909.731213:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788572909.731217:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788572909.731218:0:38:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788572909.731222:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1255
00000100:00080000:2.0:1788572909.731225:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788572909.731228:0:38:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788572909.731233:0:38:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788572909.731243:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453360789248/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788572909.731253:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788572909.731256:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788572909.731258:0:38:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788572909.731262:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1255
00000100:00080000:2.0:1788572909.731265:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788572909.731268:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788572909.731272:0:38:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788572909.731285:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453360789376/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788572909.731295:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788572909.731298:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788572909.731300:0:38:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788572909.731305:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1255
00000100:00080000:2.0:1788572909.731310:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788572909.731312:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788572909.731316:0:38:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788572909.731328:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453360789504/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788572909.731360:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788572909.731363:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788572909.731364:0:38:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788572909.731369:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1255
00000100:00080000:2.0:1788572909.731372:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788572909.731379:0:38:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788572909.731387:0:38:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788572909.731403:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453360789632/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788572909.731423:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788572909.731435:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788572909.731439:0:38:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788572909.731455:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1255
00000100:00080000:2.0:1788572909.731459:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788572909.731463:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788572909.731467:0:38:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788572909.731475:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496300 x1875453360789760/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788572910.114970:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788572911.138973:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788572911.139053:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788572912.162963:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788572912.162987:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788572913.186982:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788572913.187014:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788572914.211001:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788572915.234952:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788572916.259010:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788572917.282952:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788572917.283025:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788572918.307016:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788572919.330968:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788572920.354974:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788572921.378979:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788572922.402965:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788572923.426950:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788572923.426996:0:14038:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788572924.450983:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788572924.451014:0:14038:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788572925.474992:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788572925.475111:0:14038:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788572926.498967:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788572926.499088:0:14038:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788572927.522984:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788572927.523113:0:14038:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 16 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1788572927.523381:0:14038:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8dc0032d2800 lock: ffff8dc0081f1c00/0xc2934ec3fb6ee55c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x97:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x85ace67feb15f2b5 expref: -99 pid: 35795 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1788572927.523431:0:14038:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8dc0032d2800 lock: ffff8dc0081f0400/0xc2934ec3fb6ee1ce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x85ace67feb15e7a2 expref: -99 pid: 35749 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1788572927.523445:0:14038:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8dc0032d2800 lock: ffff8dc006dfc600/0xc2934ec3fb6ede94 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x8c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x85ace67feb15dcf8 expref: -99 pid: 35706 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0
00010000:00010000:2.0:1788572927.523459:0:14038:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8dc0032d2800 lock: ffff8dc0062c3800/0xc2934ec3fb6ede8d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x85ace67feb15dcdc expref: -99 pid: 35706 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1788572927.523470:0:14038:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8dc0032d2800 lock: ffff8dc006a1c800/0xc2934ec3fb6ede7f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x85ace67feb15dcc0 expref: -99 pid: 35706 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1788572927.523480:0:14038:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8dc0032d2800 lock: ffff8dc00636b200/0xc2934ec3fb6ec3ba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x85ace67feb158ac6 expref: -99 pid: 33443 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1788572927.523502:0:14038:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8dc0032d2800 lock: ffff8dc006c2f200/0xc2934ec3fb6ec27f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x85ace67feb15872a expref: -99 pid: 32754 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1788572927.523518:0:14038:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8dc0032d2800 lock: ffff8dc00636b000/0xc2934ec3fb6ec183 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x85ace67feb15843d expref: -99 pid: 32112 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1788572927.523528:0:14038:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8dc0032d2800 lock: ffff8dc00636ac00/0xc2934ec3fb6ec095 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x85ace67feb15817a expref: -99 pid: 31468 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1788572927.523538:0:14038:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8dc0032d2800 lock: ffff8dc008123c00/0xc2934ec3fb6ec064 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x85ace67feb1580e7 expref: -99 pid: 30833 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0
00000080:00200000:2.0:1788572927.523549:0:14038:0:(vvp_object.c:117:vvp_conf_set()) [0x200000402:0x27:0x0]: losing layout lock
00010000:00010000:2.0:1788572927.523560:0:14038:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8dc0032d2800 lock: ffff8dc000030400/0xc2934ec3fb6ebf68 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x85ace67feb157de5 expref: -99 pid: 30754 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1788572927.523570:0:14038:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8dc0032d2800 lock: ffff8dc000030a00/0xc2934ec3fb6ebd8c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x85ace67feb15790e expref: -99 pid: 30067 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1788572927.523581:0:14038:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8dc0032d2800 lock: ffff8dc00636aa00/0xc2934ec3fb6ebc43 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x85ace67feb157517 expref: -99 pid: 29342 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1788572927.523591:0:14038:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8dc0032d2800 lock: ffff8dc006286c00/0xc2934ec3fb6ebbd3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x85ace67feb1573a4 expref: -99 pid: 28723 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1788572927.523601:0:14038:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8dc0032d2800 lock: ffff8dc003eeda00/0xc2934ec3fb6ebabb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x85ace67feb157039 expref: -99 pid: 28051 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1788572927.523611:0:14038:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8dc0032d2800 lock: ffff8dc006286200/0xc2934ec3fb6eb9c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x85ace67feb156d68 expref: -99 pid: 27129 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1788572927.523648:0:14038:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8dc0032d2800 lock: ffff8dc0081f1c00/0xc2934ec3fb6ee55c lrc: 1/0,0 mode: --/PR res: [0x200000401:0x97:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x85ace67feb15f2b5 expref: -99 pid: 35795 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1788572927.523654:0:14038:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8dc0032d2800 lock: ffff8dc0081f0400/0xc2934ec3fb6ee1ce lrc: 1/0,0 mode: --/PR res: [0x200000401:0xc3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x85ace67feb15e7a2 expref: -99 pid: 35749 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1788572927.523658:0:14038:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8dc0032d2800 lock: ffff8dc006dfc600/0xc2934ec3fb6ede94 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x8c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x85ace67feb15dcf8 expref: -99 pid: 35706 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0
00010000:00010000:2.0:1788572927.523662:0:14038:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8dc0032d2800 lock: ffff8dc0062c3800/0xc2934ec3fb6ede8d lrc: 1/0,0 mode: --/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x85ace67feb15dcdc expref: -99 pid: 35706 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1788572927.523667:0:14038:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8dc0032d2800 lock: ffff8dc006a1c800/0xc2934ec3fb6ede7f lrc: 1/0,0 mode: --/PR res: [0x200000401:0x5e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x85ace67feb15dcc0 expref: -99 pid: 35706 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1788572927.523671:0:14038:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8dc0032d2800 lock: ffff8dc00636b200/0xc2934ec3fb6ec3ba lrc: 1/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x85ace67feb158ac6 expref: -99 pid: 33443 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1788572927.523675:0:14038:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8dc0032d2800 lock: ffff8dc006c2f200/0xc2934ec3fb6ec27f lrc: 1/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x85ace67feb15872a expref: -99 pid: 32754 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1788572927.523679:0:14038:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8dc0032d2800 lock: ffff8dc00636b000/0xc2934ec3fb6ec183 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x85ace67feb15843d expref: -99 pid: 32112 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1788572927.523683:0:14038:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8dc0032d2800 lock: ffff8dc00636ac00/0xc2934ec3fb6ec095 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x85ace67feb15817a expref: -99 pid: 31468 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1788572927.523687:0:14038:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8dc0032d2800 lock: ffff8dc008123c00/0xc2934ec3fb6ec064 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x85ace67feb1580e7 expref: -99 pid: 30833 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0
00010000:00010000:2.0:1788572927.523692:0:14038:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8dc0032d2800 lock: ffff8dc000030400/0xc2934ec3fb6ebf68 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x85ace67feb157de5 expref: -99 pid: 30754 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1788572927.523696:0:14038:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8dc0032d2800 lock: ffff8dc000030a00/0xc2934ec3fb6ebd8c lrc: 1/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x85ace67feb15790e expref: -99 pid: 30067 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1788572927.523701:0:14038:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8dc0032d2800 lock: ffff8dc00636aa00/0xc2934ec3fb6ebc43 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x85ace67feb157517 expref: -99 pid: 29342 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1788572927.523704:0:14038:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8dc0032d2800 lock: ffff8dc006286c00/0xc2934ec3fb6ebbd3 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x85ace67feb1573a4 expref: -99 pid: 28723 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1788572927.523708:0:14038:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8dc0032d2800 lock: ffff8dc003eeda00/0xc2934ec3fb6ebabb lrc: 1/0,0 mode: --/PR res: [0x200000401:0x40:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x85ace67feb157039 expref: -99 pid: 28051 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1788572927.523712:0:14038:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8dc0032d2800 lock: ffff8dc006286200/0xc2934ec3fb6eb9c6 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x85ace67feb156d68 expref: -99 pid: 27129 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1788572927.523716:0:14038:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 16 locks packed
00010000:00010000:2.0:1788572927.523740:0:14038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8dc0032d2800 lock: ffff8dc0081f1c00/0xc2934ec3fb6ee55c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x97:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x85ace67feb15f2b5 expref: -99 pid: 35795 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1788572927.523761:0:14038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8dc0032d2800 lock: ffff8dc0081f0400/0xc2934ec3fb6ee1ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x85ace67feb15e7a2 expref: -99 pid: 35749 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1788572927.523774:0:14038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8dc0032d2800 lock: ffff8dc006dfc600/0xc2934ec3fb6ede94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x8c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x85ace67feb15dcf8 expref: -99 pid: 35706 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0
00010000:00010000:2.0:1788572927.523808:0:14038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8dc0032d2800 lock: ffff8dc0062c3800/0xc2934ec3fb6ede8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x85ace67feb15dcdc expref: -99 pid: 35706 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1788572927.523817:0:14038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8dc0032d2800 lock: ffff8dc006a1c800/0xc2934ec3fb6ede7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x85ace67feb15dcc0 expref: -99 pid: 35706 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1788572927.523826:0:14038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8dc0032d2800 lock: ffff8dc00636b200/0xc2934ec3fb6ec3ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x85ace67feb158ac6 expref: -99 pid: 33443 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1788572927.523834:0:14038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8dc0032d2800 lock: ffff8dc006c2f200/0xc2934ec3fb6ec27f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x85ace67feb15872a expref: -99 pid: 32754 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1788572927.523844:0:14038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8dc0032d2800 lock: ffff8dc00636b000/0xc2934ec3fb6ec183 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x85ace67feb15843d expref: -99 pid: 32112 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1788572927.523851:0:14038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8dc0032d2800 lock: ffff8dc00636ac00/0xc2934ec3fb6ec095 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x85ace67feb15817a expref: -99 pid: 31468 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1788572927.523858:0:14038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8dc0032d2800 lock: ffff8dc008123c00/0xc2934ec3fb6ec064 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x85ace67feb1580e7 expref: -99 pid: 30833 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0
00010000:00010000:2.0:1788572927.523896:0:14038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8dc0032d2800 lock: ffff8dc000030400/0xc2934ec3fb6ebf68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x85ace67feb157de5 expref: -99 pid: 30754 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1788572927.523908:0:14038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8dc0032d2800 lock: ffff8dc000030a00/0xc2934ec3fb6ebd8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x85ace67feb15790e expref: -99 pid: 30067 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1788572927.523932:0:14038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8dc0032d2800 lock: ffff8dc00636aa00/0xc2934ec3fb6ebc43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x85ace67feb157517 expref: -99 pid: 29342 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1788572927.523952:0:14038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8dc0032d2800 lock: ffff8dc006286c00/0xc2934ec3fb6ebbd3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x85ace67feb1573a4 expref: -99 pid: 28723 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1788572927.523960:0:14038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8dc0032d2800 lock: ffff8dc003eeda00/0xc2934ec3fb6ebabb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x40:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x85ace67feb157039 expref: -99 pid: 28051 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1788572927.523967:0:14038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8dc0032d2800 lock: ffff8dc006286200/0xc2934ec3fb6eb9c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x85ace67feb156d68 expref: -99 pid: 27129 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1788572927.523976:0:14038:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1788572927.523978:0:14038:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1788572927.523980:0:14038:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788572928.546945:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788572929.570942:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788572929.571043:0:14038:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788572930.594989:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788572931.618952:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788572932.642984:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788572933.667041:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788572934.690983:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788572934.691160:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788572935.715014:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788572935.715077:0:14038:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788572936.739016:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788572936.739059:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788572937.763008:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788572937.763062:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788572938.786973:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788572939.810985:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788572939.811016:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788572940.834976:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788572940.835001:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788572941.858973:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788572941.859008:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788572942.882956:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788572942.883005:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788572943.906990:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788572944.930960:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788572944.930987:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788572945.954981:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788572945.955029:0:14038:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788572946.978933:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788572948.003018:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788572948.003157:0:14038:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788572949.027000:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788572949.027043:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788572949.027148:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788572949.027207:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788572950.050959:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788572950.051043:0:14038:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788572951.075021:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788572951.075156:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788572952.098967:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788572952.099015:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788572953.122937:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788572953.122979:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788572953.123064:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788572954.146969:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788572954.146999:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788572955.171020:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788572955.171074:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788572956.195019:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788572956.195075:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788572957.219006:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788572958.242963:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000400:00000100:2.0:1788572958.883104:0:2336:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.140:988
00000400:00000100:2.0:1788572958.883146:0:2336:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.140@tcp at host 192.168.202.140 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:2.0:1788572958.883163:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:2.0:1788572958.883200:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:2.0:1788572958.883207:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:2.0:1788572958.883214:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:2.0:1788572958.883222:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:2.0:1788572958.883234:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:2.0:1788572958.883247:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:2.0:1788572959.267058:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788572960.291007:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788572960.291064:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00080000:2.0:1788572960.931023:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788572960.931031:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788572960.931036:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788572960.931047:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1306
00000100:00080000:2.0:1788572960.931080:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788572960.931103:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788572960.931145:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496300 x1875453360798208/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788572960.931186:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788572960.931191:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788572960.931193:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788572960.931198:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1306
00000100:00080000:2.0:1788572960.931202:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788572960.931208:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788572960.931219:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788572960.931239:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453360798336/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788572960.931258:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788572960.931262:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788572960.931264:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788572960.931268:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1306
00000100:00080000:2.0:1788572960.931273:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788572960.931278:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788572960.931284:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788572960.931318:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453360798464/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788572960.931329:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788572960.931333:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788572960.931336:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788572960.931340:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1306
00000100:00080000:2.0:1788572960.931348:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788572960.931355:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788572960.931361:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788572960.931375:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453360798592/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788572960.931385:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788572960.931389:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788572960.931391:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788572960.931397:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1306
00000100:00080000:2.0:1788572960.931402:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788572960.931410:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788572960.931419:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788572960.931437:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453360798720/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788572960.931459:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788572960.931466:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788572960.931469:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788572960.931481:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1306
00000100:00080000:2.0:1788572960.931487:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788572960.931495:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788572960.931505:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788572960.931518:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453360798848/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788572960.931537:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788572960.931544:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788572960.931549:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788572960.931554:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1306
00000100:00080000:2.0:1788572960.931558:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788572960.931563:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788572960.931569:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788572960.931584:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497800 x1875453360798976/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788572962.339031:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788572962.339049:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788572963.363014:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788572963.363047:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788572964.386947:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788572965.411029:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788572966.434955:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788572966.434977:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788572967.459048:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788572967.459092:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788572968.482966:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788572969.506987:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788572970.530942:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788572970.530985:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788572972.579021:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788572973.602959:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788572974.626970:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788572975.650968:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00080000:2.0:1788572976.291029:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788572976.291041:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788572976.291047:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788572976.291059:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1321
00000100:00080000:2.0:1788572976.291073:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788572976.291082:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788572976.291126:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453360800896/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788572976.291160:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788572976.291165:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788572976.291168:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788572976.291175:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1321
00000100:00080000:2.0:1788572976.291180:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788572976.291187:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788572976.291203:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788572976.291222:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453360801024/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788572976.291250:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788572976.291257:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788572976.291264:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788572976.291273:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1321
00000100:00080000:2.0:1788572976.291280:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788572976.291285:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788572976.291295:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788572976.291324:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453360801152/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788572976.291346:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788572976.291350:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788572976.291352:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788572976.291358:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1321
00000100:00080000:2.0:1788572976.291365:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788572976.291370:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788572976.291377:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788572976.291396:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453360801280/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788572976.291422:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788572976.291434:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788572976.291441:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788572976.291450:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1321
00000100:00080000:2.0:1788572976.291460:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788572976.291473:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788572976.291481:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788572976.291501:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453360801408/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788572976.291527:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788572976.291537:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788572976.291544:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788572976.291564:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1321
00000100:00080000:2.0:1788572976.291570:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788572976.291584:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788572976.291595:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788572976.291625:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453360801536/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788572976.291648:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788572976.291656:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788572976.291665:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788572976.291677:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1321
00000100:00080000:2.0:1788572976.291691:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788572976.291701:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788572976.291721:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788572976.291746:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453360801664/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788572976.675048:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788572977.699008:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788572978.722994:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788572979.746975:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788572980.770999:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00080000:2.0:1788572981.410981:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788572981.410993:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788572981.410998:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788572981.411011:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1327
00000100:00080000:2.0:1788572981.411023:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788572981.411032:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788572981.411082:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453360801792/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788572981.411111:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788572981.411114:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788572981.411116:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788572981.411119:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1327
00000100:00080000:2.0:1788572981.411121:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788572981.411124:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788572981.411133:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788572981.411143:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453360801920/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788572981.411150:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788572981.411153:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788572981.411154:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788572981.411157:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1327
00000100:00080000:2.0:1788572981.411159:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788572981.411161:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788572981.411165:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788572981.411172:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453360802048/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788572981.411190:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788572981.411195:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788572981.411197:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788572981.411202:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1327
00000100:00080000:2.0:1788572981.411206:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788572981.411211:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788572981.411228:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788572981.411245:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453360802176/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788572981.411255:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788572981.411267:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788572981.411269:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788572981.411277:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1327
00000100:00080000:2.0:1788572981.411284:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788572981.411289:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788572981.411296:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788572981.411311:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453360802304/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788572981.411318:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788572981.411321:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788572981.411323:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788572981.411327:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1327
00000100:00080000:2.0:1788572981.411330:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788572981.411335:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788572981.411342:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788572981.411353:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453360802432/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788572981.411360:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788572981.411362:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788572981.411365:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788572981.411370:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1327
00000100:00080000:2.0:1788572981.411373:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788572981.411377:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788572981.411384:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788572981.411396:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453360802560/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788572981.795010:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788572982.819002:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788572983.843007:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788572984.867159:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788572985.890962:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788572986.915053:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788572986.915124:0:14038:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788572987.938935:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788572987.938995:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788572988.962998:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788572988.963038:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788572989.987028:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788572989.987077:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788572991.010970:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788572991.010999:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788572992.034980:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788572993.059030:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788572994.083019:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788572995.107016:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00080000:2.0:1788572996.771018:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788572996.771027:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788572996.771033:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788572996.771044:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1342
00000100:00080000:2.0:1788572996.771056:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788572996.771064:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788572996.771115:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497800 x1875453360804480/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788572996.771139:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788572996.771142:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788572996.771144:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788572996.771147:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1342
00000100:00080000:2.0:1788572996.771149:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788572996.771152:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788572996.771178:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788572996.771193:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453360804608/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788572996.771211:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788572996.771216:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788572996.771220:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788572996.771228:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1342
00000100:00080000:2.0:1788572996.771232:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788572996.771240:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788572996.771249:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788572996.771267:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453360804736/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788572996.771288:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788572996.771292:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788572996.771293:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788572996.771300:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1342
00000100:00080000:2.0:1788572996.771304:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788572996.771309:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788572996.771315:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788572996.771336:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453360804864/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788572996.771374:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788572996.771379:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788572996.771382:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788572996.771400:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1342
00000100:00080000:2.0:1788572996.771410:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788572996.771422:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788572996.771436:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788572996.771449:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453360804992/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788572996.771463:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788572996.771468:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788572996.771472:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788572996.771477:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1342
00000100:00080000:2.0:1788572996.771488:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788572996.771499:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788572996.771507:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788572996.771525:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453360805120/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788572996.771563:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788572996.771572:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788572996.771579:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788572996.771594:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1342
00000100:00080000:2.0:1788572996.771603:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788572996.771614:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788572996.771619:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788572996.771631:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496300 x1875453360805248/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788572997.155042:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788572998.179045:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788572999.202993:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573000.227039:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573001.251033:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00080000:2.0:1788573001.890989:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573001.891002:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788573001.891007:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573001.891021:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1347
00000100:00080000:2.0:1788573001.891037:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573001.891047:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573001.891095:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496300 x1875453360805376/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573001.891132:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573001.891137:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573001.891138:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573001.891143:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1347
00000100:00080000:2.0:1788573001.891159:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573001.891164:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573001.891175:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573001.891191:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453360805504/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573001.891213:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573001.891216:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573001.891218:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573001.891224:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1347
00000100:00080000:2.0:1788573001.891229:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573001.891235:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573001.891247:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573001.891268:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453360805632/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573001.891285:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573001.891289:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573001.891291:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573001.891297:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1347
00000100:00080000:2.0:1788573001.891303:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573001.891309:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573001.891320:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573001.891350:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453360805760/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573001.891372:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573001.891380:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573001.891383:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573001.891392:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1347
00000100:00080000:2.0:1788573001.891400:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573001.891406:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573001.891411:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573001.891423:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453360805888/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573001.891437:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573001.891440:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573001.891441:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573001.891448:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1347
00000100:00080000:2.0:1788573001.891461:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573001.891466:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573001.891475:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573001.891496:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453360806016/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573001.891550:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573001.891568:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573001.891575:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573001.891581:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1347
00000100:00080000:2.0:1788573001.891586:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573001.891604:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573001.891613:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573001.891647:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497800 x1875453360806144/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788573002.274973:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573003.298961:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573003.298993:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573004.322981:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573004.323013:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573005.346997:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573005.347047:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573006.371083:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00080000:2.0:1788573007.010982:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573007.010988:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788573007.010991:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573007.010999:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1352
00000100:00080000:2.0:1788573007.011008:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573007.011015:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573007.011049:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453360806272/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573007.011070:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573007.011073:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573007.011074:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573007.011077:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1352
00000100:00080000:2.0:1788573007.011079:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573007.011081:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573007.011090:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573007.011119:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453360806400/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573007.011129:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573007.011131:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573007.011133:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573007.011136:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1352
00000100:00080000:2.0:1788573007.011138:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573007.011141:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573007.011145:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573007.011155:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453360806528/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573007.011162:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573007.011164:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573007.011166:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573007.011169:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1352
00000100:00080000:2.0:1788573007.011171:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573007.011175:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573007.011181:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573007.011190:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453360806656/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573007.011197:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573007.011200:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573007.011201:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573007.011203:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1352
00000100:00080000:2.0:1788573007.011206:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573007.011209:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573007.011212:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573007.011222:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453360806784/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573007.011233:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573007.011238:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573007.011240:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573007.011247:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1352
00000100:00080000:2.0:1788573007.011252:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573007.011257:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573007.011261:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573007.011272:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453360806912/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573007.011287:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573007.011290:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573007.011291:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573007.011294:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1352
00000100:00080000:2.0:1788573007.011296:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573007.011299:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573007.011304:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573007.011317:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453360807040/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788573007.394964:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573008.419007:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573009.443001:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573010.466994:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573011.491001:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573011.491071:0:14038:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573012.514993:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573013.538964:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573013.539012:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573014.563000:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573015.586994:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573016.611003:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00080000:2.0:1788573017.251032:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573017.251050:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788573017.251054:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573017.251066:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1362
00000100:00080000:2.0:1788573017.251079:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573017.251088:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573017.251135:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453360808064/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573017.251158:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573017.251161:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573017.251162:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573017.251165:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1362
00000100:00080000:2.0:1788573017.251168:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573017.251170:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573017.251180:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573017.251190:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453360808192/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573017.251201:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573017.251205:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573017.251206:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573017.251210:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1362
00000100:00080000:2.0:1788573017.251212:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573017.251214:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573017.251218:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573017.251227:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453360808320/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573017.251232:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573017.251235:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573017.251237:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573017.251240:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1362
00000100:00080000:2.0:1788573017.251243:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573017.251246:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573017.251249:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573017.251258:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453360808448/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573017.251267:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573017.251271:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573017.251273:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573017.251278:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1362
00000100:00080000:2.0:1788573017.251286:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573017.251294:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573017.251300:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573017.251314:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453360808576/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573017.251323:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573017.251327:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573017.251329:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573017.251338:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1362
00000100:00080000:2.0:1788573017.251347:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573017.251353:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573017.251360:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573017.251382:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453360808704/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573017.251399:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573017.251403:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573017.251405:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573017.251410:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1362
00000100:00080000:2.0:1788573017.251414:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573017.251420:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573017.251430:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573017.251444:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453360808832/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788573017.635037:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573018.659001:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573019.683016:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573020.706990:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573021.730988:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573022.754957:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573023.778995:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573023.779212:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573024.802996:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573025.826968:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573025.826996:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573026.850952:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573026.851012:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573027.875048:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573027.875090:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573028.898968:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573028.899005:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573029.922961:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573030.946978:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573031.970974:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788573031.971061:0:14038:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573032.994977:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573034.018973:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788573034.019008:0:14038:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573034.019116:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573035.042966:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573036.067008:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573037.090966:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573037.091024:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573038.114983:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573039.139002:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573040.162981:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573041.186999:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573042.210938:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573042.210981:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573043.234989:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573043.235024:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573044.258933:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573045.283117:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573046.306931:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573046.306993:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573047.331004:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00080000:2.0:1788573047.971007:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573047.971015:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788573047.971020:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573047.971031:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1393
00000100:00080000:2.0:1788573047.971042:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573047.971050:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573047.971093:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497800 x1875453360813440/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573047.971136:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573047.971141:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573047.971144:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573047.971150:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1393
00000100:00080000:2.0:1788573047.971155:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573047.971161:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573047.971174:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573047.971204:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453360813568/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573047.971219:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573047.971223:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573047.971226:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573047.971231:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1393
00000100:00080000:2.0:1788573047.971235:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573047.971240:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573047.971247:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573047.971263:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453360813696/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573047.971276:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573047.971280:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573047.971282:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573047.971288:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1393
00000100:00080000:2.0:1788573047.971292:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573047.971300:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573047.971309:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573047.971326:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453360813824/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573047.971359:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573047.971368:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573047.971372:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573047.971381:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1393
00000100:00080000:2.0:1788573047.971385:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573047.971391:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573047.971399:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573047.971416:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453360813952/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573047.971427:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573047.971433:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573047.971436:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573047.971442:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1393
00000100:00080000:2.0:1788573047.971446:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573047.971453:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573047.971458:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573047.971474:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453360814080/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573047.971485:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573047.971493:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573047.971497:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573047.971505:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1393
00000100:00080000:2.0:1788573047.971511:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573047.971519:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573047.971526:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573047.971543:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496300 x1875453360814208/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788573048.354974:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573048.355020:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573049.378979:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573049.379134:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573050.402999:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573051.427015:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573052.450973:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573053.475002:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573053.475059:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573054.498972:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573055.522944:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573056.546948:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573057.570948:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573057.570999:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573058.211511:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006e56a00 x1875453360815744/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573083 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573058.211526:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573058.211529:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573058.211533:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006e56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360815744:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573058.211539:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360815872:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573058.211558:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573058.211568:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573058/real 1788573058]  req@ffff8dc006e54000 x1875453360815872/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573083 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573058.211580:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006e54000 x1875453360815872/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573083 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573058.211588:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573058.211591:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573058.211594:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360815872:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573058.211600:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006e56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360816000:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573058.211617:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573058.211628:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573058/real 1788573058]  req@ffff8dc006e56680 x1875453360816000/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573083 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573058.211640:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006e56680 x1875453360816000/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573083 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573058.211648:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573058.211651:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573058.211655:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006e56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360816000:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573058.594980:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573058.595001:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788573058.595035:0:14038:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573059.618960:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573059.618960:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573059.619027:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573060.643021:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573060.643033:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788573060.643087:0:14038:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573061.666963:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573061.667004:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573061.667009:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573062.690965:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573062.690965:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00080000:2.0:1788573063.330969:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573063.330978:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788573063.330982:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573063.330991:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1408
00000100:00080000:2.0:1788573063.331001:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573063.331008:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573063.331041:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496300 x1875453360816128/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573063.331076:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573063.331079:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573063.331081:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573063.331087:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1408
00000100:00080000:2.0:1788573063.331090:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573063.331096:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573063.331105:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573063.331116:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453360816256/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788573063.331121:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360816128:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788573063.331126:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573063.331130:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573063.331132:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573063.331135:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1408
00000100:00080000:2.0:1788573063.331138:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573063.331140:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573063.331143:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573063.331156:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453360816384/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573063.331162:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573063.331165:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573063.331166:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573063.331168:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1408
00000100:00080000:2.0:1788573063.331170:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573063.331173:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573063.331175:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573063.331182:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453360816512/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573063.331189:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1788573063.331194:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788573063.331195:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573063.331198:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573063.331203:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1408
00000100:00080000:2.0:1788573063.331205:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573063.331207:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573063.331210:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573063.331216:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453360816640/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573063.331227:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573063.331229:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573063.331230:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573063.331233:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1408
00000100:00080000:2.0:1788573063.331235:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573063.331237:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573063.331241:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573063.331249:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453360816768/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788573063.331255:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573063/real 1788573063]  req@ffff8dc020496300 x1875453360816128/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573088 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573063.331257:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573063.331265:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573063.331267:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573063.331275:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1408
00000100:00080000:2.0:1788573063.331280:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573063.331283:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573063.331285:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573063.331293:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496300 x1875453360816128/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573088 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573063.331294:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497800 x1875453360816896/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573063.331320:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573063.331326:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573063.331332:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360816128:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788573063.331355:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360816256:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788573063.331382:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573063.331396:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573063/real 1788573063]  req@ffff8dc020496a00 x1875453360816256/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573088 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573063.331410:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453360816256/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573088 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573063.331421:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573063.331425:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573063.331429:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360816256:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573063.331436:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360816384:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573063.331460:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573063.331473:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573063/real 1788573063]  req@ffff8dc020494e00 x1875453360816384/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573088 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573063.331486:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453360816384/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573088 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573063.331495:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573063.331499:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573063.331502:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360816384:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573063.331509:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360816512:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573063.331540:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573063.331553:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573063/real 1788573063]  req@ffff8dc020497100 x1875453360816512/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573088 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573063.331566:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453360816512/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573088 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573063.331575:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573063.331578:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573063.331582:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360816512:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573063.331588:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360816640:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788573063.331609:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573063.331620:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573063/real 1788573063]  req@ffff8dc020494700 x1875453360816640/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573088 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573063.331633:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453360816640/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573088 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573063.331642:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573063.331645:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573063.331649:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360816640:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573063.331655:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360816768:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573063.331675:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573063.331686:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573063/real 1788573063]  req@ffff8dc020494000 x1875453360816768/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573088 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573063.331698:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453360816768/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573088 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573063.331706:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573063.331710:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573063.331714:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360816768:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573063.331721:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360816896:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573063.331740:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573063.331752:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573063/real 1788573063]  req@ffff8dc020497800 x1875453360816896/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573088 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573063.331771:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497800 x1875453360816896/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573088 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573063.331779:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573063.331782:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573063.331786:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360816896:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573063.714944:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573063.714954:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788573063.715046:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573064.738956:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573064.738956:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573065.763001:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573065.763006:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573066.787039:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573066.787039:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573067.810965:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573067.810969:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00080000:2.0:1788573068.450988:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573068.450995:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788573068.450999:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573068.451007:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1414
00000100:00080000:2.0:1788573068.451018:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573068.451027:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573068.451068:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453360817024/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573068.451092:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573068.451094:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573068.451096:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573068.451098:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1414
00000100:00080000:2.0:1788573068.451101:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573068.451104:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573068.451112:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573068.451122:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453360817152/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573068.451130:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573068.451133:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573068.451135:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788573068.451139:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360817024:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788573068.451140:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1414
00000100:00080000:2.0:1788573068.451145:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573068.451151:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573068.451155:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573068.451162:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453360817280/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573068.451168:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573068.451170:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573068.451171:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573068.451173:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1414
00000100:00080000:2.0:1788573068.451176:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573068.451178:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573068.451181:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573068.451188:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453360817408/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573068.451193:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573068.451195:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573068.451196:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573068.451199:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1414
00000100:00080000:2.0:1788573068.451201:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573068.451203:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573068.451207:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788573068.451210:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573068.451217:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453360817536/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573068.451225:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573068.451227:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573068.451229:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573068.451232:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1414
00000100:00080000:2.0:1788573068.451234:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573068.451237:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573068.451240:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573068.451254:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573068/real 1788573068]  req@ffff8dc020495500 x1875453360817024/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573093 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573068.451254:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453360817664/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573068.451278:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573068.451280:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573068.451281:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573068.451285:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1414
00000100:00080000:2.0:1788573068.451289:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573068.451292:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573068.451295:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573068.451299:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453360817024/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573093 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573068.451305:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453360817792/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573068.451312:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573068.451318:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573068.451322:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360817024:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788573068.451341:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360817152:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788573068.451358:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573068.451367:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573068/real 1788573068]  req@ffff8dc020495180 x1875453360817152/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573093 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573068.451376:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453360817152/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573093 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573068.451383:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573068.451386:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573068.451388:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360817152:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573068.451392:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360817280:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573068.451404:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573068.451411:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573068/real 1788573068]  req@ffff8dc020497480 x1875453360817280/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573093 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573068.451418:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453360817280/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573093 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573068.451424:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573068.451425:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573068.451427:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360817280:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573068.451431:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360817408:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573068.451441:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573068.451446:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573068/real 1788573068]  req@ffff8dc020494380 x1875453360817408/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573093 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573068.451453:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453360817408/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573093 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573068.451463:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573068.451465:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573068.451467:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360817408:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573068.451470:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360817536:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788573068.451480:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573068.451486:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573068/real 1788573068]  req@ffff8dc020495880 x1875453360817536/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573093 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573068.451493:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453360817536/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573093 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573068.451499:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573068.451501:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573068.451503:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360817536:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573068.451507:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360817664:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573068.451516:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573068.451521:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573068/real 1788573068]  req@ffff8dc020496d80 x1875453360817664/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573093 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573068.451528:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453360817664/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573093 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573068.451534:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573068.451535:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573068.451538:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360817664:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573068.451542:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360817792:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573068.451552:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573068.451557:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573068/real 1788573068]  req@ffff8dc020494a80 x1875453360817792/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573093 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573068.451564:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453360817792/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573093 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573068.451577:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573068.451579:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573068.451581:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360817792:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573068.834986:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573068.834987:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573069.858996:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573069.858998:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573070.883017:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573070.883031:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573071.907001:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573071.907002:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573072.930947:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573072.930951:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788573072.930993:0:14038:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1788573073.570937:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573073.570946:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788573073.570950:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573073.570959:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1419
00000100:00080000:2.0:1788573073.570967:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573073.570974:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573073.571006:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453360817920/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573073.571027:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573073.571030:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573073.571031:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573073.571034:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1419
00000100:00080000:2.0:1788573073.571036:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573073.571039:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573073.571046:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573073.571056:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453360818048/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573073.571065:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573073.571067:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573073.571071:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788573073.571072:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360817920:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788573073.571075:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1419
00000100:00080000:2.0:1788573073.571082:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573073.571091:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573073.571096:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573073.571108:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453360818176/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573073.571120:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573073.571122:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573073.571124:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573073.571126:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1419
00000100:00080000:2.0:1788573073.571129:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573073.571132:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573073.571136:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788573073.571147:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573073.571151:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453360818304/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573073.571164:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573073.571168:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573073.571170:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573073.571176:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1419
00000100:00080000:2.0:1788573073.571181:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788573073.571188:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573073/real 1788573073]  req@ffff8dc020494a80 x1875453360817920/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573098 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573073.571188:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573073.571197:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573073.571210:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453360817920/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573098 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573073.571214:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453360818432/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573073.571234:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573073.571236:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573073.571241:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788573073.571242:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573073.571247:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788573073.571249:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360817920:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788573073.571253:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1419
00000100:00080000:2.0:1788573073.571258:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573073.571261:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573073.571264:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573073.571273:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360818048:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788573073.571274:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453360818560/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573073.571287:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573073.571290:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573073.571292:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573073.571295:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1419
00000100:00080000:2.0:1788573073.571297:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1788573073.571299:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788573073.571303:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573073.571308:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573073.571314:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573073/real 1788573073]  req@ffff8dc020496d80 x1875453360818048/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573098 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573073.571320:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453360818688/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788573073.571331:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453360818048/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573098 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573073.571346:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573073.571349:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573073.571352:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360818048:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573073.571357:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360818176:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573073.571370:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573073.571377:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573073/real 1788573073]  req@ffff8dc020495880 x1875453360818176/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573098 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573073.571384:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453360818176/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573098 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573073.571389:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573073.571391:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573073.571393:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360818176:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573073.571396:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360818304:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573073.571406:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573073.571412:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573073/real 1788573073]  req@ffff8dc020494380 x1875453360818304/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573098 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573073.571420:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453360818304/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573098 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573073.571425:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573073.571426:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573073.571428:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360818304:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573073.571431:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360818432:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788573073.571441:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573073.571446:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573073/real 1788573073]  req@ffff8dc020497480 x1875453360818432/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573098 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573073.571453:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453360818432/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573098 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573073.571458:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573073.571460:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573073.571462:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360818432:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573073.571472:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360818560:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573073.571482:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573073.571488:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573073/real 1788573073]  req@ffff8dc020495180 x1875453360818560/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573098 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573073.571494:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453360818560/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573098 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573073.571500:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573073.571502:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573073.571504:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360818560:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573073.571508:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360818688:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573073.571517:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573073.571522:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573073/real 1788573073]  req@ffff8dc020495500 x1875453360818688/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573098 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573073.571529:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453360818688/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573098 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573073.571534:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573073.571545:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573073.571547:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360818688:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573073.955002:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573073.955016:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788573073.955095:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573074.978986:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573074.979000:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788573074.979201:0:14038:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573076.002998:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573076.002998:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788573076.003113:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573077.027004:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573077.027014:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573077.027052:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573078.050994:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573078.051035:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573078.691022:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573078.691154:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360818816:192.168.202.140@tcp:250:kworker.0
00000800:00000100:0.0:1788573078.691213:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573078.691262:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573078/real 1788573078]  req@ffff8dc005dc1c00 x1875453360818816/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573103 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573078.691285:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453360818816/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573103 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573078.691296:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573078.691300:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573078.691304:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360818816:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788573078.691325:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360818944:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788573078.691357:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573078.691369:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573078/real 1788573078]  req@ffff8dc005dc3b80 x1875453360818944/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573103 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573078.691381:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360818944/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573103 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573078.691390:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573078.691394:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573078.691397:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360818944:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573078.691404:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360819072:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573078.691424:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573078.691433:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573078/real 1788573078]  req@ffff8dc005dc3800 x1875453360819072/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573103 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573078.691441:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453360819072/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573103 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573078.691447:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573078.691449:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573078.691459:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360819072:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573078.691467:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360819200:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573078.691479:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573078.691486:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573078/real 1788573078]  req@ffff8dc005dc1500 x1875453360819200/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573103 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573078.691494:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360819200/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573103 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573078.691499:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573078.691501:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573078.691503:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360819200:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573078.691506:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360819328:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788573078.691516:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573078.691522:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573078/real 1788573078]  req@ffff8dc005dc0700 x1875453360819328/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573103 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573078.691529:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453360819328/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573103 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573078.691535:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573078.691537:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573078.691538:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360819328:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573078.691551:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360819456:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573078.691561:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573078.691567:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573078/real 1788573078]  req@ffff8dc005dc1180 x1875453360819456/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573103 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573078.691575:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360819456/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573103 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573078.691579:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573078.691581:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573078.691583:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360819456:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573078.691602:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360819584:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573078.691615:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573078.691622:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573078/real 1788573078]  req@ffff8dc005dc2d80 x1875453360819584/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573103 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573078.691630:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360819584/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573103 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573078.691639:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573078.691642:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573078.691645:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360819584:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573079.074952:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573079.074993:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573079.715045:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573080.098993:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573080.099001:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573080.099048:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573080.739044:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573081.122923:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573081.122999:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573081.763026:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573082.147019:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573082.147052:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573082.787063:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573083.170946:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573083.170962:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573083.170998:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573083.811002:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573083.811385:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573083.811407:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1429
00000100:00080000:1.0:1788573083.811410:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573083.811413:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573083.811419:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573083.811432:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453360820352/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573083.811441:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573083.811445:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573083.811448:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573083.811466:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1429
00000100:00080000:1.0:1788573083.811470:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573083.811473:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573083.811477:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573083.811484:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360820480/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788573084.195002:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573084.195002:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573084.195008:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573084.195041:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788573084.195051:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573084.835041:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573085.218945:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573085.218966:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573085.218987:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573085.859028:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573086.243038:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573086.243038:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573086.243040:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788573086.243194:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573086.883035:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573087.266993:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573087.266993:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573087.267023:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573087.267056:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573087.907048:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573088.291019:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573088.291019:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573088.291031:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573088.291087:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788573088.291099:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1788573088.930986:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788573088.930987:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573088.930998:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788573088.931004:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573088.931014:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1434
00000100:00080000:1.0:1788573088.931026:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573088.931034:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573088.931079:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360820608/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573088.931106:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573088.931108:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573088.931110:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573088.931113:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1434
00000100:00080000:1.0:1788573088.931115:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573088.931118:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573088.931128:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573088.931143:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360820736/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573088.931154:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573088.931158:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573088.931160:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573088.931166:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1434
00000100:00080000:1.0:1788573088.931170:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573088.931176:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573088.931183:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573088.931210:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453360820864/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573088.931220:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573088.931223:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573088.931225:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573088.931228:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1434
00000100:00080000:1.0:1788573088.931231:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573088.931234:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573088.931238:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573088.931247:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360820992/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573088.931253:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573088.931256:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573088.931257:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573088.931260:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1434
00000100:00080000:1.0:1788573088.931263:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573088.931266:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573088.931269:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573088.931275:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360821120/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573088.931282:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573088.931286:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573088.931289:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573088.931293:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1434
00000100:00080000:1.0:1788573088.931297:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573088.931302:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573088.931307:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573088.931321:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360821248/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573088.931333:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573088.931337:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573088.931338:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573088.931345:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1434
00000100:00080000:1.0:1788573088.931350:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573088.931354:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573088.931358:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573088.931373:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360821376/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788573089.315023:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573089.315032:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573089.315032:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573089.315070:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573089.955095:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573090.338998:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573090.338999:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573090.338999:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573090.339040:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788573090.339042:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573090.979079:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573091.363046:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573091.363048:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573091.363049:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573091.363115:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573092.003241:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573092.003590:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573088/real 1788573092]  req@ffff8dc005dc3800 x1875453360820864/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573113 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573092.003630:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453360820864/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573113 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573092.003646:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573092.003653:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573092.003659:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360820864:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573092.003669:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573088/real 1788573092]  req@ffff8dc005dc1500 x1875453360820992/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573113 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573092.003683:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360820992/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573113 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573092.003693:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573092.003696:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573092.003700:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360820992:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573092.003708:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573088/real 1788573092]  req@ffff8dc005dc0700 x1875453360821120/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573113 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573092.003736:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453360821120/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573113 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573092.003747:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573092.003751:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573092.003755:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360821120:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573092.003763:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573088/real 1788573092]  req@ffff8dc005dc1180 x1875453360821248/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573113 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573092.003776:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360821248/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573113 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573092.003789:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573092.003793:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573092.003797:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360821248:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573092.003805:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573088/real 1788573092]  req@ffff8dc005dc2d80 x1875453360821376/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573113 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573092.003819:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360821376/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573113 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573092.003829:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573092.003832:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573092.003836:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360821376:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573092.003843:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573088/real 1788573092]  req@ffff8dc005dc1c00 x1875453360820608/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573113 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573092.003863:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453360820608/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573113 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573092.003913:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573092.003918:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573092.003922:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360820608:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788573092.003931:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573088/real 1788573092]  req@ffff8dc005dc3b80 x1875453360820736/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573113 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573092.003951:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360820736/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573113 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573092.003963:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573092.003967:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573092.003972:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360820736:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573092.386991:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573092.386991:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573092.387000:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788573092.387134:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573093.027015:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573093.411018:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573093.411041:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573093.411079:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00080000:0.0:1788573094.051032:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573094.051041:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788573094.051044:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573094.051054:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1439
00000100:00080000:0.0:1788573094.051065:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573094.051071:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573094.051089:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573094.051121:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453360821504/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573094.051154:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573094.051158:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573094.051160:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573094.051164:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1439
00000100:00080000:0.0:1788573094.051168:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573094.051172:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573094.051183:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573094.051197:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453360821632/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573094.051207:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573094.051210:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573094.051212:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573094.051216:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1439
00000100:00080000:0.0:1788573094.051219:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573094.051223:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573094.051227:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573094.051235:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453360821760/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573094.051243:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573094.051246:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573094.051248:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573094.051250:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1439
00000100:00080000:0.0:1788573094.051254:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573094.051257:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573094.051262:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573094.051270:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453360821888/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573094.051278:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573094.051281:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573094.051282:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573094.051286:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1439
00000100:00080000:0.0:1788573094.051289:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573094.051292:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573094.051296:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573094.051305:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453360822016/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573094.051314:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573094.051317:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573094.051318:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573094.051322:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1439
00000100:00080000:0.0:1788573094.051326:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573094.051329:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573094.051333:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573094.051341:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453360822144/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573094.051355:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573094.051358:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573094.051359:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573094.051363:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1439
00000100:00080000:0.0:1788573094.051367:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573094.051370:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573094.051374:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573094.051383:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453360822272/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788573094.435000:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573094.435000:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573094.435027:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788573094.435133:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573095.075108:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573095.458972:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573095.458972:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573095.459042:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573095.459081:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573096.099032:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573096.483020:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573096.483029:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573096.483031:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573096.483061:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788573096.483085:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573097.123002:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573097.506974:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573097.506974:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573097.507007:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573097.507034:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573098.146986:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573098.530970:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573098.530971:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573098.531049:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788573098.531137:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1788573099.170997:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788573099.171004:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788573099.171010:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788573099.171016:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573099.171027:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1444
00000100:00080000:0.0:1788573099.171040:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573099.171049:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788573099.171093:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711f80 x1875453360822400/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573099.171121:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573099.171125:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573099.171127:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573099.171132:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1444
00000100:00080000:0.0:1788573099.171135:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573099.171140:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573099.171152:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573099.171169:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453360822528/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573099.171180:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573099.171184:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573099.171185:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573099.171189:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1444
00000100:00080000:0.0:1788573099.171192:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573099.171196:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573099.171201:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573099.171213:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453360822656/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573099.171228:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573099.171231:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573099.171232:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573099.171235:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1444
00000100:00080000:0.0:1788573099.171237:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573099.171240:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573099.171244:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573099.171252:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453360822784/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573099.171266:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573099.171269:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573099.171271:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573099.171274:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1444
00000100:00080000:0.0:1788573099.171278:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573099.171280:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573099.171284:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573099.171298:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453360822912/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573099.171308:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573099.171311:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573099.171313:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573099.171316:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1444
00000100:00080000:0.0:1788573099.171318:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573099.171321:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573099.171324:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573099.171332:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453360823040/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573099.171344:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573099.171346:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573099.171350:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573099.171354:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1444
00000100:00080000:0.0:1788573099.171364:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573099.171367:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573099.171371:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573099.171381:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710000 x1875453360823168/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788573099.555002:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573099.555013:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573099.555021:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573100.194986:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573100.578944:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573100.578962:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573100.578979:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573100.579011:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573101.219000:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573101.603024:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573101.603024:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573101.603031:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573101.603073:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573102.242965:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573102.626957:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573102.626957:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573102.627000:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573102.627018:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573103.266999:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573103.651052:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573103.651055:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573103.651056:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573103.651096:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00080000:2.0:1788573104.291016:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573104.291028:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788573104.291033:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573104.291045:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1449
00000100:00080000:2.0:1788573104.291058:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573104.291069:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573104.291118:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497800 x1875453360823296/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573104.291155:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573104.291160:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573104.291162:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573104.291167:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1449
00000100:00080000:2.0:1788573104.291171:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573104.291177:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573104.291189:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573104.291214:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453360823424/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573104.291228:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573104.291233:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573104.291235:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573104.291242:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1449
00000100:00080000:2.0:1788573104.291251:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573104.291275:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573104.291283:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573104.291312:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453360823552/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573104.291391:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573104.291395:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573104.291401:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573104.291415:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1449
00000100:00080000:2.0:1788573104.291428:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573104.291434:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573104.291442:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573104.291453:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453360823680/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573104.291483:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573104.291487:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573104.291490:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573104.291493:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1449
00000100:00080000:2.0:1788573104.291495:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573104.291498:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573104.291502:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573104.291509:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453360823808/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573104.291523:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573104.291532:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573104.291535:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573104.291543:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1449
00000100:00080000:2.0:1788573104.291549:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573104.291560:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573104.291569:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573104.291595:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453360823936/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573104.291669:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573104.291684:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573104.291689:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573104.291703:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1449
00000100:00080000:2.0:1788573104.291710:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573104.291715:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573104.291720:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573104.291742:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496300 x1875453360824064/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788573104.674994:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573104.674999:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573104.675030:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573104.675082:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573105.315046:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573105.698986:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573105.698999:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573105.698999:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573105.699043:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573106.339039:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573106.723009:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573106.723020:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573106.723051:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573106.723059:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788573106.723084:0:37903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 16 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1788573106.723094:0:37903:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 0000000028071151/0xc2934ec3fb6ef74c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800028400000000 nid: local remote: 0x85ace67feb1622e3 expref: -99 pid: 35867 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0
00000080:00200000:2.0:1788573106.723129:0:37903:0:(vvp_io.c:1826:vvp_io_init()) [0x200000401:0xbd:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0
00000080:00200000:2.0:1788573106.723232:0:37903:0:(vvp_io.c:304:vvp_io_fini()) [0x200000401:0xbd:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1
00010000:00010000:2.0:1788573106.723258:0:37903:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 00000000e35bfef4/0xc2934ec3fb6ef71b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800028400000000 nid: local remote: 0x85ace67feb162242 expref: -99 pid: 35867 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0
00000080:00200000:2.0:1788573106.723277:0:37903:0:(vvp_io.c:1826:vvp_io_init()) [0x200000401:0xbf:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0
00000080:00200000:2.0:1788573106.723306:0:37903:0:(vvp_io.c:304:vvp_io_fini()) [0x200000401:0xbf:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1
00010000:00010000:2.0:1788573106.723318:0:37903:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 000000002d0fdcfe/0xc2934ec3fb6ef68f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800028400000000 nid: local remote: 0x85ace67feb16210e expref: -99 pid: 35867 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0
00000080:00200000:2.0:1788573106.723327:0:37903:0:(vvp_io.c:1826:vvp_io_init()) [0x200000401:0xc1:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0
00000080:00200000:2.0:1788573106.723347:0:37903:0:(vvp_io.c:304:vvp_io_fini()) [0x200000401:0xc1:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1
00010000:00010000:2.0:1788573106.723356:0:37903:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 0000000022a30abb/0xc2934ec3fb6ef037 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800028400000000 nid: local remote: 0x85ace67feb160edf expref: -99 pid: 35881 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0
00000080:00200000:2.0:1788573106.723364:0:37903:0:(vvp_io.c:1826:vvp_io_init()) [0x200000401:0x62:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0
00000080:00200000:2.0:1788573106.723380:0:37903:0:(vvp_io.c:304:vvp_io_fini()) [0x200000401:0x62:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1
00010000:00010000:2.0:1788573106.723389:0:37903:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 00000000f74a7c85/0xc2934ec3fb6eefea lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800028400000000 nid: local remote: 0x85ace67feb160e53 expref: -99 pid: 35867 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0
00000080:00200000:2.0:1788573106.723401:0:37903:0:(vvp_io.c:1826:vvp_io_init()) [0x200000401:0x65:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0
00000080:00200000:2.0:1788573106.723417:0:37903:0:(vvp_io.c:304:vvp_io_fini()) [0x200000401:0x65:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1
00010000:00010000:2.0:1788573106.723426:0:37903:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 00000000808d7798/0xc2934ec3fb6eeecb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x800028400000000 nid: local remote: 0x85ace67feb160ac5 expref: -99 pid: 35867 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0
00000080:00200000:2.0:1788573106.723434:0:37903:0:(vvp_io.c:1826:vvp_io_init()) [0x200000401:0x61:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0
00000080:00200000:2.0:1788573106.723456:0:37903:0:(vvp_io.c:304:vvp_io_fini()) [0x200000401:0x61:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1
00010000:00010000:2.0:1788573106.723465:0:37903:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 00000000537fdd6f/0xc2934ec3fb6eef96 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800028400000000 nid: local remote: 0x85ace67feb160dab expref: -99 pid: 35867 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0
00000080:00200000:2.0:1788573106.723473:0:37903:0:(vvp_io.c:1826:vvp_io_init()) [0x200000401:0x66:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0
00000080:00200000:2.0:1788573106.723493:0:37903:0:(vvp_io.c:304:vvp_io_fini()) [0x200000401:0x66:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1
00010000:00010000:2.0:1788573106.723501:0:37903:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 0000000017673c19/0xc2934ec3fb6eeed9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800028400000000 nid: local remote: 0x85ace67feb160b12 expref: -99 pid: 35867 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0
00000080:00200000:2.0:1788573106.723526:0:37903:0:(vvp_io.c:1826:vvp_io_init()) [0x200000401:0x69:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0
00000080:00200000:2.0:1788573106.723544:0:37903:0:(vvp_io.c:304:vvp_io_fini()) [0x200000401:0x69:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1
00010000:00010000:2.0:1788573106.723554:0:37903:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 000000008e369311/0xc2934ec3fb6eec2b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800028400000000 nid: local remote: 0x85ace67feb1606dc expref: -99 pid: 35871 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0
00000080:00200000:2.0:1788573106.723566:0:37903:0:(vvp_io.c:1826:vvp_io_init()) [0x200000401:0xc5:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0
00000080:00200000:2.0:1788573106.723590:0:37903:0:(vvp_io.c:304:vvp_io_fini()) [0x200000401:0xc5:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1
00010000:00010000:2.0:1788573106.723603:0:37903:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 000000007b9091a1/0xc2934ec3fb6eec1d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800028400000000 nid: local remote: 0x85ace67feb1606d5 expref: -99 pid: 35871 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0
00000080:00200000:2.0:1788573106.723614:0:37903:0:(vvp_io.c:1826:vvp_io_init()) [0x200000401:0xc7:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0
00000080:00200000:2.0:1788573106.723632:0:37903:0:(vvp_io.c:304:vvp_io_fini()) [0x200000401:0xc7:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1
00010000:00010000:2.0:1788573106.723641:0:37903:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 000000003efa94a0/0xc2934ec3fb6eebc9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800028400000000 nid: local remote: 0x85ace67feb1605fc expref: -99 pid: 35867 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0
00000080:00200000:2.0:1788573106.723648:0:37903:0:(vvp_io.c:1826:vvp_io_init()) [0x200000401:0xc9:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0
00000080:00200000:2.0:1788573106.723663:0:37903:0:(vvp_io.c:304:vvp_io_fini()) [0x200000401:0xc9:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1
00010000:00010000:2.0:1788573106.723672:0:37903:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 0000000011b6dcfc/0xc2934ec3fb6eeac6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800028400000000 nid: local remote: 0x85ace67feb16031d expref: -99 pid: 35867 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0
00000080:00200000:2.0:1788573106.723679:0:37903:0:(vvp_io.c:1826:vvp_io_init()) [0x200000401:0xc4:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0
00000080:00200000:2.0:1788573106.723692:0:37903:0:(vvp_io.c:304:vvp_io_fini()) [0x200000401:0xc4:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1
00010000:00010000:2.0:1788573106.723700:0:37903:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 00000000ad5b48ec/0xc2934ec3fb6eeab1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800028400000000 nid: local remote: 0x85ace67feb16027c expref: -99 pid: 35867 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0
00000080:00200000:2.0:1788573106.723707:0:37903:0:(vvp_io.c:1826:vvp_io_init()) [0x200000401:0xcd:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0
00000080:00200000:2.0:1788573106.723720:0:37903:0:(vvp_io.c:304:vvp_io_fini()) [0x200000401:0xcd:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1
00010000:00010000:2.0:1788573106.723728:0:37903:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 00000000ea6c7f2f/0xc2934ec3fb6ed4fb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x800028400000000 nid: local remote: 0x85ace67feb15b8ee expref: -99 pid: 34278 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0
00000080:00200000:2.0:1788573106.723736:0:37903:0:(vvp_io.c:1826:vvp_io_init()) [0x200000401:0x5d:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0
00010000:00010000:2.0:1788573106.723751:0:37903:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 00000000f5503386/0xc2934ec3fb6ed4bc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x800020000000000 nid: local remote: 0x85ace67feb15b8af expref: -99 pid: 34253 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1
00000080:00200000:2.0:1788573106.723759:0:37903:0:(vvp_io.c:304:vvp_io_fini()) [0x200000401:0x5d:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1
00010000:00010000:2.0:1788573106.723766:0:37903:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 000000009162de15/0xc2934ec3fb6ed4c3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x800028400000000 nid: local remote: 0x85ace67feb15b8d2 expref: -99 pid: 34257 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0
00000080:00200000:2.0:1788573106.723771:0:37903:0:(vvp_io.c:1826:vvp_io_init()) [0x200000401:0x5d:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0
00010000:00010000:2.0:1788573106.723775:0:37903:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 00000000f5503386/0xc2934ec3fb6ed4bc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x800020000000000 nid: local remote: 0x85ace67feb15b8af expref: -99 pid: 34253 timeout: 0 lvb_type: 1 lru_score: 12 lru_type: 1
00000080:00200000:2.0:1788573106.723782:0:37903:0:(vvp_io.c:304:vvp_io_fini()) [0x200000401:0x5d:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1
00010000:00010000:2.0:1788573106.723789:0:37903:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 000000002146b603/0xc2934ec3fb6ed4d1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x800028400000000 nid: local remote: 0x85ace67feb15b8bd expref: -99 pid: 34261 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0
00000080:00200000:2.0:1788573106.723798:0:37903:0:(vvp_io.c:1826:vvp_io_init()) [0x200000401:0x5d:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0
00010000:00010000:2.0:1788573106.723807:0:37903:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 00000000f5503386/0xc2934ec3fb6ed4bc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x800020000000000 nid: local remote: 0x85ace67feb15b8af expref: -99 pid: 34253 timeout: 0 lvb_type: 1 lru_score: 13 lru_type: 1
00000080:00200000:2.0:1788573106.723816:0:37903:0:(vvp_io.c:304:vvp_io_fini()) [0x200000401:0x5d:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1
00010000:00010000:2.0:1788573106.723864:0:37903:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 0000000028071151/0xc2934ec3fb6ef74c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804869400000020 nid: local remote: 0x85ace67feb1622e3 expref: -99 pid: 35867 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0
00010000:00010000:2.0:1788573106.723902:0:37903:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 00000000e35bfef4/0xc2934ec3fb6ef71b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804869400000020 nid: local remote: 0x85ace67feb162242 expref: -99 pid: 35867 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0
00010000:00010000:2.0:1788573106.723908:0:37903:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 000000002d0fdcfe/0xc2934ec3fb6ef68f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804869400000020 nid: local remote: 0x85ace67feb16210e expref: -99 pid: 35867 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0
00010000:00010000:2.0:1788573106.723913:0:37903:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 0000000022a30abb/0xc2934ec3fb6ef037 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804869400000020 nid: local remote: 0x85ace67feb160edf expref: -99 pid: 35881 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0
00010000:00010000:2.0:1788573106.723917:0:37903:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 00000000f74a7c85/0xc2934ec3fb6eefea lrc: 1/0,0 mode: --/PR res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804869400000020 nid: local remote: 0x85ace67feb160e53 expref: -99 pid: 35867 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0
00010000:00010000:2.0:1788573106.723921:0:37903:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 00000000808d7798/0xc2934ec3fb6eeecb lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x804869400000020 nid: local remote: 0x85ace67feb160ac5 expref: -99 pid: 35867 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0
00010000:00010000:2.0:1788573106.723926:0:37903:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 00000000537fdd6f/0xc2934ec3fb6eef96 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804869400000020 nid: local remote: 0x85ace67feb160dab expref: -99 pid: 35867 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0
00010000:00010000:2.0:1788573106.723930:0:37903:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 0000000017673c19/0xc2934ec3fb6eeed9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804869400000020 nid: local remote: 0x85ace67feb160b12 expref: -99 pid: 35867 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0
00010000:00010000:2.0:1788573106.723940:0:37903:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 000000008e369311/0xc2934ec3fb6eec2b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804869400000020 nid: local remote: 0x85ace67feb1606dc expref: -99 pid: 35871 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0
00010000:00010000:2.0:1788573106.723945:0:37903:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 000000007b9091a1/0xc2934ec3fb6eec1d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804869400000020 nid: local remote: 0x85ace67feb1606d5 expref: -99 pid: 35871 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0
00010000:00010000:2.0:1788573106.723949:0:37903:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 000000003efa94a0/0xc2934ec3fb6eebc9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804869400000020 nid: local remote: 0x85ace67feb1605fc expref: -99 pid: 35867 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0
00010000:00010000:2.0:1788573106.723953:0:37903:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 0000000011b6dcfc/0xc2934ec3fb6eeac6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804869400000020 nid: local remote: 0x85ace67feb16031d expref: -99 pid: 35867 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0
00010000:00010000:2.0:1788573106.723958:0:37903:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 00000000ad5b48ec/0xc2934ec3fb6eeab1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804869400000020 nid: local remote: 0x85ace67feb16027c expref: -99 pid: 35867 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0
00010000:00010000:2.0:1788573106.723962:0:37903:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 00000000ea6c7f2f/0xc2934ec3fb6ed4fb lrc: 1/0,0 mode: --/PR res: [0x280000400:0x27:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x804869400000020 nid: local remote: 0x85ace67feb15b8ee expref: -99 pid: 34278 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1788573106.723966:0:37903:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 000000009162de15/0xc2934ec3fb6ed4c3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x27:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x804869400000020 nid: local remote: 0x85ace67feb15b8d2 expref: -99 pid: 34257 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1788573106.723970:0:37903:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 000000002146b603/0xc2934ec3fb6ed4d1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x27:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x804869400000020 nid: local remote: 0x85ace67feb15b8bd expref: -99 pid: 34261 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1788573106.723974:0:37903:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 16 locks packed
00010000:00010000:2.0:1788573106.724007:0:37903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 0000000028071151/0xc2934ec3fb6ef74c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804869400000020 nid: local remote: 0x85ace67feb1622e3 expref: -99 pid: 35867 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0
00010000:00010000:2.0:1788573106.724037:0:37903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 00000000e35bfef4/0xc2934ec3fb6ef71b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804869400000020 nid: local remote: 0x85ace67feb162242 expref: -99 pid: 35867 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0
00010000:00010000:2.0:1788573106.724053:0:37903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 000000002d0fdcfe/0xc2934ec3fb6ef68f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804869400000020 nid: local remote: 0x85ace67feb16210e expref: -99 pid: 35867 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0
00010000:00010000:2.0:1788573106.724070:0:37903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 0000000022a30abb/0xc2934ec3fb6ef037 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804869400000020 nid: local remote: 0x85ace67feb160edf expref: -99 pid: 35881 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0
00010000:00010000:2.0:1788573106.724083:0:37903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 00000000f74a7c85/0xc2934ec3fb6eefea lrc: 0/0,0 mode: --/PR res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804869400000020 nid: local remote: 0x85ace67feb160e53 expref: -99 pid: 35867 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0
00010000:00010000:2.0:1788573106.724099:0:37903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 00000000808d7798/0xc2934ec3fb6eeecb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x804869400000020 nid: local remote: 0x85ace67feb160ac5 expref: -99 pid: 35867 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0
00010000:00010000:2.0:1788573106.724119:0:37903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 00000000537fdd6f/0xc2934ec3fb6eef96 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804869400000020 nid: local remote: 0x85ace67feb160dab expref: -99 pid: 35867 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0
00010000:00010000:2.0:1788573106.724139:0:37903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 0000000017673c19/0xc2934ec3fb6eeed9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804869400000020 nid: local remote: 0x85ace67feb160b12 expref: -99 pid: 35867 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0
00010000:00010000:2.0:1788573106.724155:0:37903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 000000008e369311/0xc2934ec3fb6eec2b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804869400000020 nid: local remote: 0x85ace67feb1606dc expref: -99 pid: 35871 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0
00010000:00010000:2.0:1788573106.724176:0:37903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 000000007b9091a1/0xc2934ec3fb6eec1d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804869400000020 nid: local remote: 0x85ace67feb1606d5 expref: -99 pid: 35871 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0
00010000:00010000:2.0:1788573106.724186:0:37903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 000000003efa94a0/0xc2934ec3fb6eebc9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804869400000020 nid: local remote: 0x85ace67feb1605fc expref: -99 pid: 35867 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0
00010000:00010000:2.0:1788573106.724195:0:37903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 0000000011b6dcfc/0xc2934ec3fb6eeac6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804869400000020 nid: local remote: 0x85ace67feb16031d expref: -99 pid: 35867 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0
00010000:00010000:2.0:1788573106.724203:0:37903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 00000000ad5b48ec/0xc2934ec3fb6eeab1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804869400000020 nid: local remote: 0x85ace67feb16027c expref: -99 pid: 35867 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0
00010000:00010000:2.0:1788573106.724211:0:37903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 00000000ea6c7f2f/0xc2934ec3fb6ed4fb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x27:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x804869400000020 nid: local remote: 0x85ace67feb15b8ee expref: -99 pid: 34278 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1788573106.724217:0:37903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 000000009162de15/0xc2934ec3fb6ed4c3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x804869400000020 nid: local remote: 0x85ace67feb15b8d2 expref: -99 pid: 34257 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1788573106.724223:0:37903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 000000002146b603/0xc2934ec3fb6ed4d1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x804869400000020 nid: local remote: 0x85ace67feb15b8bd expref: -99 pid: 34261 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1788573106.724230:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1788573106.724232:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1788573106.724233:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573107.363015:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573107.746964:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573107.746964:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573107.746967:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573108.387001:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573108.770973:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573108.770975:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573108.771034:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788573108.771091:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1788573109.411059:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573109.411070:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788573109.411076:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573109.411090:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1455
00000100:00080000:2.0:1788573109.411112:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573109.411124:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573109.411177:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453360824320/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573109.411202:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573109.411205:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573109.411206:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573109.411210:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1455
00000100:00080000:2.0:1788573109.411213:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573109.411217:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573109.411227:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573109.411239:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453360824448/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573109.411252:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573109.411260:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573109.411261:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573109.411265:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1455
00000100:00080000:2.0:1788573109.411267:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573109.411270:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573109.411275:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573109.411287:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453360824576/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573109.411301:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573109.411305:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573109.411307:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573109.411312:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1455
00000100:00080000:2.0:1788573109.411318:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573109.411321:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573109.411325:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573109.411336:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453360824704/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573109.411344:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573109.411347:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573109.411349:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573109.411354:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1455
00000100:00080000:2.0:1788573109.411360:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573109.411365:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573109.411371:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573109.411388:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453360824832/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573109.411439:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573109.411455:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573109.411458:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573109.411467:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1455
00000100:00080000:2.0:1788573109.411473:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573109.411492:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573109.411503:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573109.411528:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497800 x1875453360824960/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573109.411544:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573109.411550:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573109.411556:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573109.411567:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1455
00000100:00080000:2.0:1788573109.411572:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573109.411576:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573109.411581:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573109.411595:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453360825088/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788573109.794980:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573109.794994:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573109.795022:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573109.795053:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573110.819008:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573110.819008:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573110.819019:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573110.819047:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788573110.819066:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573111.842980:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573111.842980:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573111.842980:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573111.843014:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573112.867008:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573112.867008:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573112.867008:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573112.867050:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788573112.867071:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573113.890991:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573113.890991:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573113.890991:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573113.891025:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573113.891046:0:14038:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1788573114.530989:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573114.530998:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788573114.531002:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573114.531013:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1460
00000100:00080000:2.0:1788573114.531026:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573114.531034:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573114.531088:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453360825216/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573114.531123:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573114.531127:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573114.531129:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573114.531133:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1460
00000100:00080000:2.0:1788573114.531137:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573114.531143:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573114.531156:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573114.531176:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453360825344/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573114.531197:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573114.531202:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573114.531205:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573114.531227:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1460
00000100:00080000:2.0:1788573114.531231:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573114.531236:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573114.531242:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573114.531254:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453360825472/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573114.531270:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573114.531274:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573114.531276:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573114.531281:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1460
00000100:00080000:2.0:1788573114.531286:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573114.531289:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573114.531294:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573114.531304:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453360825600/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573114.531312:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573114.531318:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573114.531324:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573114.531340:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1460
00000100:00080000:2.0:1788573114.531347:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573114.531351:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573114.531356:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573114.531376:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453360825728/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573114.531402:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573114.531409:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573114.531413:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573114.531428:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1460
00000100:00080000:2.0:1788573114.531433:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573114.531436:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573114.531439:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573114.531454:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453360825856/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573114.531466:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573114.531469:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573114.531470:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573114.531476:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1460
00000100:00080000:2.0:1788573114.531484:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573114.531493:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573114.531497:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573114.531508:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453360825984/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788573114.915012:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573114.915012:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573114.915012:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573114.915047:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788573114.915071:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573115.938945:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573115.938945:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573115.938968:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573115.938994:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788573115.939062:0:14038:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573116.963023:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573116.963033:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573116.963065:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788573116.963129:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573117.986951:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573117.986973:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573117.986978:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573117.987094:0:14038:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573119.011025:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573119.011034:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573119.011102:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788573119.011114:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573119.011125:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573119.651027:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573119.651036:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788573119.651041:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573119.651051:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1465
00000100:00080000:1.0:1788573119.651062:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573119.651071:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573119.651166:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453360826112/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573119.651202:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573119.651205:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573119.651206:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573119.651210:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1465
00000100:00080000:1.0:1788573119.651213:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573119.651217:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573119.651225:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573119.651238:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360826240/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573119.651247:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573119.651251:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573119.651254:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573119.651261:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1465
00000100:00080000:1.0:1788573119.651264:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573119.651267:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573119.651271:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573119.651284:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360826368/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573119.651292:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573119.651294:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573119.651297:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573119.651300:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1465
00000100:00080000:1.0:1788573119.651304:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573119.651310:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573119.651316:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573119.651330:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360826496/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573119.651340:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573119.651344:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573119.651348:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573119.651354:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1465
00000100:00080000:1.0:1788573119.651358:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573119.651362:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573119.651367:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573119.651375:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360826624/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573119.651382:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573119.651384:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573119.651386:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573119.651391:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1465
00000100:00080000:1.0:1788573119.651395:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573119.651398:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573119.651401:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573119.651412:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360826752/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573119.651459:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573119.651462:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573119.651465:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573119.651468:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1465
00000100:00080000:1.0:1788573119.651472:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573119.651477:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573119.651483:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573119.651496:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360826880/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788573120.034947:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573120.034947:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573120.034979:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788573120.034980:0:14038:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573120.035016:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573121.058977:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573121.059003:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788573121.059030:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573121.059046:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573122.082970:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573122.082974:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573122.083014:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788573122.083020:0:14038:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573122.083041:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573123.106999:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573123.106999:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573123.107035:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788573123.107040:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573123.107046:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573124.131018:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573124.131027:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573124.131065:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573124.131087:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788573124.131265:0:14038:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 16 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1788573124.131279:0:14038:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8dc01049b800 lock: ffff8dc008122a00/0xc2934ec3fb6ed533 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x85ace67feb15b9ab expref: -99 pid: 35666 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0
00010000:00010000:1.0:1788573124.131293:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1788573124.131324:0:14038:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8dc01049b800 lock: ffff8dc001473c00/0xc2934ec3fb6eee1c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x85ace67feb1608e2 expref: -99 pid: 35867 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0
00000080:00200000:0.0:1788573124.131342:0:14038:0:(vvp_object.c:117:vvp_conf_set()) [0x200000401:0x6a:0x0]: losing layout lock
00010000:00010000:0.0:1788573124.131374:0:14038:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8dc01049b800 lock: ffff8dc0204a1400/0xc2934ec3fb6eebf3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x85ace67feb160688 expref: -99 pid: 35871 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 0
00000080:00200000:0.0:1788573124.131383:0:14038:0:(vvp_object.c:117:vvp_conf_set()) [0x200000401:0xc5:0x0]: losing layout lock
00010000:00010000:0.0:1788573124.131394:0:14038:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8dc01049b800 lock: ffff8dc0204a0800/0xc2934ec3fb6eebec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x85ace67feb16066c expref: -99 pid: 35871 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 0
00000080:00200000:0.0:1788573124.131402:0:14038:0:(vvp_object.c:117:vvp_conf_set()) [0x200000401:0xc6:0x0]: losing layout lock
00010000:00010000:0.0:1788573124.131409:0:14038:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8dc01049b800 lock: ffff8dc005f36c00/0xc2934ec3fb6eebd7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x85ace67feb16062d expref: -99 pid: 35867 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0
00000080:00200000:0.0:1788573124.131416:0:14038:0:(vvp_object.c:117:vvp_conf_set()) [0x200000401:0xc8:0x0]: losing layout lock
00010000:00010000:0.0:1788573124.131426:0:14038:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8dc01049b800 lock: ffff8dc000031600/0xc2934ec3fb6eebbb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x85ace67feb1605ee expref: -99 pid: 35867 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0
00000080:00200000:0.0:1788573124.131432:0:14038:0:(vvp_object.c:117:vvp_conf_set()) [0x200000401:0xc9:0x0]: losing layout lock
00010000:00010000:0.0:1788573124.131439:0:14038:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8dc01049b800 lock: ffff8dc003524a00/0xc2934ec3fb6eeb75 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xca:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x85ace67feb160577 expref: -99 pid: 35867 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0
00000080:00200000:0.0:1788573124.131446:0:14038:0:(vvp_object.c:117:vvp_conf_set()) [0x200000401:0xca:0x0]: losing layout lock
00010000:00010000:0.0:1788573124.131455:0:14038:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8dc01049b800 lock: ffff8dc00346c800/0xc2934ec3fb6eeb2f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x85ace67feb1604cf expref: -99 pid: 35867 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0
00000080:00200000:0.0:1788573124.131463:0:14038:0:(vvp_object.c:117:vvp_conf_set()) [0x200000401:0xcb:0x0]: losing layout lock
00010000:00010000:0.0:1788573124.131472:0:14038:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8dc01049b800 lock: ffff8dc006c2e600/0xc2934ec3fb6eeae9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x85ace67feb1603e8 expref: -99 pid: 35867 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0
00000080:00200000:0.0:1788573124.131479:0:14038:0:(vvp_object.c:117:vvp_conf_set()) [0x200000401:0xcc:0x0]: losing layout lock
00010000:00010000:0.0:1788573124.131488:0:14038:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8dc01049b800 lock: ffff8dc006c2f000/0xc2934ec3fb6eeaaa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xcd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x85ace67feb16026e expref: -99 pid: 35867 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0
00000080:00200000:0.0:1788573124.131495:0:14038:0:(vvp_object.c:117:vvp_conf_set()) [0x200000401:0xcd:0x0]: losing layout lock
00010000:00010000:0.0:1788573124.131503:0:14038:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8dc01049b800 lock: ffff8dc005f36e00/0xc2934ec3fb6eea9c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x85ace67feb160221 expref: -99 pid: 35867 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0
00010000:00010000:0.0:1788573124.131574:0:14038:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8dc01049b800 lock: ffff8dc0204a1a00/0xc2934ec3fb6ed977 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x97:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x85ace67feb15c99c expref: -99 pid: 35666 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0
00010000:00010000:0.0:1788573124.131592:0:14038:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8dc01049b800 lock: ffff8dc006dfce00/0xc2934ec3fb6f07b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x97:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x85ace67feb1649cc expref: -99 pid: 35867 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0
00010000:00010000:0.0:1788573124.131602:0:14038:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8dc01049b800 lock: ffff8dc0080dd800/0xc2934ec3fb6edcdb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x85ace67feb15d64c expref: -99 pid: 35666 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0
00010000:00010000:0.0:1788573124.131609:0:14038:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8dc01049b800 lock: ffff8dc020481400/0xc2934ec3fb6ed89e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x8c:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x85ace67feb15c670 expref: -99 pid: 35666 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0
00010000:00010000:0.0:1788573124.131616:0:14038:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8dc01049b800 lock: ffff8dc006495400/0xc2934ec3fb6f0a4d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x8c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x85ace67feb164c6c expref: -99 pid: 35867 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0
00010000:00010000:0.0:1788573124.131624:0:14038:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8dc01049b800 lock: ffff8dc006a1de00/0xc2934ec3fb6ed52c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x85ace67feb15b981 expref: -99 pid: 35666 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00010000:00010000:0.0:1788573124.131631:0:14038:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8dc01049b800 lock: ffff8dc0062c2e00/0xc2934ec3fb6eddbb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x85ace67feb15d96a expref: -99 pid: 35693 timeout: 0 lvb_type: 0 lru_score: 108 lru_type: 1
00010000:00010000:0.0:1788573124.131638:0:14038:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8dc01049b800 lock: ffff8dc006a1c400/0xc2934ec3fb6ed525 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5e:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x85ace67feb15b957 expref: -99 pid: 35666 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00010000:00010000:0.0:1788573124.131644:0:14038:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8dc01049b800 lock: ffff8dc0420e6c00/0xc2934ec3fb6ede16 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x85ace67feb15da9e expref: -99 pid: 35696 timeout: 0 lvb_type: 0 lru_score: 101 lru_type: 1
00010000:00010000:0.0:1788573124.131715:0:14038:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8dc01049b800 lock: ffff8dc008122a00/0xc2934ec3fb6ed533 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x60:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x85ace67feb15b9ab expref: -99 pid: 35666 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0
00010000:00010000:0.0:1788573124.131722:0:14038:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8dc01049b800 lock: ffff8dc001473c00/0xc2934ec3fb6eee1c lrc: 1/0,0 mode: --/PR res: [0x200000401:0x6a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x85ace67feb1608e2 expref: -99 pid: 35867 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0
00010000:00010000:0.0:1788573124.131727:0:14038:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8dc01049b800 lock: ffff8dc0204a1400/0xc2934ec3fb6eebf3 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x85ace67feb160688 expref: -99 pid: 35871 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 0
00010000:00010000:0.0:1788573124.131731:0:14038:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8dc01049b800 lock: ffff8dc0204a0800/0xc2934ec3fb6eebec lrc: 1/0,0 mode: --/PR res: [0x200000401:0xc6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x85ace67feb16066c expref: -99 pid: 35871 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 0
00010000:00010000:0.0:1788573124.131736:0:14038:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8dc01049b800 lock: ffff8dc005f36c00/0xc2934ec3fb6eebd7 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x85ace67feb16062d expref: -99 pid: 35867 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0
00010000:00010000:0.0:1788573124.131740:0:14038:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8dc01049b800 lock: ffff8dc000031600/0xc2934ec3fb6eebbb lrc: 1/0,0 mode: --/PR res: [0x200000401:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x85ace67feb1605ee expref: -99 pid: 35867 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0
00010000:00010000:0.0:1788573124.131744:0:14038:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8dc01049b800 lock: ffff8dc003524a00/0xc2934ec3fb6eeb75 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xca:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x85ace67feb160577 expref: -99 pid: 35867 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0
00010000:00010000:0.0:1788573124.131765:0:14038:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8dc01049b800 lock: ffff8dc00346c800/0xc2934ec3fb6eeb2f lrc: 1/0,0 mode: --/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x85ace67feb1604cf expref: -99 pid: 35867 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0
00010000:00010000:0.0:1788573124.131771:0:14038:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8dc01049b800 lock: ffff8dc006c2e600/0xc2934ec3fb6eeae9 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x85ace67feb1603e8 expref: -99 pid: 35867 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0
00010000:00010000:0.0:1788573124.131777:0:14038:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8dc01049b800 lock: ffff8dc006c2f000/0xc2934ec3fb6eeaaa lrc: 1/0,0 mode: --/PR res: [0x200000401:0xcd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x85ace67feb16026e expref: -99 pid: 35867 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0
00010000:00010000:0.0:1788573124.131782:0:14038:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8dc01049b800 lock: ffff8dc005f36e00/0xc2934ec3fb6eea9c lrc: 1/0,0 mode: --/PR res: [0x200000401:0xc3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x85ace67feb160221 expref: -99 pid: 35867 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0
00010000:00010000:0.0:1788573124.131789:0:14038:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8dc01049b800 lock: ffff8dc0204a1a00/0xc2934ec3fb6ed977 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x97:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x85ace67feb15c99c expref: -99 pid: 35666 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0
00010000:00010000:0.0:1788573124.131796:0:14038:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8dc01049b800 lock: ffff8dc0080dd800/0xc2934ec3fb6edcdb lrc: 1/0,0 mode: --/PR res: [0x200000401:0xc3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x85ace67feb15d64c expref: -99 pid: 35666 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0
00010000:00010000:0.0:1788573124.131801:0:14038:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8dc01049b800 lock: ffff8dc020481400/0xc2934ec3fb6ed89e lrc: 1/0,0 mode: --/PR res: [0x200000401:0x8c:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x85ace67feb15c670 expref: -99 pid: 35666 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0
00010000:00010000:0.0:1788573124.131807:0:14038:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8dc01049b800 lock: ffff8dc006a1de00/0xc2934ec3fb6ed52c lrc: 1/0,0 mode: --/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x85ace67feb15b981 expref: -99 pid: 35666 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00010000:00010000:0.0:1788573124.131813:0:14038:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8dc01049b800 lock: ffff8dc006a1c400/0xc2934ec3fb6ed525 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x5e:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x85ace67feb15b957 expref: -99 pid: 35666 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00010000:00010000:0.0:1788573124.131818:0:14038:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 16 locks packed
00000100:00080000:1.0:1788573124.131918:0:2348:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN)  req@ffff8dc006710000 x1875453360827008/t0(0) o103->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:17/18 lens 440/224 e 0 to 0 dl 0 ref 1 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295
00010000:00010000:0.0:1788573124.131932:0:14038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8dc01049b800 lock: ffff8dc008122a00/0xc2934ec3fb6ed533 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x60:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x85ace67feb15b9ab expref: -99 pid: 35666 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0
00010000:00010000:0.0:1788573124.131963:0:14038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8dc01049b800 lock: ffff8dc001473c00/0xc2934ec3fb6eee1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x85ace67feb1608e2 expref: -99 pid: 35867 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0
00010000:00010000:0.0:1788573124.131991:0:14038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8dc01049b800 lock: ffff8dc0204a1400/0xc2934ec3fb6eebf3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x85ace67feb160688 expref: -99 pid: 35871 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 0
00010000:00010000:0.0:1788573124.132014:0:14038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8dc01049b800 lock: ffff8dc0204a0800/0xc2934ec3fb6eebec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x85ace67feb16066c expref: -99 pid: 35871 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 0
00010000:00010000:0.0:1788573124.132033:0:14038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8dc01049b800 lock: ffff8dc005f36c00/0xc2934ec3fb6eebd7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x85ace67feb16062d expref: -99 pid: 35867 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0
00010000:00010000:0.0:1788573124.132045:0:14038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8dc01049b800 lock: ffff8dc000031600/0xc2934ec3fb6eebbb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x85ace67feb1605ee expref: -99 pid: 35867 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0
00010000:00010000:0.0:1788573124.132059:0:14038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8dc01049b800 lock: ffff8dc003524a00/0xc2934ec3fb6eeb75 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xca:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x85ace67feb160577 expref: -99 pid: 35867 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0
00010000:00010000:0.0:1788573124.132072:0:14038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8dc01049b800 lock: ffff8dc00346c800/0xc2934ec3fb6eeb2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x85ace67feb1604cf expref: -99 pid: 35867 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0
00010000:00010000:0.0:1788573124.132087:0:14038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8dc01049b800 lock: ffff8dc006c2e600/0xc2934ec3fb6eeae9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x85ace67feb1603e8 expref: -99 pid: 35867 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0
00010000:00010000:0.0:1788573124.132099:0:14038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8dc01049b800 lock: ffff8dc006c2f000/0xc2934ec3fb6eeaaa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xcd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x85ace67feb16026e expref: -99 pid: 35867 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0
00010000:00010000:0.0:1788573124.132108:0:14038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8dc01049b800 lock: ffff8dc005f36e00/0xc2934ec3fb6eea9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x85ace67feb160221 expref: -99 pid: 35867 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0
00010000:00010000:0.0:1788573124.132113:0:14038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8dc01049b800 lock: ffff8dc0204a1a00/0xc2934ec3fb6ed977 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x97:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x85ace67feb15c99c expref: -99 pid: 35666 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0
00010000:00010000:0.0:1788573124.132119:0:14038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8dc01049b800 lock: ffff8dc0080dd800/0xc2934ec3fb6edcdb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x85ace67feb15d64c expref: -99 pid: 35666 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0
00010000:00010000:0.0:1788573124.132132:0:14038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8dc01049b800 lock: ffff8dc020481400/0xc2934ec3fb6ed89e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x8c:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x85ace67feb15c670 expref: -99 pid: 35666 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0
00010000:00010000:0.0:1788573124.132138:0:14038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8dc01049b800 lock: ffff8dc006a1de00/0xc2934ec3fb6ed52c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x85ace67feb15b981 expref: -99 pid: 35666 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00010000:00010000:0.0:1788573124.132144:0:14038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8dc01049b800 lock: ffff8dc006a1c400/0xc2934ec3fb6ed525 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5e:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x85ace67feb15b957 expref: -99 pid: 35666 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00010000:00010000:0.0:1788573124.132152:0:14038:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1788573124.132154:0:14038:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1788573124.132156:0:14038:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1788573124.771067:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573124.771077:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788573124.771083:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573124.771097:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1470
00000100:00080000:0.0:1788573124.771112:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573124.771123:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788573124.771179:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453360827136/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573124.771215:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573124.771219:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573124.771222:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573124.771227:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1470
00000100:00080000:0.0:1788573124.771233:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573124.771239:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573124.771253:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573124.771273:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453360827264/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573124.771288:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573124.771292:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573124.771295:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573124.771300:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1470
00000100:00080000:0.0:1788573124.771316:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573124.771322:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573124.771329:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573124.771347:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453360827392/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573124.771384:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573124.771389:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573124.771391:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573124.771396:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1470
00000100:00080000:0.0:1788573124.771401:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573124.771406:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573124.771413:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573124.771433:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453360827520/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573124.771464:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573124.771470:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573124.771475:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573124.771488:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1470
00000100:00080000:0.0:1788573124.771493:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573124.771500:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573124.771506:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573124.771522:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453360827648/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573124.771537:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573124.771541:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573124.771544:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573124.771550:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1470
00000100:00080000:0.0:1788573124.771558:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573124.771565:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573124.771573:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573124.771596:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711f80 x1875453360827776/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573124.771619:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573124.771626:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573124.771631:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573124.771637:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1470
00000100:00080000:0.0:1788573124.771643:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573124.771648:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573124.771656:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573124.771676:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453360827904/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788573125.154987:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573125.154987:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573125.154988:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573125.155026:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788573125.155038:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573126.179007:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573126.179007:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573126.179019:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573126.179053:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788573126.179073:0:14038:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573127.203011:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573127.203011:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573127.203016:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573127.203051:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573128.227023:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573128.227023:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573128.227023:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573128.227064:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788573128.227107:0:14038:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573129.250969:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573129.251010:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573129.251017:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573129.890990:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573129.890997:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788573129.891002:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573129.891012:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1475
00000100:00080000:1.0:1788573129.891023:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573129.891031:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573129.891068:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453360828032/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573129.891094:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573129.891098:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573129.891100:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573129.891104:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1475
00000100:00080000:1.0:1788573129.891108:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573129.891113:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573129.891124:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573129.891141:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360828160/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573129.891154:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573129.891158:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573129.891159:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573129.891163:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1475
00000100:00080000:1.0:1788573129.891168:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573129.891171:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573129.891178:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573129.891190:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360828288/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573129.891208:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573129.891212:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573129.891214:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573129.891220:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1475
00000100:00080000:1.0:1788573129.891224:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573129.891228:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573129.891234:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573129.891261:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360828416/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573129.891284:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573129.891289:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573129.891291:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573129.891297:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1475
00000100:00080000:1.0:1788573129.891301:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573129.891310:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573129.891316:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573129.891332:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360828544/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573129.891345:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573129.891352:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573129.891356:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573129.891366:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1475
00000100:00080000:1.0:1788573129.891372:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573129.891381:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573129.891387:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573129.891404:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360828672/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573129.891419:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573129.891424:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573129.891429:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573129.891435:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1475
00000100:00080000:1.0:1788573129.891441:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573129.891451:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573129.891462:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573129.891478:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360828800/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788573130.275020:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573130.275020:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573130.275023:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788573130.275136:0:14038:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573131.298998:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573131.298999:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573131.299043:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573131.299087:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788573131.299106:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573132.323023:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573132.323024:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573132.323024:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573132.323084:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573133.346967:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573133.346967:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573133.347012:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573133.347035:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573134.370969:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573134.370972:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573134.371015:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573134.371016:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573135.011035:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788573135.011052:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573135.011062:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788573135.011066:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573135.011078:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1480
00000100:00080000:0.0:1788573135.011087:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573135.011093:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788573135.011128:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453360828928/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573135.011155:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573135.011158:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573135.011159:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573135.011162:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1480
00000100:00080000:0.0:1788573135.011165:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573135.011170:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573135.011181:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573135.011193:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453360829056/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573135.011207:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573135.011211:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573135.011213:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573135.011217:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1480
00000100:00080000:0.0:1788573135.011219:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573135.011222:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573135.011226:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573135.011238:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453360829184/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573135.011244:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573135.011247:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573135.011248:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573135.011250:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1480
00000100:00080000:0.0:1788573135.011253:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573135.011255:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573135.011260:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573135.011266:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453360829312/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573135.011276:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573135.011280:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573135.011281:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573135.011284:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1480
00000100:00080000:0.0:1788573135.011286:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573135.011288:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573135.011291:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573135.011301:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453360829440/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573135.011311:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573135.011314:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573135.011316:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573135.011319:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1480
00000100:00080000:0.0:1788573135.011322:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573135.011325:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573135.011329:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573135.011337:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453360829568/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573135.011344:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573135.011346:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573135.011348:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573135.011351:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1480
00000100:00080000:0.0:1788573135.011356:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573135.011365:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573135.011379:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573135.011400:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453360829696/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788573135.394953:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573135.394974:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573135.395014:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573136.034982:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573136.419005:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573136.419005:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573136.419005:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573137.059005:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573137.443006:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573137.443011:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573137.443044:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573138.082955:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573138.467023:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573138.467024:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573138.467024:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788573138.467165:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1788573138.468055:0:2350:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN)  req@ffff8dc006e56d80 x1875453360829824/t0(0) o103->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:17/18 lens 440/224 e 0 to 0 dl 0 ref 1 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573139.106935:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573139.490963:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573139.490963:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573139.490971:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573139.491108:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788573139.491196:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573140.131024:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573140.131108:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006e54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360829952:192.168.202.140@tcp:250:kworker.0
00000800:00000100:0.0:1788573140.131168:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573140.131220:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573140/real 1788573140]  req@ffff8dc006e54380 x1875453360829952/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573165 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573140.131246:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006e54380 x1875453360829952/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573165 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573140.131285:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573140.131293:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573140.131302:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006e54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360829952:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788573140.131332:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006e57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360830080:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788573140.131358:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573140.131370:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573140/real 1788573140]  req@ffff8dc006e57480 x1875453360830080/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573165 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573140.131386:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006e57480 x1875453360830080/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573165 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573140.131396:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573140.131400:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573140.131403:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006e57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360830080:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573140.131410:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006e56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360830208:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573140.131433:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573140.131453:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573140/real 1788573140]  req@ffff8dc006e56300 x1875453360830208/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573165 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573140.131461:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006e56300 x1875453360830208/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573165 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573140.131468:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573140.131470:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573140.131472:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006e56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360830208:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573140.131476:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360830336:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573140.131490:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573140.131496:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573140/real 1788573140]  req@ffff8dc006e55180 x1875453360830336/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573165 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573140.131503:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006e55180 x1875453360830336/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573165 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573140.131513:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573140.131515:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573140.131517:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360830336:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573140.131521:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006e56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360830464:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788573140.131531:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573140.131537:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573140/real 1788573140]  req@ffff8dc006e56680 x1875453360830464/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573165 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573140.131550:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006e56680 x1875453360830464/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573165 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573140.131556:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573140.131559:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573140.131562:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006e56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360830464:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573140.131568:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360830592:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573140.131587:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573140.131599:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573140/real 1788573140]  req@ffff8dc006e54000 x1875453360830592/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573165 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573140.131612:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006e54000 x1875453360830592/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573165 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573140.131619:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573140.131621:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573140.131624:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360830592:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573140.131640:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006e56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360830720:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573140.131654:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573140.131661:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573140/real 1788573140]  req@ffff8dc006e56a00 x1875453360830720/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573165 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573140.131669:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006e56a00 x1875453360830720/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573165 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573140.131674:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573140.131676:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573140.131678:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006e56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360830720:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573140.515008:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573140.515008:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573140.515019:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788573140.515062:0:14038:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573140.515066:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573141.154992:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573141.538975:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573141.538975:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573141.539009:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573141.539043:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573142.179017:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573142.562976:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573142.562976:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573142.563018:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573142.563022:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573143.203035:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573143.586959:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573143.586960:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573143.586960:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573143.586993:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788573143.587079:0:14038:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1788573143.587713:0:2349:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN)  req@ffff8dc006e55880 x1875453360830848/t0(0) o103->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:17/18 lens 488/224 e 0 to 0 dl 0 ref 1 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573144.226983:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573144.610968:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573144.610972:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573144.610972:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788573144.611031:0:14038:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1788573145.251012:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573145.251021:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788573145.251025:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573145.251036:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1490
00000100:00080000:2.0:1788573145.251049:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573145.251056:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573145.251121:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453360830976/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573145.251154:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573145.251156:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573145.251158:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573145.251161:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1490
00000100:00080000:2.0:1788573145.251164:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573145.251167:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573145.251177:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573145.251188:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497800 x1875453360831104/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573145.251195:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573145.251199:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573145.251201:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573145.251206:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1490
00000100:00080000:2.0:1788573145.251211:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788573145.251213:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360830976:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788573145.251219:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573145.251228:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573145.251242:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453360831232/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573145.251255:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573145.251259:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573145.251261:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573145.251265:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1490
00000100:00080000:2.0:1788573145.251270:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573145.251274:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573145.251279:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788573145.251293:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573145.251294:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453360831360/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573145.251304:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573145.251306:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573145.251308:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573145.251312:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1490
00000100:00080000:2.0:1788573145.251315:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573145.251319:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573145.251322:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573145.251332:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453360831488/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573145.251339:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573145.251342:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573145.251344:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788573145.251347:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573145/real 1788573145]  req@ffff8dc020495500 x1875453360830976/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573170 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573145.251350:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1490
00000100:00080000:2.0:1788573145.251355:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573145.251361:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573145.251367:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573145.251376:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453360830976/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573170 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573145.251379:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453360831616/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573145.251398:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573145.251399:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573145.251405:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573145.251409:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788573145.251409:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573145.251417:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1490
00000100:00080000:2.0:1788573145.251421:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788573145.251422:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360830976:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788573145.251426:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573145.251433:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573145.251441:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360831104:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788573145.251443:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453360831744/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1788573145.251478:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573145.251490:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573145/real 1788573145]  req@ffff8dc020497800 x1875453360831104/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573170 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573145.251500:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497800 x1875453360831104/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573170 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573145.251508:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573145.251510:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573145.251513:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360831104:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573145.251537:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360831232:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573145.251551:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573145.251558:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573145/real 1788573145]  req@ffff8dc020494000 x1875453360831232/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573170 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573145.251566:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453360831232/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573170 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573145.251573:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573145.251574:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573145.251576:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360831232:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573145.251581:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360831360:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573145.251592:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573145.251598:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573145/real 1788573145]  req@ffff8dc020494700 x1875453360831360/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573170 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573145.251606:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453360831360/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573170 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573145.251611:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573145.251613:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573145.251615:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360831360:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573145.251627:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360831488:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788573145.251640:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573145.251647:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573145/real 1788573145]  req@ffff8dc020497100 x1875453360831488/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573170 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573145.251654:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453360831488/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573170 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573145.251659:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573145.251661:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573145.251663:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360831488:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573145.251667:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360831616:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573145.251678:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573145.251684:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573145/real 1788573145]  req@ffff8dc020494e00 x1875453360831616/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573170 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573145.251697:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453360831616/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573170 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573145.251702:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573145.251704:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573145.251706:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360831616:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573145.251709:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360831744:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573145.251720:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573145.251726:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573145/real 1788573145]  req@ffff8dc020496a00 x1875453360831744/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573170 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573145.251734:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453360831744/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573170 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573145.251739:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573145.251741:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573145.251742:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360831744:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573145.634978:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573145.634981:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573145.635016:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573146.658967:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573146.658967:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573146.658986:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573146.659017:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788573146.659095:0:14038:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1788573146.659930:0:2350:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN)  req@ffff8dc006e55f80 x1875453360831872/t0(0) o103->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:17/18 lens 440/224 e 0 to 0 dl 0 ref 1 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573147.683015:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573147.683015:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573147.683045:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573147.683078:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573148.707001:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573148.707001:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573148.707009:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573148.707052:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788573148.707130:0:14038:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1788573148.707930:0:2349:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN)  req@ffff8dc006e54a80 x1875453360832000/t0(0) o103->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:17/18 lens 440/224 e 0 to 0 dl 0 ref 1 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573149.731022:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573149.731022:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573149.731036:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573149.731062:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00080000:2.0:1788573150.371013:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573150.371026:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788573150.371032:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573150.371056:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1496
00000100:00080000:2.0:1788573150.371070:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573150.371080:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573150.371135:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453360832128/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573150.371163:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573150.371167:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573150.371168:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573150.371172:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1496
00000100:00080000:2.0:1788573150.371175:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573150.371179:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573150.371189:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573150.371201:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453360832256/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573150.371210:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573150.371213:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573150.371214:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573150.371219:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1496
00000100:00100000:0.0:1788573150.371221:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360832128:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788573150.371222:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573150.371228:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573150.371234:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573150.371242:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453360832384/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573150.371249:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573150.371252:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573150.371253:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573150.371256:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1496
00000100:00080000:2.0:1788573150.371258:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573150.371260:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573150.371263:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573150.371270:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453360832512/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573150.371276:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573150.371279:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573150.371280:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573150.371283:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1496
00000100:00080000:2.0:1788573150.371286:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573150.371289:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573150.371293:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788573150.371300:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573150.371302:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453360832640/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573150.371310:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573150.371313:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573150.371314:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573150.371317:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1496
00000100:00080000:2.0:1788573150.371320:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573150.371322:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573150.371326:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573150.371333:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497800 x1875453360832768/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573150.371339:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573150.371341:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573150.371342:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573150.371345:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1496
00000100:00080000:2.0:1788573150.371348:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573150.371353:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788573150.371355:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573150/real 1788573150]  req@ffff8dc020496a00 x1875453360832128/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573175 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1788573150.371356:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573150.371367:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453360832896/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788573150.371391:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453360832128/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573175 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573150.371404:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573150.371408:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573150.371411:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360832128:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788573150.371435:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360832256:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788573150.371468:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573150.371483:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573150/real 1788573150]  req@ffff8dc020494e00 x1875453360832256/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573175 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573150.371497:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453360832256/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573175 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573150.371505:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573150.371508:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573150.371510:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360832256:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573150.371514:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360832384:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573150.371531:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573150.371539:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573150/real 1788573150]  req@ffff8dc020497100 x1875453360832384/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573175 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573150.371547:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453360832384/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573175 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573150.371558:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573150.371560:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573150.371562:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360832384:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573150.371565:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360832512:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573150.371576:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573150.371581:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573150/real 1788573150]  req@ffff8dc020494700 x1875453360832512/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573175 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573150.371588:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453360832512/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573175 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573150.371594:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573150.371596:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573150.371598:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360832512:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573150.371601:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360832640:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788573150.371612:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573150.371618:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573150/real 1788573150]  req@ffff8dc020494000 x1875453360832640/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573175 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573150.371626:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453360832640/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573175 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573150.371631:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573150.371633:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573150.371636:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360832640:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573150.371640:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360832768:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573150.371651:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573150.371656:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573150/real 1788573150]  req@ffff8dc020497800 x1875453360832768/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573175 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573150.371664:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497800 x1875453360832768/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573175 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573150.371669:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573150.371671:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573150.371672:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360832768:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573150.371676:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360832896:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573150.371686:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573150.371691:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573150/real 1788573150]  req@ffff8dc020495500 x1875453360832896/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573175 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573150.371697:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453360832896/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573175 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573150.371703:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573150.371705:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573150.371707:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360832896:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573150.754961:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573150.754961:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573150.754966:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573151.779007:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573151.779007:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573151.779048:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573152.802964:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573152.802964:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573152.802991:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573152.803020:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573153.827022:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573153.827022:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573153.827022:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573153.827061:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788573153.827202:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1788573153.830253:0:2350:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN)  req@ffff8dc006e57b80 x1875453360833024/t0(0) o103->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:17/18 lens 816/224 e 0 to 0 dl 0 ref 1 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573154.850978:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573154.850985:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573154.851006:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788573154.851021:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1788573155.491010:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573155.491020:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788573155.491025:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573155.491037:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1501
00000100:00080000:2.0:1788573155.491050:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573155.491059:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573155.491104:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453360833152/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573155.491127:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573155.491131:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573155.491134:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573155.491138:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1501
00000100:00080000:2.0:1788573155.491141:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573155.491145:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573155.491157:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573155.491181:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453360833280/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573155.491196:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573155.491200:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573155.491202:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573155.491210:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1501
00000100:00080000:2.0:1788573155.491227:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573155.491235:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573155.491242:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573155.491253:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453360833408/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573155.491263:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573155.491268:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573155.491272:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573155.491276:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1501
00000100:00080000:2.0:1788573155.491281:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573155.491292:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573155.491300:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573155.491317:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453360833536/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573155.491333:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573155.491338:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573155.491340:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573155.491345:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1501
00000100:00080000:2.0:1788573155.491350:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573155.491359:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573155.491366:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573155.491385:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453360833664/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573155.491402:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573155.491419:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573155.491422:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573155.491430:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1501
00000100:00080000:2.0:1788573155.491434:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573155.491438:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573155.491442:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573155.491457:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453360833792/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573155.491466:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573155.491469:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573155.491470:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573155.491473:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1501
00000100:00080000:2.0:1788573155.491475:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573155.491477:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573155.491479:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573155.491488:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453360833920/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788573155.875011:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573155.875011:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573155.875022:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573156.898981:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573156.898983:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573156.899142:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573156.899148:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788573156.899251:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1788573156.900047:0:2349:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING)  req@ffff8dc006e56a00 x1875453360834048/t0(0) o103->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:17/18 lens 480/224 e 0 to 0 dl 0 ref 1 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573157.923007:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573157.923016:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788573157.923047:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573157.923191:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000400:00000100:1.0:1788573158.563104:0:2337:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.140:988
00000400:00000100:1.0:1788573158.563138:0:2337:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.140@tcp at host 192.168.202.140 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:1.0:1788573158.563152:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788573158.563182:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788573158.563189:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788573158.563198:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788573158.563204:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788573158.563210:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788573158.563215:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:1.0:1788573158.946963:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573158.946968:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573158.947010:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788573158.947107:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1788573158.950422:0:2350:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN)  req@ffff8dc006e54000 x1875453360834176/t0(0) o103->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:17/18 lens 416/224 e 0 to 0 dl 0 ref 1 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573159.970981:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573159.970982:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788573159.971023:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573159.971030:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573160.611020:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573160.611026:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788573160.611029:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573160.611038:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1506
00000100:00080000:1.0:1788573160.611046:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573160.611052:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573160.611081:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453360834304/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573160.611103:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573160.611106:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573160.611108:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573160.611110:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1506
00000100:00080000:1.0:1788573160.611112:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573160.611114:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573160.611122:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573160.611132:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360834432/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573160.611142:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573160.611151:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573160.611152:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573160.611155:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1506
00000100:00080000:1.0:1788573160.611157:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573160.611160:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573160.611163:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573160.611171:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360834560/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573160.611182:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573160.611185:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573160.611186:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573160.611188:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1506
00000100:00080000:1.0:1788573160.611191:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573160.611192:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573160.611195:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573160.611202:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360834688/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573160.611210:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573160.611217:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573160.611221:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573160.611226:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1506
00000100:00080000:1.0:1788573160.611232:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573160.611237:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573160.611242:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573160.611255:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360834816/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573160.611268:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573160.611278:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573160.611282:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573160.611289:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1506
00000100:00080000:1.0:1788573160.611294:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573160.611303:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573160.611312:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573160.611329:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360834944/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573160.611342:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573160.611347:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573160.611349:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573160.611354:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1506
00000100:00080000:1.0:1788573160.611358:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573160.611363:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573160.611370:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573160.611387:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360835072/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788573160.995003:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573160.995003:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573160.995041:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573162.018997:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573162.019003:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573162.019004:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573163.043014:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573163.043014:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573163.043019:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573164.066979:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573164.066980:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573164.067019:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573164.067067:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788573164.067088:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573165.090961:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573165.090965:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573165.090975:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788573165.091003:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573165.091018:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00080000:1.0:1788573165.730940:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573165.730951:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788573165.730955:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573165.730963:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1511
00000100:00080000:1.0:1788573165.730972:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573165.730979:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573165.731013:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453360835456/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573165.731034:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573165.731037:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573165.731038:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573165.731041:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1511
00000100:00080000:1.0:1788573165.731043:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573165.731046:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573165.731054:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573165.731066:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360835584/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573165.731081:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573165.731084:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573165.731085:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573165.731088:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1511
00000100:00080000:1.0:1788573165.731089:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573165.731092:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573165.731095:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573165.731102:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360835712/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573165.731109:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573165.731112:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573165.731113:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573165.731116:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1511
00000100:00080000:1.0:1788573165.731118:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573165.731121:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573165.731124:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573165.731132:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360835840/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573165.731139:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573165.731142:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573165.731145:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573165.731149:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1511
00000100:00080000:1.0:1788573165.731151:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573165.731154:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573165.731157:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573165.731164:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360835968/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573165.731170:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573165.731172:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573165.731174:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573165.731177:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1511
00000100:00080000:1.0:1788573165.731180:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573165.731182:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573165.731186:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573165.731198:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360836096/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573165.731207:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573165.731215:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573165.731218:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573165.731225:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1511
00000100:00080000:1.0:1788573165.731229:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573165.731232:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573165.731239:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573165.731249:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360836224/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788573166.114981:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573166.114995:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573166.115000:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788573166.115044:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573166.115055:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573166.115072:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573167.138995:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573167.139000:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573167.139011:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573167.139043:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788573167.139050:0:37903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 3 locks of 0 total in blp.  (0 blwis in pool)
00000100:00100000:1.0:1788573167.139077:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788573167.139682:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1788573167.139687:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1788573167.139691:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1788573167.139707:0:37903:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 0000000025c55716/0xc2934ec3fb6f1bc6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x800028400000000 nid: local remote: 0x85ace67feb166a64 expref: -99 pid: 37422 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0
00000080:00200000:2.0:1788573167.139742:0:37903:0:(vvp_io.c:1826:vvp_io_init()) [0x200000402:0xb3:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0
00000080:00200000:2.0:1788573167.140821:0:37903:0:(vvp_io.c:304:vvp_io_fini()) [0x200000402:0xb3:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1
00010000:00010000:2.0:1788573167.140852:0:37903:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 0000000098799e56/0xc2934ec3fb6f1ae6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x800028400000000 nid: local remote: 0x85ace67feb1667e7 expref: -99 pid: 37412 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0
00000080:00200000:2.0:1788573167.140864:0:37903:0:(vvp_io.c:1826:vvp_io_init()) [0x200000402:0xb1:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0
00000080:00200000:2.0:1788573167.141786:0:37903:0:(vvp_io.c:304:vvp_io_fini()) [0x200000402:0xb1:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1
00010000:00010000:2.0:1788573167.141799:0:37903:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 00000000d6796a66/0xc2934ec3fb6f15de lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x800028400000000 nid: local remote: 0x85ace67feb165ac7 expref: -99 pid: 36628 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0
00000080:00200000:2.0:1788573167.141819:0:37903:0:(vvp_io.c:1826:vvp_io_init()) [0x200000402:0xa8:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0
00000080:00200000:2.0:1788573167.143029:0:37903:0:(vvp_io.c:304:vvp_io_fini()) [0x200000402:0xa8:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1
00010000:00010000:2.0:1788573167.143075:0:37903:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 0000000025c55716/0xc2934ec3fb6f1bc6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x804869400000020 nid: local remote: 0x85ace67feb166a64 expref: -99 pid: 37422 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0
00010000:00010000:2.0:1788573167.143082:0:37903:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 0000000098799e56/0xc2934ec3fb6f1ae6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x804869400000020 nid: local remote: 0x85ace67feb1667e7 expref: -99 pid: 37412 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0
00010000:00010000:2.0:1788573167.143088:0:37903:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 00000000d6796a66/0xc2934ec3fb6f15de lrc: 1/0,0 mode: --/PR res: [0x280000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x804869400000020 nid: local remote: 0x85ace67feb165ac7 expref: -99 pid: 36628 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0
00010000:00010000:2.0:1788573167.143092:0:37903:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 3 locks packed
00010000:00010000:2.0:1788573167.143123:0:37903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 0000000025c55716/0xc2934ec3fb6f1bc6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x804869400000020 nid: local remote: 0x85ace67feb166a64 expref: -99 pid: 37422 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0
00010000:00010000:2.0:1788573167.143142:0:37903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 0000000098799e56/0xc2934ec3fb6f1ae6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x804869400000020 nid: local remote: 0x85ace67feb1667e7 expref: -99 pid: 37412 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0
00010000:00010000:2.0:1788573167.143152:0:37903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8dc01049b800 lock: 00000000d6796a66/0xc2934ec3fb6f15de lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x804869400000020 nid: local remote: 0x85ace67feb165ac7 expref: -99 pid: 36628 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0
00010000:00010000:2.0:1788573167.143227:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1788573167.143231:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1788573167.143236:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573168.162961:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573168.163004:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573168.163005:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788573168.163030:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573168.163035:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573168.163041:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573169.186977:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573169.186977:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573169.187025:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573169.187047:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573169.187047:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788573169.187074:0:37938:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1788573169.187075:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1788573169.187083:0:37938:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8dc0032d2800 lock: ffff8dc009bdd200/0xc2934ec3fb6f14e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xce:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x85ace67feb1657a9 expref: -99 pid: 36581 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0
00010000:00010000:0.0:1788573169.187158:0:37938:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8dc0032d2800 lock: ffff8dc009bdd200/0xc2934ec3fb6f14e9 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xce:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x85ace67feb1657a9 expref: -99 pid: 36581 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0
00010000:00010000:0.0:1788573169.187164:0:37938:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed
00010000:00010000:0.0:1788573169.187193:0:37938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8dc0032d2800 lock: ffff8dc009bdd200/0xc2934ec3fb6f14e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xce:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x85ace67feb1657a9 expref: -99 pid: 36581 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0
00000100:00080000:1.0:1788573169.187214:0:2347:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN)  req@ffff8dc006711f80 x1875453360836480/t0(0) o103->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295
00010000:00010000:0.0:1788573169.187253:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1788573169.187255:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1788573169.187257:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573170.210972:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573170.210973:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573170.210988:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573170.211006:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573170.211022:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00080000:2.0:1788573170.851024:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573170.851029:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788573170.851033:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573170.851040:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1516
00000100:00080000:2.0:1788573170.851048:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573170.851054:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573170.851088:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453360836608/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573170.851110:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573170.851113:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573170.851115:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573170.851117:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1516
00000100:00080000:2.0:1788573170.851120:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573170.851123:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573170.851131:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573170.851142:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453360836736/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573170.851153:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573170.851156:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573170.851157:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573170.851159:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1516
00000100:00080000:2.0:1788573170.851161:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573170.851164:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573170.851168:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573170.851308:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453360836864/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573170.851319:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573170.851325:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573170.851329:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573170.851334:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1516
00000100:00080000:2.0:1788573170.851337:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573170.851344:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573170.851353:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573170.851366:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453360836992/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573170.851385:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573170.851389:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573170.851390:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573170.851394:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1516
00000100:00080000:2.0:1788573170.851399:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573170.851406:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573170.851410:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573170.851419:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453360837120/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573170.851433:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573170.851438:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573170.851441:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573170.851445:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1516
00000100:00080000:2.0:1788573170.851447:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573170.851451:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573170.851457:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573170.851469:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453360837248/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573170.851491:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573170.851496:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573170.851500:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573170.851506:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1516
00000100:00080000:2.0:1788573170.851510:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573170.851515:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573170.851522:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573170.851532:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453360837376/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788573171.234966:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573171.234971:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573171.234974:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788573171.234997:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573171.235001:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573172.259013:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573172.259043:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573172.259057:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573172.259112:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788573172.259112:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573173.282942:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573173.282945:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573173.282945:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788573173.283055:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573174.306948:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573174.306984:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573174.307001:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573174.307024:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573174.307187:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573175.331073:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573175.331076:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573175.331076:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573175.331126:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788573175.331173:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1788573175.970996:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573175.971022:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788573175.971027:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573175.971037:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1521
00000100:00080000:1.0:1788573175.971050:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573175.971058:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573175.971102:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453360837504/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573175.971128:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573175.971131:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573175.971132:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573175.971135:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1521
00000100:00080000:1.0:1788573175.971138:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573175.971141:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573175.971151:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573175.971165:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360837632/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573175.971176:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573175.971178:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573175.971180:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573175.971184:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1521
00000100:00080000:1.0:1788573175.971186:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573175.971189:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573175.971193:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573175.971201:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360837760/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573175.971207:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573175.971210:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573175.971212:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573175.971215:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1521
00000100:00080000:1.0:1788573175.971218:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573175.971220:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573175.971222:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573175.971230:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360837888/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573175.971236:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573175.971238:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573175.971239:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573175.971242:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1521
00000100:00080000:1.0:1788573175.971244:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573175.971249:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573175.971253:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573175.971263:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360838016/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573175.971271:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573175.971274:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573175.971276:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573175.971279:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1521
00000100:00080000:1.0:1788573175.971284:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573175.971286:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573175.971289:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573175.971296:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360838144/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573175.971303:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573175.971305:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573175.971307:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573175.971310:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1521
00000100:00080000:1.0:1788573175.971312:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573175.971316:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573175.971319:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573175.971331:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360838272/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788573176.354930:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573176.354968:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573176.355018:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573176.355028:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573176.355124:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573177.378992:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573177.379021:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573177.379036:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573177.379042:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573177.379047:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573178.402969:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573178.402981:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573178.403020:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573178.403039:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788573178.403085:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573179.427060:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573179.427062:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573179.427062:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573179.427108:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573179.427125:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573180.450977:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573180.450977:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573180.450983:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573180.451004:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573180.451011:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00080000:2.0:1788573181.090958:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573181.090968:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788573181.090972:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573181.090981:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1526
00000100:00080000:2.0:1788573181.090989:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573181.090995:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573181.091027:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453360838400/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573181.091049:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573181.091052:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573181.091053:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573181.091056:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1526
00000100:00080000:2.0:1788573181.091058:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573181.091060:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573181.091068:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573181.091077:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453360838528/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573181.091084:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573181.091087:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573181.091091:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573181.091098:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1526
00000100:00080000:2.0:1788573181.091102:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573181.091104:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573181.091108:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573181.091115:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453360838656/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573181.091121:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573181.091123:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573181.091125:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573181.091127:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1526
00000100:00080000:2.0:1788573181.091129:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573181.091131:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573181.091133:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573181.091140:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453360838784/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573181.091145:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573181.091147:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573181.091149:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573181.091151:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1526
00000100:00080000:2.0:1788573181.091154:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573181.091156:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573181.091159:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573181.091169:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453360838912/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573181.091176:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573181.091179:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573181.091181:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573181.091184:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1526
00000100:00080000:2.0:1788573181.091186:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573181.091189:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573181.091192:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573181.091199:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453360839040/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573181.091204:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573181.091206:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573181.091207:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573181.091210:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1526
00000100:00080000:2.0:1788573181.091214:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573181.091218:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573181.091225:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573181.091238:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453360839168/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788573181.474970:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573181.474980:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573181.474983:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573181.475000:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573181.475013:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573182.499049:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573182.499054:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573182.499055:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573182.499103:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573182.499106:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788573182.499140:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573183.522994:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573183.522994:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573183.523016:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573183.523040:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573183.523072:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573184.546993:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573184.547023:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573184.547027:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573184.547073:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573185.570970:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573185.570970:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573185.570976:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573185.571005:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00080000:0.0:1788573186.210981:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573186.210989:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788573186.210993:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573186.211004:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1531
00000100:00080000:0.0:1788573186.211015:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573186.211023:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788573186.211072:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453360839296/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573186.211103:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573186.211108:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573186.211117:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573186.211122:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1531
00000100:00080000:0.0:1788573186.211127:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573186.211133:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573186.211144:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573186.211161:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453360839424/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573186.211175:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573186.211179:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573186.211181:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573186.211186:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1531
00000100:00080000:0.0:1788573186.211202:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573186.211207:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573186.211213:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573186.211227:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453360839552/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573186.211241:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573186.211246:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573186.211248:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573186.211254:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1531
00000100:00080000:0.0:1788573186.211261:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573186.211266:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573186.211271:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573186.211288:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453360839680/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573186.211324:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573186.211329:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573186.211334:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573186.211343:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1531
00000100:00080000:0.0:1788573186.211352:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573186.211360:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573186.211383:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573186.211400:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453360839808/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573186.211417:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573186.211421:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573186.211424:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573186.211429:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1531
00000100:00080000:0.0:1788573186.211437:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573186.211444:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573186.211451:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573186.211478:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453360839936/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573186.211494:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573186.211504:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573186.211510:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573186.211519:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1531
00000100:00080000:0.0:1788573186.211528:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573186.211534:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573186.211541:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573186.211557:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453360840064/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788573186.594947:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573186.594947:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573186.594981:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573186.595002:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573186.595002:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573187.618969:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573187.618969:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573187.618971:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573187.618998:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573187.619003:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573188.642950:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573188.642963:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573188.642991:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573188.643009:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573188.643022:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573189.666962:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573189.666962:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573189.666963:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573190.690988:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573190.690988:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573190.691013:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00080000:0.0:1788573191.330966:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573191.330976:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788573191.330979:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573191.330988:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1536
00000100:00080000:0.0:1788573191.330997:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573191.331004:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788573191.331036:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453360840192/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573191.331058:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573191.331061:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573191.331063:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573191.331072:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1536
00000100:00080000:0.0:1788573191.331075:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573191.331078:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573191.331087:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573191.331099:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453360840320/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573191.331108:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573191.331111:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573191.331112:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573191.331115:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1536
00000100:00080000:0.0:1788573191.331117:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573191.331120:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573191.331123:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573191.331132:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453360840448/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573191.331139:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573191.331142:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573191.331143:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573191.331146:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1536
00000100:00080000:0.0:1788573191.331148:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573191.331150:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573191.331153:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573191.331163:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453360840576/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573191.331171:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573191.331174:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573191.331176:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573191.331178:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1536
00000100:00080000:0.0:1788573191.331180:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573191.331182:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573191.331185:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573191.331200:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453360840704/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573191.331222:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573191.331225:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573191.331226:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573191.331232:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1536
00000100:00080000:0.0:1788573191.331235:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573191.331240:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573191.331245:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573191.331255:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453360840832/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573191.331267:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573191.331273:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573191.331277:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573191.331282:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1536
00000100:00080000:0.0:1788573191.331285:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573191.331287:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573191.331290:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573191.331297:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453360840960/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788573191.714953:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573191.714954:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573191.715000:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573191.715026:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573192.738968:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573192.738968:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573192.738971:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573192.739002:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573193.762977:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573193.762984:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573193.763015:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573193.763069:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573194.787006:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573194.787006:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573194.787006:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573194.787040:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573195.810943:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573195.810957:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573195.810979:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573195.811901:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00080000:0.0:1788573196.451003:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573196.451016:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788573196.451021:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573196.451032:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1542
00000100:00080000:0.0:1788573196.451043:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573196.451051:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788573196.451095:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453360841088/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573196.451122:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573196.451124:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573196.451126:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573196.451129:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1542
00000100:00080000:0.0:1788573196.451131:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573196.451134:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573196.451146:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573196.451160:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453360841216/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573196.451169:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573196.451172:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573196.451173:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573196.451176:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1542
00000100:00080000:0.0:1788573196.451179:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573196.451181:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573196.451184:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573196.451192:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453360841344/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573196.451214:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573196.451217:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573196.451218:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573196.451221:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1542
00000100:00080000:0.0:1788573196.451226:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573196.451229:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573196.451232:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573196.451243:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453360841472/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573196.451251:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573196.451254:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573196.451255:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573196.451258:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1542
00000100:00080000:0.0:1788573196.451260:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573196.451263:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573196.451266:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573196.451273:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453360841600/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573196.451279:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573196.451282:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573196.451297:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573196.451302:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1542
00000100:00080000:0.0:1788573196.451308:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573196.451316:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573196.451325:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573196.451341:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453360841728/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573196.451358:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573196.451366:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573196.451370:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573196.451376:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1542
00000100:00080000:0.0:1788573196.451381:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573196.451386:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573196.451392:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573196.451410:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453360841856/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788573196.835012:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573196.835012:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573196.835013:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573196.835054:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573197.859005:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573197.859005:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573197.859005:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573197.859046:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573198.883042:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573198.883048:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573198.883050:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573198.883097:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573198.883122:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573199.907005:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573199.907005:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573199.907047:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573199.907069:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573199.907093:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573200.930976:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573200.931009:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573200.931014:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573200.931046:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00080000:1.0:1788573201.570992:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573201.571001:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788573201.571006:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573201.571020:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1547
00000100:00080000:1.0:1788573201.571034:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573201.571043:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573201.571092:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453360841984/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573201.571124:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573201.571128:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573201.571130:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573201.571136:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1547
00000100:00080000:1.0:1788573201.571140:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573201.571145:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573201.571186:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573201.571207:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360842112/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573201.571219:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573201.571223:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573201.571225:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573201.571230:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1547
00000100:00080000:1.0:1788573201.571236:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573201.571241:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573201.571248:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573201.571264:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360842240/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573201.571275:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573201.571280:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573201.571291:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573201.571295:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1547
00000100:00080000:1.0:1788573201.571299:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573201.571303:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573201.571309:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573201.571325:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360842368/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573201.571343:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573201.571348:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573201.571353:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573201.571364:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1547
00000100:00080000:1.0:1788573201.571370:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573201.571382:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573201.571392:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573201.571408:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360842496/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573201.571428:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573201.571433:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573201.571435:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573201.571442:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1547
00000100:00080000:1.0:1788573201.571451:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573201.571458:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573201.571466:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573201.571487:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360842624/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573201.571512:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573201.571518:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573201.571523:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573201.571530:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1547
00000100:00080000:1.0:1788573201.571534:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573201.571539:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573201.571545:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573201.571562:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360842752/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788573201.955060:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573201.955060:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573201.955061:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573201.955131:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573202.978997:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573202.978997:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573202.978997:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573202.979038:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788573202.979091:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573204.003001:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573204.003001:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573204.003001:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573204.003038:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573205.026993:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573205.026993:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573205.026993:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573205.027034:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788573205.027079:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573206.051037:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573206.051037:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573206.051038:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573206.051092:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573206.690976:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573206.690985:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788573206.690989:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573206.691000:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1552
00000100:00080000:1.0:1788573206.691009:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573206.691017:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573206.691067:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453360842880/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573206.691093:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573206.691098:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573206.691100:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573206.691104:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1552
00000100:00080000:1.0:1788573206.691108:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573206.691113:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573206.691123:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573206.691138:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360843008/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573206.691149:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573206.691152:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573206.691154:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573206.691158:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1552
00000100:00080000:1.0:1788573206.691161:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573206.691164:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573206.691169:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573206.691177:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360843136/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573206.691186:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573206.691190:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573206.691191:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573206.691195:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1552
00000100:00080000:1.0:1788573206.691197:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573206.691200:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573206.691204:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573206.691213:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360843264/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573206.691223:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573206.691226:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573206.691228:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573206.691232:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1552
00000100:00080000:1.0:1788573206.691235:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573206.691238:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573206.691242:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573206.691252:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360843392/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573206.691261:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573206.691264:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573206.691266:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573206.691270:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1552
00000100:00080000:1.0:1788573206.691273:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573206.691276:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573206.691280:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573206.691289:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360843520/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573206.691299:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573206.691303:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573206.691304:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573206.691308:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1552
00000100:00080000:1.0:1788573206.691311:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573206.691315:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573206.691319:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573206.691328:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360843648/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788573207.075017:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573207.075019:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573207.075032:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573207.075081:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573208.098972:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573208.098972:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573208.099040:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573208.099064:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573208.099085:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573209.123001:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573209.123025:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573209.123055:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573209.123060:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573210.146999:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573210.146999:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573210.147053:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573210.147060:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573211.171014:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573211.171018:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573211.171033:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573211.171062:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00080000:1.0:1788573211.810992:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573211.811003:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788573211.811009:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573211.811020:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1557
00000100:00080000:1.0:1788573211.811031:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573211.811039:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573211.811085:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453360843776/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573211.811109:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573211.811112:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573211.811113:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573211.811116:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1557
00000100:00080000:1.0:1788573211.811119:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573211.811122:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573211.811130:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573211.811140:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360843904/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573211.811148:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573211.811150:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573211.811151:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573211.811154:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1557
00000100:00080000:1.0:1788573211.811156:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573211.811159:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573211.811166:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573211.811179:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360844032/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573211.811187:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573211.811189:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573211.811192:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573211.811194:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1557
00000100:00080000:1.0:1788573211.811197:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573211.811199:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573211.811202:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573211.811210:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360844160/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573211.811216:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573211.811218:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573211.811220:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573211.811222:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1557
00000100:00080000:1.0:1788573211.811224:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573211.811228:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573211.811234:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573211.811245:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360844288/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573211.811252:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573211.811255:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573211.811256:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573211.811259:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1557
00000100:00080000:1.0:1788573211.811261:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573211.811263:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573211.811266:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573211.811274:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360844416/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573211.811281:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573211.811284:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573211.811287:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573211.811294:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1557
00000100:00080000:1.0:1788573211.811298:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573211.811304:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573211.811307:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573211.811316:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360844544/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788573212.195021:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573212.195022:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573212.195022:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573212.195077:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573213.218944:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573213.218976:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573213.219014:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573213.219015:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573213.219016:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573214.243000:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573214.243000:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573214.243063:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573214.243071:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788573214.243106:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573215.266987:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573215.266987:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573215.267033:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573215.267064:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573216.290994:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573216.291036:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573216.291038:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573216.291061:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00080000:2.0:1788573216.931006:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573216.931015:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788573216.931021:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573216.931034:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1562
00000100:00080000:2.0:1788573216.931048:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573216.931058:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573216.931106:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453360844672/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573216.931133:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573216.931136:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573216.931137:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573216.931140:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1562
00000100:00080000:2.0:1788573216.931144:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573216.931148:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573216.931158:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573216.931171:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453360844800/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573216.931180:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573216.931182:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573216.931183:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573216.931186:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1562
00000100:00080000:2.0:1788573216.931188:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573216.931190:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573216.931194:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573216.931203:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453360844928/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573216.931214:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573216.931218:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573216.931220:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573216.931224:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1562
00000100:00080000:2.0:1788573216.931238:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573216.931244:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573216.931250:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573216.931269:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453360845056/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573216.931280:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573216.931285:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573216.931287:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573216.931291:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1562
00000100:00080000:2.0:1788573216.931297:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573216.931305:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573216.931315:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573216.931331:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453360845184/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573216.931343:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573216.931347:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573216.931350:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573216.931358:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1562
00000100:00080000:2.0:1788573216.931363:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573216.931368:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573216.931373:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573216.931388:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453360845312/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573216.931399:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573216.931404:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573216.931405:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573216.931409:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1562
00000100:00080000:2.0:1788573216.931414:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573216.931419:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573216.931423:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573216.931430:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453360845440/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788573217.315026:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573217.315066:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573217.315074:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573217.315078:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573218.338999:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573218.339038:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573218.339043:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573218.339069:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573219.362988:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573219.362988:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573219.363038:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573219.363066:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573220.003065:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573220.386989:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573220.386989:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573220.386989:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573220.387025:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573221.026964:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573221.410969:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573221.410977:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573221.411027:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573221.411080:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573221.411136:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573222.051055:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573222.051205:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360845568:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788573222.051312:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006e56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360845696:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573222.051349:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006e57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360845824:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573222.051374:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006e54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360845952:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573222.051399:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360846080:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573222.051461:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360846208:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573222.051493:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360846336:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573222.434957:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573222.434960:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573222.435006:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573222.435022:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573222.435028:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573223.075043:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573223.459046:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573223.459048:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573223.459049:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573223.459098:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573223.459126:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573224.099100:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573224.483003:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573224.483007:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573224.483054:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573224.483070:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573225.123132:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000400:00000100:1.0:1788573225.123235:0:2336:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.140:988
00000400:00000100:1.0:1788573225.123291:0:2336:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.140@tcp at host 192.168.202.140 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:1.0:1788573225.123314:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788573225.123362:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788573225.123372:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788573225.123380:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788573225.123392:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788573225.123412:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788573225.123426:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:0.0:1788573225.123429:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573222/real 1788573225]  req@ffff8dc00644ca80 x1875453360846080/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573247 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573225.123466:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ca80 x1875453360846080/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573247 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573225.123484:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573225.123492:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573225.123498:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360846080:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573225.123509:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573222/real 1788573225]  req@ffff8dc006e56300 x1875453360845696/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573247 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573225.123524:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006e56300 x1875453360845696/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573247 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573225.123536:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573225.123540:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573225.123543:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006e56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360845696:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573225.123551:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573222/real 1788573225]  req@ffff8dc006e57480 x1875453360845824/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573247 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573225.123563:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006e57480 x1875453360845824/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573247 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573225.123573:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573225.123577:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573225.123580:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006e57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360845824:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573225.123588:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573222/real 1788573225]  req@ffff8dc006e54380 x1875453360845952/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573247 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573225.123600:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006e54380 x1875453360845952/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573247 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573225.123608:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573225.123613:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573225.123616:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006e54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360845952:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573225.123632:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573222/real 1788573225]  req@ffff8dc006e55180 x1875453360845568/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573247 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573225.123646:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006e55180 x1875453360845568/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573247 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573225.123655:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573225.123658:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573225.123662:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360845568:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788573225.123718:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573222/real 1788573225]  req@ffff8dc00644ce00 x1875453360846336/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573247 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573225.123732:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ce00 x1875453360846336/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573247 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573225.123742:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573225.123746:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573225.123750:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360846336:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573225.123758:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573222/real 1788573225]  req@ffff8dc00644ea00 x1875453360846208/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573247 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573225.123771:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ea00 x1875453360846208/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573247 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573225.123780:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573225.123784:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573225.123788:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360846208:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573225.506995:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573225.507028:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573225.507036:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573225.507045:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573225.507066:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573226.147087:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573226.531012:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573226.531012:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573226.531026:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573226.531061:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573226.531069:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573227.171028:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573227.171103:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360846464:192.168.202.140@tcp:250:kworker.0
00000800:00000100:2.0:1788573227.171207:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573227.171286:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573227/real 1788573227]  req@ffff8dc00644d500 x1875453360846464/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573252 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573227.171354:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d500 x1875453360846464/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573252 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573227.171379:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573227.171390:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573227.171403:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360846464:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788573227.171452:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360846592:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788573227.171500:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573227.171525:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573227/real 1788573227]  req@ffff8dc00644c000 x1875453360846592/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573252 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573227.171540:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c000 x1875453360846592/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573252 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573227.171553:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573227.171557:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573227.171560:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360846592:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788573227.171569:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360846720:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573227.171595:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573227.171609:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573227/real 1788573227]  req@ffff8dc00644dc00 x1875453360846720/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573252 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573227.171621:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644dc00 x1875453360846720/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573252 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573227.171631:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573227.171635:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573227.171638:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360846720:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573227.171647:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360846848:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573227.171701:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573227.171715:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573227/real 1788573227]  req@ffff8dc00644f800 x1875453360846848/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573252 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573227.171726:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f800 x1875453360846848/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573252 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573227.171736:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573227.171740:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573227.171743:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360846848:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573227.171750:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360846976:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788573227.171774:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573227.171787:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573227/real 1788573227]  req@ffff8dc00644c700 x1875453360846976/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573252 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573227.171799:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453360846976/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573252 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573227.171809:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573227.171812:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573227.171816:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360846976:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788573227.171823:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360847104:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573227.171846:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573227.171857:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573227/real 1788573227]  req@ffff8dc00644c380 x1875453360847104/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573252 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573227.171904:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453360847104/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573252 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573227.171914:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573227.171918:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573227.171922:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360847104:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573227.171945:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360847232:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573227.171967:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573227.171985:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573227/real 1788573227]  req@ffff8dc00644e300 x1875453360847232/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573252 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573227.171999:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453360847232/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573252 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573227.172009:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573227.172014:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573227.172018:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360847232:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573227.554977:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573227.554977:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573227.555235:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573227.555236:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573228.195138:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573228.578960:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573228.578960:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573228.578962:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573228.578999:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573229.219049:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573229.602997:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573229.602997:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573229.602997:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573229.603037:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573230.242975:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573230.627003:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573230.627004:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573230.627004:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573230.627066:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573231.267055:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573231.650985:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573231.650990:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573231.651027:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573231.651054:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788573231.651097:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1788573232.290970:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573232.290978:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788573232.290982:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573232.290990:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1577
00000100:00080000:0.0:1788573232.290999:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1788573232.291004:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788573232.291006:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788573232.291047:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453360847360/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573232.291070:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573232.291073:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573232.291075:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573232.291078:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1577
00000100:00080000:0.0:1788573232.291081:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573232.291084:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573232.291092:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573232.291102:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453360847488/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788573232.291109:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360847360:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788573232.291118:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573232.291121:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573232.291122:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573232.291125:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1577
00000100:00080000:0.0:1788573232.291127:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573232.291129:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573232.291133:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573232.291144:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453360847616/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573232.291150:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573232.291152:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573232.291153:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573232.291156:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1577
00000100:00080000:0.0:1788573232.291160:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573232.291162:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573232.291165:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573232.291171:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453360847744/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573232.291177:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573232.291179:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573232.291180:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573232.291183:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1577
00000100:00080000:0.0:1788573232.291185:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573232.291188:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573232.291190:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573232.291196:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453360847872/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573232.291202:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573232.291204:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573232.291206:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:2.0:1788573232.291217:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788573232.291223:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1577
00000100:00080000:0.0:1788573232.291228:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573232.291231:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573232.291234:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573232.291247:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453360848000/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573232.291254:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573232.291257:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573232.291259:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573232.291261:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1577
00000100:00080000:0.0:1788573232.291266:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573232.291268:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573232.291274:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573232.291283:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573232/real 1788573232]  req@ffff8dc006710380 x1875453360847360/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573257 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573232.291288:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453360848128/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788573232.291339:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453360847360/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573257 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573232.291351:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573232.291357:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573232.291362:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360847360:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788573232.291387:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360847488:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788573232.291406:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573232.291415:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573232/real 1788573232]  req@ffff8dc006711500 x1875453360847488/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573257 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573232.291423:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453360847488/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573257 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573232.291431:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573232.291433:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573232.291436:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360847488:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788573232.291440:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360847616:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573232.291453:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573232.291460:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573232/real 1788573232]  req@ffff8dc006713b80 x1875453360847616/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573257 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573232.291468:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453360847616/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573257 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573232.291474:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573232.291476:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573232.291478:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360847616:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573232.291481:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360847744:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573232.291492:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573232.291498:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573232/real 1788573232]  req@ffff8dc006712680 x1875453360847744/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573257 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573232.291506:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453360847744/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573257 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573232.291512:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573232.291514:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573232.291516:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360847744:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573232.291519:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360847872:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788573232.291534:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573232.291545:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573232/real 1788573232]  req@ffff8dc006711c00 x1875453360847872/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573257 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573232.291557:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453360847872/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573257 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573232.291582:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573232.291587:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573232.291591:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360847872:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788573232.291598:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360848000:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573232.291622:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573232.291636:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573232/real 1788573232]  req@ffff8dc006712a00 x1875453360848000/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573257 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573232.291648:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453360848000/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573257 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573232.291654:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573232.291657:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573232.291659:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360848000:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573232.291664:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360848128:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573232.291678:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573232.291686:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573232/real 1788573232]  req@ffff8dc006711880 x1875453360848128/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573257 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573232.291693:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453360848128/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573257 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573232.291699:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573232.291701:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573232.291704:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360848128:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573232.674975:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573232.674975:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573232.674976:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573233.315015:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573233.699003:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573233.699037:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573233.699039:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573233.699043:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573233.699118:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573234.338982:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573234.722948:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573234.722979:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573234.722985:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573234.723008:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573235.363035:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573235.746980:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573235.746991:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573235.747010:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573235.747029:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573235.747052:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573236.386973:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573236.771015:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573236.771016:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573236.771126:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573236.771135:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573237.411019:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573237.411028:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573237.411038:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788573237.411044:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573237.411064:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1583
00000100:00080000:1.0:1788573237.411080:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573237.411088:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573237.411135:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453360848256/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573237.411163:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573237.411166:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573237.411167:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573237.411170:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1583
00000100:00080000:1.0:1788573237.411173:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573237.411177:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573237.411187:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573237.411196:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360848256:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788573237.411201:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360848384/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573237.411210:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573237.411212:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573237.411213:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573237.411216:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1583
00000100:00080000:1.0:1788573237.411219:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573237.411221:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573237.411225:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573237.411237:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360848512/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573237.411247:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573237.411251:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573237.411262:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573237.411270:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1583
00000100:00080000:1.0:1788573237.411275:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573237.411280:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573237.411286:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788573237.411287:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573237.411299:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360848640/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573237.411307:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573237.411309:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573237.411311:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573237.411314:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1583
00000100:00080000:1.0:1788573237.411320:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573237.411323:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573237.411326:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573237.411334:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360848768/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573237.411341:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788573237.411346:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573237/real 1788573237]  req@ffff8dc005dc0a80 x1875453360848256/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573262 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573237.411347:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573237.411351:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573237.411359:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1583
00000100:00080000:1.0:1788573237.411364:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573237.411368:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573237.411372:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573237.411376:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453360848256/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573262 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573237.411384:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360848896/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573237.411391:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573237.411393:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573237.411399:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573237.411399:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788573237.411403:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788573237.411407:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360848256:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788573237.411411:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1583
00000100:00080000:1.0:1788573237.411415:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573237.411418:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573237.411421:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573237.411427:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360849024/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788573237.411434:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360848384:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788573237.411459:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573237.411501:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573237/real 1788573237]  req@ffff8dc005dc3b80 x1875453360848384/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573262 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573237.411522:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360848384/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573262 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573237.411531:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573237.411533:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573237.411535:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360848384:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788573237.411541:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360848512:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573237.411566:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573237.411575:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573237/real 1788573237]  req@ffff8dc005dc1c00 x1875453360848512/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573262 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573237.411584:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453360848512/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573262 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573237.411591:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573237.411593:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573237.411595:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360848512:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573237.411599:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360848640:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573237.411611:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573237.411617:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573237/real 1788573237]  req@ffff8dc005dc2d80 x1875453360848640/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573262 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573237.411625:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360848640/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573262 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573237.411636:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573237.411638:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573237.411640:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360848640:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573237.411643:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360848768:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788573237.411655:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573237.411661:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573237/real 1788573237]  req@ffff8dc005dc1180 x1875453360848768/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573262 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573237.411668:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360848768/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573262 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573237.411674:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573237.411676:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573237.411679:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360848768:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788573237.411683:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360848896:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573237.411694:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573237.411700:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573237/real 1788573237]  req@ffff8dc005dc0700 x1875453360848896/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573262 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573237.411706:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453360848896/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573262 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573237.411712:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573237.411714:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573237.411717:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360848896:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573237.411731:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360849024:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573237.411742:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573237.411748:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573237/real 1788573237]  req@ffff8dc005dc1500 x1875453360849024/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573262 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573237.411756:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360849024/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573262 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573237.411762:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573237.411763:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573237.411765:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360849024:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573237.795028:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573237.795034:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573237.795045:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573237.795096:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573238.434968:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573238.818985:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573238.819007:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573238.819023:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573238.819029:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573239.459008:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573239.842975:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573239.842977:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573239.843003:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573239.843033:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573240.482970:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573240.867010:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573240.867010:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573240.867013:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573240.867048:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573240.867063:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573241.507019:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573241.891013:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573241.891014:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573241.891024:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573241.891048:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573241.891053:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00080000:0.0:1788573242.530972:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573242.530992:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:2.0:1788573242.530995:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788573242.530998:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573242.531012:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1588
00000100:00080000:0.0:1788573242.531022:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573242.531030:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788573242.531069:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453360849152/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573242.531110:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573242.531115:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573242.531117:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573242.531123:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1588
00000100:00080000:0.0:1788573242.531128:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573242.531133:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573242.531144:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573242.531155:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360849152:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788573242.531163:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453360849280/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573242.531179:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573242.531184:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573242.531186:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573242.531191:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1588
00000100:00080000:0.0:1788573242.531196:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573242.531200:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573242.531208:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573242.531223:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453360849408/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573242.531241:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573242.531247:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573242.531249:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573242.531254:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1588
00000100:00080000:0.0:1788573242.531260:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1788573242.531264:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788573242.531268:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573242.531275:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573242.531292:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453360849536/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573242.531302:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573242.531305:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573242.531308:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573242.531313:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1588
00000100:00080000:0.0:1788573242.531319:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573242.531324:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573242.531329:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573242.531337:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573242/real 1788573242]  req@ffff8dc006713480 x1875453360849152/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573267 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573242.531343:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453360849664/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573242.531401:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573242.531405:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573242.531407:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573242.531414:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1588
00000100:00080000:0.0:1788573242.531418:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1788573242.531423:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453360849152/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573267 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573242.531428:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573242.531440:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1788573242.531449:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573242.531460:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573242.531461:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453360849792/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788573242.531471:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360849152:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788573242.531484:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573242.531490:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573242.531492:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573242.531498:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1588
00000100:00080000:0.0:1788573242.531502:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573242.531505:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573242.531511:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573242.531516:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360849280:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573242.531530:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453360849920/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788573242.531558:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573242.531577:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573242/real 1788573242]  req@ffff8dc006710e00 x1875453360849280/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573267 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573242.531589:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453360849280/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573267 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573242.531602:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573242.531606:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573242.531610:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360849280:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788573242.531618:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360849408:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573242.531644:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573242.531657:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573242/real 1788573242]  req@ffff8dc006712300 x1875453360849408/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573267 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573242.531670:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453360849408/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573267 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573242.531688:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573242.531692:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573242.531695:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360849408:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573242.531701:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360849536:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573242.531719:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573242.531735:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573242/real 1788573242]  req@ffff8dc006713100 x1875453360849536/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573267 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573242.531744:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453360849536/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573267 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573242.531751:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573242.531754:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573242.531756:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360849536:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573242.531760:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360849664:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788573242.531774:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573242.531781:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573242/real 1788573242]  req@ffff8dc006713800 x1875453360849664/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573267 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573242.531789:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453360849664/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573267 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573242.531795:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573242.531797:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573242.531800:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360849664:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788573242.531805:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360849792:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573242.531817:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573242.531823:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573242/real 1788573242]  req@ffff8dc006711880 x1875453360849792/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573267 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573242.531830:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453360849792/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573267 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573242.531836:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573242.531837:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573242.531839:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360849792:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573242.531853:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360849920:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573242.531864:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573242.531892:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573242/real 1788573242]  req@ffff8dc006712a00 x1875453360849920/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573267 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573242.531900:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453360849920/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573267 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573242.531912:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573242.531914:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573242.531917:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360849920:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573242.914987:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573242.914987:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573242.915015:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573242.915058:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573243.555045:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573243.938998:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573243.939011:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573243.939144:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573243.939176:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573244.578948:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573244.963016:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573244.963017:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573244.963021:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573244.963077:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573245.603016:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573245.986971:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573245.987021:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573245.987056:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573245.987056:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573246.626991:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573247.010990:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573247.011004:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573247.011032:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573247.011036:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573247.011053:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00080000:0.0:1788573247.650968:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573247.650976:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788573247.650981:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788573247.650987:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788573247.650994:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1593
00000100:00080000:0.0:1788573247.651009:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573247.651017:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788573247.651061:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453360850048/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573247.651092:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573247.651097:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573247.651099:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573247.651104:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1593
00000100:00080000:0.0:1788573247.651109:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573247.651114:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573247.651126:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573247.651134:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360850048:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788573247.651143:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453360850176/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573247.651154:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573247.651157:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573247.651159:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573247.651164:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1593
00000100:00080000:0.0:1788573247.651170:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573247.651174:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573247.651180:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573247.651194:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453360850304/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573247.651202:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573247.651204:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573247.651206:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573247.651210:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1593
00000100:00080000:0.0:1788573247.651214:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1788573247.651215:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788573247.651227:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573247.651234:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573247.651249:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453360850432/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573247.651256:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573247.651258:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573247.651260:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573247.651267:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1593
00000100:00080000:0.0:1788573247.651274:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573247.651278:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573247.651299:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573247/real 1788573247]  req@ffff8dc006711c00 x1875453360850048/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573272 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1788573247.651302:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573247.651324:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453360850560/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573247.651332:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788573247.651334:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453360850048/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573272 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573247.651336:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573247.651341:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573247.651352:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1593
00000100:00080000:0.0:1788573247.651362:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573247.651374:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:2.0:1788573247.651380:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1788573247.651381:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1788573247.651394:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573247.651398:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453360850688/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788573247.651406:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360850048:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788573247.651412:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573247.651422:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573247.651425:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573247.651428:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1593
00000100:00080000:0.0:1788573247.651432:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573247.651437:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573247.651442:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573247.651452:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360850176:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573247.651454:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453360850816/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788573247.651505:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573247.651520:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573247/real 1788573247]  req@ffff8dc006712680 x1875453360850176/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573272 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573247.651534:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453360850176/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573272 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573247.651552:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573247.651556:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573247.651559:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360850176:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788573247.651566:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360850304:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573247.651586:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573247.651596:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573247/real 1788573247]  req@ffff8dc006713b80 x1875453360850304/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573272 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573247.651607:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453360850304/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573272 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573247.651616:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573247.651619:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573247.651623:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360850304:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573247.651629:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360850432:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573247.651646:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573247.651657:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573247/real 1788573247]  req@ffff8dc006711500 x1875453360850432/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573272 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573247.651668:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453360850432/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573272 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573247.651677:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573247.651680:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573247.651684:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360850432:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573247.651691:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360850560:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788573247.651707:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573247.651718:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573247/real 1788573247]  req@ffff8dc006710380 x1875453360850560/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573272 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573247.651729:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453360850560/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573272 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573247.651738:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573247.651742:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573247.651745:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360850560:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788573247.651751:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360850688:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573247.651778:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573247.651791:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573247/real 1788573247]  req@ffff8dc006712a00 x1875453360850688/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573272 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573247.651803:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453360850688/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573272 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573247.651812:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573247.651816:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573247.651819:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360850688:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573247.651840:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360850816:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573247.651861:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573247.651902:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573247/real 1788573247]  req@ffff8dc006711880 x1875453360850816/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573272 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573247.651916:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453360850816/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573272 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573247.651926:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573247.651930:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573247.651933:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360850816:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573248.035009:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573248.035033:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573248.035043:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573248.035075:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573248.675010:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573249.059020:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573249.059029:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573249.059202:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573249.059222:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573249.699023:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573250.082959:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573250.082983:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573250.082985:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573250.082996:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573250.723027:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573251.106984:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573251.107003:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573251.107003:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573251.107033:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788573251.107082:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573251.746998:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573252.130971:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573252.130979:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573252.130988:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573252.131026:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788573252.131076:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573252.771018:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573252.771024:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573252.771035:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788573252.771041:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573252.771051:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1598
00000100:00080000:1.0:1788573252.771064:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573252.771072:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573252.771116:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453360850944/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573252.771144:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573252.771148:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573252.771150:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573252.771156:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1598
00000100:00080000:1.0:1788573252.771161:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573252.771165:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573252.771175:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573252.771206:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360851072/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788573252.771211:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360850944:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788573252.771233:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573252.771238:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573252.771240:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573252.771246:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1598
00000100:00080000:1.0:1788573252.771250:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573252.771254:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573252.771262:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573252.771278:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360851200/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573252.771289:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573252.771293:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573252.771295:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573252.771299:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1598
00000100:00080000:1.0:1788573252.771304:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1788573252.771306:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788573252.771312:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573252.771322:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573252.771337:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360851328/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573252.771349:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573252.771353:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573252.771355:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573252.771359:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1598
00000100:00080000:1.0:1788573252.771363:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573252.771368:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573252.771371:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573252/real 1788573252]  req@ffff8dc005dc3800 x1875453360850944/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573277 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1788573252.771376:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573252.771402:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360851456/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788573252.771404:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453360850944/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573277 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573252.771473:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573252.771474:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573252.771488:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788573252.771490:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573252.771500:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788573252.771502:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360850944:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788573252.771512:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1598
00000100:00080000:1.0:1788573252.771517:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573252.771521:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573252.771527:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573252.771534:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360851072:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573252.771543:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360851584/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573252.771556:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:2.0:1788573252.771562:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788573252.771571:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573252.771574:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573252.771581:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1598
00000100:00100000:2.0:1788573252.771582:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573252/real 1788573252]  req@ffff8dc005dc1500 x1875453360851072/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573277 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573252.771592:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1788573252.771606:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360851072/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573277 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573252.771607:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573252.771625:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1788573252.771629:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573252.771633:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573252.771640:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360851072:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573252.771646:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360851712/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788573252.771660:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360851200:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573252.771693:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573252.771706:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573252/real 1788573252]  req@ffff8dc005dc0700 x1875453360851200/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573277 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573252.771716:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453360851200/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573277 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573252.771723:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573252.771726:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573252.771728:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360851200:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573252.771733:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360851328:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573252.771757:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573252.771764:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573252/real 1788573252]  req@ffff8dc005dc1180 x1875453360851328/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573277 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573252.771772:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360851328/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573277 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573252.771779:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573252.771782:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573252.771784:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360851328:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573252.771788:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360851456:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788573252.771799:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573252.771805:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573252/real 1788573252]  req@ffff8dc005dc2d80 x1875453360851456/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573277 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573252.771813:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360851456/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573277 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573252.771819:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573252.771821:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573252.771823:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360851456:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788573252.771838:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360851584:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573252.771849:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573252.771856:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573252/real 1788573252]  req@ffff8dc005dc1c00 x1875453360851584/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573277 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573252.771864:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453360851584/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573277 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573252.771890:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573252.771893:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573252.771895:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360851584:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573252.771899:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360851712:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573252.771913:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573252.771920:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573252/real 1788573252]  req@ffff8dc005dc3b80 x1875453360851712/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573277 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573252.771928:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360851712/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573277 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573252.771934:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573252.771936:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573252.771938:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360851712:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573253.154998:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573253.155001:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573253.155047:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573253.155076:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788573253.155125:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573253.794946:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573254.178967:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573254.179022:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573254.179058:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573254.179071:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573254.818996:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573255.203010:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573255.203023:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573255.203031:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573255.203050:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573255.203068:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573255.842997:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573256.227018:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573256.227027:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573256.227065:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573256.227070:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573256.866988:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573257.250994:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573257.251015:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573257.251024:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573257.890970:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788573257.890986:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573257.890992:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788573257.890995:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573257.891003:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1603
00000100:00080000:0.0:1788573257.891013:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573257.891020:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788573257.891059:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453360851840/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573257.891079:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573257.891082:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573257.891083:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573257.891097:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1603
00000100:00080000:0.0:1788573257.891100:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573257.891103:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573257.891113:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573257.891124:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453360851968/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573257.891133:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573257.891136:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573257.891138:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573257.891143:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1603
00000100:00080000:0.0:1788573257.891149:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1788573257.891149:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360851840:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788573257.891157:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573257.891165:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573257.891179:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453360852096/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573257.891191:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573257.891195:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573257.891197:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573257.891200:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1603
00000100:00080000:0.0:1788573257.891203:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573257.891206:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573257.891211:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573257.891220:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453360852224/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788573257.891228:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788573257.891231:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573257.891235:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573257.891236:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573257.891240:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1603
00000100:00080000:0.0:1788573257.891243:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573257.891245:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573257.891249:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573257.891255:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453360852352/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573257.891261:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573257.891264:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573257.891265:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573257.891268:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1603
00000100:00080000:0.0:1788573257.891271:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573257.891274:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573257.891277:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573257.891280:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573257/real 1788573257]  req@ffff8dc006713800 x1875453360851840/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573282 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573257.891288:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453360852480/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573257.891311:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573257.891314:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573257.891315:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573257.891318:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1603
00000100:00080000:0.0:1788573257.891320:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1788573257.891324:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453360851840/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573282 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573257.891325:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573257.891330:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573257.891339:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453360852608/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573257.891346:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573257.891353:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573257.891360:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360851840:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788573257.891369:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360851968:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788573257.891395:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573257.891410:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573257/real 1788573257]  req@ffff8dc006713100 x1875453360851968/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573282 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573257.891424:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453360851968/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573282 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573257.891436:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573257.891439:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573257.891443:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360851968:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788573257.891467:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360852096:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573257.891492:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573257.891506:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573257/real 1788573257]  req@ffff8dc006712300 x1875453360852096/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573282 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573257.891519:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453360852096/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573282 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573257.891528:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573257.891532:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573257.891536:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360852096:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573257.891542:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360852224:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573257.891561:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573257.891573:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573257/real 1788573257]  req@ffff8dc006710e00 x1875453360852224/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573282 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573257.891585:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453360852224/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573282 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573257.891595:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573257.891599:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573257.891602:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360852224:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573257.891608:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360852352:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788573257.891628:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573257.891640:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573257/real 1788573257]  req@ffff8dc006713480 x1875453360852352/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573282 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573257.891652:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453360852352/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573282 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573257.891663:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573257.891666:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573257.891669:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360852352:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788573257.891676:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360852480:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573257.891696:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573257.891709:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573257/real 1788573257]  req@ffff8dc006711880 x1875453360852480/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573282 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573257.891721:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453360852480/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573282 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573257.891729:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573257.891733:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573257.891736:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360852480:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573257.891742:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360852608:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573257.891762:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573257.891774:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573257/real 1788573257]  req@ffff8dc006712a00 x1875453360852608/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573282 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573257.891786:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453360852608/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573282 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573257.891795:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573257.891798:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573257.891802:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360852608:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573258.274971:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573258.274979:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573258.274998:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573258.275112:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788573258.275181:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573258.275223:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573258.914978:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573259.298996:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573259.299003:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573259.299005:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573259.299043:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573259.299046:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573259.938957:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573260.322978:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573260.322980:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573260.322982:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573260.323013:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573260.323013:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573260.962989:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573261.346968:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573261.346977:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788573261.347005:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573261.347110:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573261.347118:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573261.986949:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573262.371025:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573262.371025:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573262.371033:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00080000:0.0:1788573263.010973:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788573263.010973:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788573263.010983:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788573263.010987:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573263.011011:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1608
00000100:00080000:0.0:1788573263.011019:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573263.011026:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788573263.011056:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453360852736/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573263.011094:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573263.011098:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573263.011100:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573263.011105:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1608
00000100:00080000:0.0:1788573263.011109:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573263.011121:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573263.011136:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573263.011150:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453360852864/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573263.011161:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573263.011164:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573263.011167:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573263.011171:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1608
00000100:00080000:0.0:1788573263.011175:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573263.011179:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573263.011185:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573263.011199:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453360852992/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573263.011210:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573263.011214:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573263.011216:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573263.011220:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1608
00000100:00080000:0.0:1788573263.011224:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573263.011229:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573263.011235:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573263.011247:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453360853120/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573263.011258:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573263.011262:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573263.011264:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573263.011270:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1608
00000100:00080000:0.0:1788573263.011275:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573263.011279:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573263.011284:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573263.011296:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453360853248/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573263.011304:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573263.011307:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573263.011309:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573263.011314:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1608
00000100:00080000:0.0:1788573263.011317:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573263.011322:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573263.011327:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573263.011341:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453360853376/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573263.011356:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573263.011359:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573263.011361:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573263.011365:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1608
00000100:00080000:0.0:1788573263.011368:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573263.011372:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573263.011377:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573263.011386:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453360853504/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788573263.394969:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573263.394969:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573263.394969:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788573263.395078:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573264.418997:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573264.419004:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573264.419163:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573264.419177:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573265.442978:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573265.442980:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573265.442982:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573265.443021:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788573265.443057:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573266.467042:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573266.467056:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573266.467089:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573266.467119:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788573266.467168:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573267.490981:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573267.490993:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573267.491025:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573267.491151:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788573267.491206:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1788573268.130982:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573268.130992:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788573268.130997:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573268.131008:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1613
00000100:00080000:2.0:1788573268.131020:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573268.131028:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573268.131067:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453360853632/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573268.131099:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573268.131103:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573268.131106:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573268.131111:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1613
00000100:00080000:2.0:1788573268.131115:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573268.131120:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573268.131131:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573268.131151:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453360853760/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573268.131165:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573268.131169:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573268.131171:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573268.131175:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1613
00000100:00080000:2.0:1788573268.131181:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573268.131186:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573268.131192:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573268.131209:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453360853888/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573268.131221:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573268.131225:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573268.131228:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573268.131236:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1613
00000100:00080000:2.0:1788573268.131246:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573268.131253:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573268.131262:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573268.131279:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453360854016/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573268.131290:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573268.131295:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573268.131300:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573268.131307:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1613
00000100:00080000:2.0:1788573268.131312:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573268.131318:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573268.131326:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573268.131344:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453360854144/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573268.131378:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573268.131387:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573268.131391:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573268.131401:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1613
00000100:00080000:2.0:1788573268.131408:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573268.131415:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573268.131425:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573268.131446:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453360854272/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573268.131496:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573268.131503:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573268.131506:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573268.131513:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1613
00000100:00080000:2.0:1788573268.131518:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573268.131526:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573268.131534:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573268.131555:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453360854400/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788573268.515041:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573268.515188:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573268.515203:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573268.515218:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573269.538955:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573269.538983:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573269.539004:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573269.539018:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788573269.539121:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573270.562978:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573270.562984:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573270.563007:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573270.563021:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573270.563035:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573271.586971:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573271.586974:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573271.586987:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573271.587025:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573271.587026:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573272.610980:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573272.610980:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573272.610983:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573273.250994:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573273.251119:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360854528:192.168.202.140@tcp:250:kworker.0
00000800:00000100:2.0:1788573273.251189:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573273.251250:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573273/real 1788573273]  req@ffff8dc00644fb80 x1875453360854528/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573298 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573273.251279:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644fb80 x1875453360854528/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573298 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573273.251311:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573273.251318:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573273.251328:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360854528:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788573273.251357:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360854656:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788573273.251378:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573273.251390:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573273/real 1788573273]  req@ffff8dc00644f480 x1875453360854656/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573298 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573273.251401:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453360854656/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573298 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573273.251410:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573273.251413:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573273.251416:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360854656:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788573273.251421:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360854784:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573273.251440:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573273.251449:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573273/real 1788573273]  req@ffff8dc00644d180 x1875453360854784/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573298 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573273.251459:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453360854784/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573298 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573273.251467:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573273.251470:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573273.251473:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360854784:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573273.251478:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360854912:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573273.251495:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573273.251504:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573273/real 1788573273]  req@ffff8dc00644e680 x1875453360854912/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573298 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573273.251515:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453360854912/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573298 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573273.251523:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573273.251526:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573273.251529:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360854912:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573273.251534:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360855040:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788573273.251550:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573273.251559:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573273/real 1788573273]  req@ffff8dc00644ed80 x1875453360855040/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573298 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573273.251569:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ed80 x1875453360855040/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573298 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573273.251578:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573273.251581:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573273.251584:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360855040:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788573273.251589:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360855168:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573273.251602:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573273.251610:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573273/real 1788573273]  req@ffff8dc00644df80 x1875453360855168/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573298 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573273.251620:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644df80 x1875453360855168/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573298 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573273.251626:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573273.251629:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573273.251631:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360855168:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573273.251637:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360855296:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573273.251651:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573273.251659:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573273/real 1788573273]  req@ffff8dc00644f100 x1875453360855296/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573298 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573273.251668:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f100 x1875453360855296/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573298 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573273.251674:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573273.251677:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573273.251680:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360855296:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573273.634942:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573273.634944:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573273.634952:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573274.274984:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573274.658960:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573274.659071:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573274.659168:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573274.659212:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573275.298982:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573275.682968:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573275.682968:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573275.682992:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573276.323027:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573276.706992:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573276.707027:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573276.707033:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573276.707148:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573277.347008:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573277.730980:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573277.730991:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573277.730993:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573277.731022:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00080000:1.0:1788573278.371000:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573278.371010:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:2.0:1788573278.371012:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573278.371013:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573278.371024:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1624
00000100:00080000:1.0:1788573278.371041:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573278.371047:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573278.371079:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453360855424/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573278.371099:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573278.371102:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573278.371103:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573278.371105:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1624
00000100:00080000:1.0:1788573278.371108:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573278.371111:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573278.371118:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573278.371127:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360855552/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573278.371134:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573278.371137:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573278.371138:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573278.371140:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1624
00000100:00080000:1.0:1788573278.371142:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573278.371143:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573278.371147:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573278.371151:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360855424:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788573278.371158:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360855680/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573278.371166:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573278.371168:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573278.371169:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573278.371172:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1624
00000100:00080000:1.0:1788573278.371174:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573278.371176:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573278.371179:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573278.371188:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360855808/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573278.371193:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573278.371196:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573278.371197:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573278.371200:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1624
00000100:00080000:1.0:1788573278.371202:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573278.371205:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573278.371208:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573278.371214:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360855936/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573278.371219:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573278.371222:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573278.371223:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573278.371226:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1624
00000100:00080000:1.0:1788573278.371228:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573278.371230:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573278.371232:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788573278.371235:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573278.371252:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360856064/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573278.371263:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573278.371266:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573278.371268:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573278.371273:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1624
00000100:00080000:1.0:1788573278.371276:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573278.371281:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573278.371286:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573278.371294:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573278/real 1788573278]  req@ffff8dc005dc0a80 x1875453360855424/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573303 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573278.371300:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360856192/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788573278.371348:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453360855424/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573303 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573278.371358:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573278.371363:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573278.371368:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360855424:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788573278.371375:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360855552:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788573278.371393:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573278.371402:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573278/real 1788573278]  req@ffff8dc005dc3b80 x1875453360855552/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573303 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573278.371409:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360855552/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573303 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573278.371416:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573278.371418:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573278.371420:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360855552:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788573278.371442:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360855680:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573278.371454:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573278.371461:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573278/real 1788573278]  req@ffff8dc005dc1c00 x1875453360855680/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573303 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573278.371467:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453360855680/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573303 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573278.371473:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573278.371474:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573278.371476:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360855680:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573278.371480:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360855808:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573278.371490:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573278.371495:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573278/real 1788573278]  req@ffff8dc005dc2d80 x1875453360855808/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573303 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573278.371502:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360855808/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573303 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573278.371507:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573278.371509:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573278.371510:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360855808:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573278.371514:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360855936:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788573278.371523:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573278.371529:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573278/real 1788573278]  req@ffff8dc005dc1180 x1875453360855936/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573303 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573278.371535:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360855936/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573303 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573278.371542:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573278.371543:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573278.371545:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360855936:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788573278.371548:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360856064:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573278.371557:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573278.371563:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573278/real 1788573278]  req@ffff8dc005dc0700 x1875453360856064/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573303 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573278.371569:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453360856064/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573303 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573278.371574:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573278.371575:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573278.371577:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360856064:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573278.371580:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360856192:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573278.371595:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573278.371604:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573278/real 1788573278]  req@ffff8dc005dc1500 x1875453360856192/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573303 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573278.371615:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360856192/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573303 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573278.371623:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573278.371627:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573278.371630:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360856192:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573278.754995:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573278.755000:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573278.755028:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573278.755053:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573279.394988:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573279.779003:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573279.779003:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573279.779003:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573279.779041:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573280.419029:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573280.802986:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573280.802986:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573280.802986:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573280.803016:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573280.803032:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573281.442981:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573281.827015:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573281.827015:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573281.827015:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573281.827055:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573281.827059:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573282.467017:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573282.851034:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573282.851034:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573282.851035:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573282.851082:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573282.851112:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00080000:1.0:1788573283.490955:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788573283.490955:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573283.490968:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788573283.490973:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573283.490986:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1629
00000100:00080000:1.0:1788573283.490998:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573283.491008:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573283.491056:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453360856320/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573283.491081:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573283.491085:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573283.491087:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573283.491091:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1629
00000100:00080000:1.0:1788573283.491095:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573283.491099:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573283.491111:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573283.491128:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360856448/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788573283.491135:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360856320:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788573283.491151:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573283.491156:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573283.491158:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573283.491163:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1629
00000100:00080000:1.0:1788573283.491168:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573283.491173:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573283.491179:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573283.491193:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360856576/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573283.491202:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573283.491207:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573283.491209:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573283.491213:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1629
00000100:00080000:1.0:1788573283.491217:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573283.491223:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:2.0:1788573283.491224:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:1.0:1788573283.491230:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573283.491253:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360856704/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573283.491263:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573283.491266:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573283.491268:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573283.491272:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1629
00000100:00080000:1.0:1788573283.491276:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573283.491281:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573283.491287:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573283.491291:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573283/real 1788573283]  req@ffff8dc005dc3800 x1875453360856320/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573308 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573283.491302:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360856832/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573283.491313:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788573283.491316:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453360856320/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573308 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573283.491318:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573283.491322:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573283.491334:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1629
00000100:00080000:2.0:1788573283.491338:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573283.491339:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573283.491348:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:2.0:1788573283.491349:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000008:00100000:1.0:1788573283.491354:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573283.491357:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360856320:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788573283.491376:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360856960/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573283.491387:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788573283.491389:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360856448:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788573283.491394:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573283.491398:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573283.491403:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1629
00000100:00080000:1.0:1788573283.491407:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573283.491412:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573283.491417:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788573283.491422:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573283.491434:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360857088/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788573283.491442:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573283/real 1788573283]  req@ffff8dc005dc1500 x1875453360856448/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573308 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573283.491459:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360856448/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573308 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573283.491471:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573283.491475:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573283.491478:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360856448:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788573283.491485:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360856576:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573283.491506:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573283.491517:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573283/real 1788573283]  req@ffff8dc005dc0700 x1875453360856576/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573308 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573283.491529:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453360856576/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573308 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573283.491538:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573283.491542:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573283.491545:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360856576:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573283.491551:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360856704:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573283.491570:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573283.491581:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573283/real 1788573283]  req@ffff8dc005dc1180 x1875453360856704/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573308 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573283.491592:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360856704/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573308 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573283.491607:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573283.491610:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573283.491613:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360856704:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573283.491620:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360856832:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788573283.491639:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573283.491650:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573283/real 1788573283]  req@ffff8dc005dc2d80 x1875453360856832/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573308 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573283.491660:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360856832/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573308 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573283.491679:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573283.491682:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573283.491686:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360856832:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788573283.491704:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360856960:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573283.491724:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573283.491753:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573283/real 1788573283]  req@ffff8dc005dc1c00 x1875453360856960/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573308 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573283.491766:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453360856960/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573308 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573283.491774:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573283.491777:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573283.491781:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360856960:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573283.491787:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360857088:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573283.491806:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573283.491829:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573283/real 1788573283]  req@ffff8dc005dc3b80 x1875453360857088/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573308 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573283.491841:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360857088/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573308 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573283.491849:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573283.491852:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573283.491855:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360857088:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573283.875016:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573283.875022:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573283.875024:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573283.875065:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573283.875066:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573284.515043:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573284.898963:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573284.898963:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573284.898963:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573284.898992:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573284.899009:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788573284.899021:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573285.539029:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573285.922978:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573285.923003:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573285.923010:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573285.923042:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573285.923043:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573286.562992:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573286.946963:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573286.946964:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573286.946998:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573286.947036:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573286.947039:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573287.587022:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573287.970996:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573287.970996:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573287.970996:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573287.971028:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573287.971035:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573288.610986:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788573288.610987:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573288.610996:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788573288.611000:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573288.611009:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1634
00000100:00080000:0.0:1788573288.611020:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573288.611027:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788573288.611067:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453360857216/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573288.611089:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573288.611092:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573288.611093:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573288.611096:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1634
00000100:00080000:0.0:1788573288.611098:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573288.611102:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573288.611111:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573288.611120:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360857216:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788573288.611124:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453360857344/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573288.611131:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573288.611134:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573288.611135:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573288.611137:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1634
00000100:00080000:0.0:1788573288.611138:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573288.611140:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573288.611143:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573288.611149:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453360857472/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573288.611154:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573288.611156:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573288.611157:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573288.611159:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1634
00000100:00080000:0.0:1788573288.611161:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573288.611163:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573288.611166:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573288.611172:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453360857600/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573288.611177:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573288.611180:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573288.611181:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573288.611183:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1634
00000100:00080000:0.0:1788573288.611186:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573288.611188:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573288.611191:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573288.611197:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453360857728/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573288.611202:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573288.611204:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573288.611205:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573288.611208:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1634
00000100:00080000:0.0:1788573288.611210:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573288.611213:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573288.611215:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573288.611222:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453360857856/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573288.611227:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573288.611230:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573288.611231:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573288.611235:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1634
00000100:00080000:0.0:1788573288.611238:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573288.611242:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573288.611248:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573288.611260:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453360857984/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788573288.611264:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360857344:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788573288.611301:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360857472:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573288.611321:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360857600:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573288.611339:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360857728:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788573288.611356:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360857856:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573288.611376:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360857984:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573288.994969:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573288.994971:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573288.994998:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573288.995038:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788573288.995055:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573289.634981:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573290.018994:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573290.019017:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573290.019017:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573290.019051:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573290.658957:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573291.042936:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573291.042965:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573291.042984:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573291.043011:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573291.043011:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573291.683022:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000400:00000100:1.0:1788573291.683128:0:2334:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.140:988
00000400:00000100:1.0:1788573291.683174:0:2334:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.140@tcp at host 192.168.202.140 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:1.0:1788573291.683188:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788573291.683228:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788573291.683238:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788573291.683248:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788573291.683257:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788573291.683267:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788573291.683276:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:2.0:1788573291.683319:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573288/real 1788573291]  req@ffff8dc006712a00 x1875453360857984/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573313 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573291.683363:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453360857984/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573313 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573291.683383:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573291.683389:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573291.683394:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360857984:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573291.683404:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573288/real 1788573291]  req@ffff8dc006710e00 x1875453360857344/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573313 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573291.683427:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453360857344/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573313 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573291.683444:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573291.683449:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573291.683454:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360857344:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788573291.683464:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573288/real 1788573291]  req@ffff8dc006712300 x1875453360857472/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573313 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573291.683482:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453360857472/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573313 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573291.683492:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573291.683497:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573291.683507:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360857472:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573291.683517:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573288/real 1788573291]  req@ffff8dc006713100 x1875453360857600/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573313 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573291.683535:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453360857600/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573313 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573291.683547:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573291.683550:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573291.683555:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360857600:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573291.683567:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573288/real 1788573291]  req@ffff8dc006713800 x1875453360857728/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573313 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573291.683586:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453360857728/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573313 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573291.683600:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573291.683605:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573291.683609:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360857728:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788573291.683621:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573288/real 1788573291]  req@ffff8dc006711880 x1875453360857856/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573313 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573291.683633:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453360857856/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573313 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573291.683640:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573291.683671:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573291.683676:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360857856:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573291.683686:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573288/real 1788573291]  req@ffff8dc006713480 x1875453360857216/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573313 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573291.683700:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453360857216/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573313 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573291.683708:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573291.683712:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573291.683715:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360857216:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788573292.066970:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573292.066970:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573292.066970:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573292.067000:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573292.067014:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573292.707039:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573293.090934:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573293.090948:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573293.090949:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573293.090999:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573293.731029:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573293.731177:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360858112:192.168.202.140@tcp:250:kworker.0
00000800:00000100:2.0:1788573293.731254:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573293.731312:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573293/real 1788573293]  req@ffff8dc00644d880 x1875453360858112/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573318 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573293.731345:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d880 x1875453360858112/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573318 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573293.731387:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573293.731398:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573293.731407:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360858112:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788573293.731441:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360858240:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788573293.731481:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573293.731504:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573293/real 1788573293]  req@ffff8dc00644f100 x1875453360858240/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573318 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573293.731530:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f100 x1875453360858240/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573318 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573293.731544:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573293.731550:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573293.731555:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360858240:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788573293.731567:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360858368:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573293.731594:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573293.731609:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573293/real 1788573293]  req@ffff8dc00644df80 x1875453360858368/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573318 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573293.731666:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644df80 x1875453360858368/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573318 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573293.731677:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573293.731681:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573293.731685:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360858368:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573293.731692:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360858496:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573293.731717:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573293.731731:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573293/real 1788573293]  req@ffff8dc00644ed80 x1875453360858496/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573318 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573293.731752:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ed80 x1875453360858496/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573318 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573293.731762:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573293.731766:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573293.731774:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360858496:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573293.731781:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360858624:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788573293.731808:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573293.731822:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573293/real 1788573293]  req@ffff8dc00644e680 x1875453360858624/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573318 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573293.731836:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453360858624/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573318 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573293.731848:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573293.731851:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573293.731856:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360858624:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788573293.731908:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360858752:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573293.731934:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573293.731948:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573293/real 1788573293]  req@ffff8dc00644d180 x1875453360858752/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573318 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573293.731963:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453360858752/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573318 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573293.731973:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573293.731977:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573293.731980:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360858752:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573293.731987:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360858880:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573293.732011:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573293.732023:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573293/real 1788573293]  req@ffff8dc00644f480 x1875453360858880/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573318 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573293.732035:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453360858880/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573318 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573293.732051:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573293.732056:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573293.732059:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360858880:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573294.114990:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573294.114990:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573294.114991:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573294.115026:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573294.115333:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573294.755071:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573295.138942:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573295.138949:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573295.139011:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573295.139034:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573295.778979:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573296.163002:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573296.163011:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573296.163170:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573296.163246:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573296.802965:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573297.186964:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573297.186965:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573297.186972:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573297.187003:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573297.826974:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573298.210964:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573298.210964:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573298.210972:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573298.210996:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573298.850943:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573298.851074:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360859008:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788573298.851109:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c380 x1875453360859264/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573298.851118:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573298.851120:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788573298.851122:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573298.851124:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1644
00000100:00080000:3.0:1788573298.851127:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573298.851130:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573298.851133:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573298.851142:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c700 x1875453360859392/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573298.851150:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1788573298.851151:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788573298.851154:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573298.851157:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573298.851161:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1644
00000100:00080000:3.0:1788573298.851166:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573298.851172:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573298.851178:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573298.851192:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f800 x1875453360859520/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788573298.851200:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573298/real 1788573298]  req@ffff8dc00644fb80 x1875453360859008/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573323 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573298.851206:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788573298.851223:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644fb80 x1875453360859008/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573323 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573298.851235:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573298.851239:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573298.851242:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360859008:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788573298.851262:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360859136:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788573298.851269:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788573298.851271:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573298.851276:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1644
00000100:00080000:3.0:1788573298.851281:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573298.851285:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:0.0:1788573298.851289:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:3.0:1788573298.851292:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573298.851303:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573298/real 1788573298]  req@ffff8dc00644e300 x1875453360859136/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573323 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573298.851309:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644dc00 x1875453360859648/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788573298.851320:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453360859136/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573323 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573298.851326:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573298.851342:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573298.851346:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788573298.851347:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:0.0:1788573298.851353:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360859136:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788573298.851357:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573298.851363:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1644
00000100:00100000:0.0:1788573298.851366:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360859264:192.168.202.140@tcp:8:kworker.0
00000100:00080000:3.0:1788573298.851368:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573298.851374:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573298.851379:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788573298.851389:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573298.851393:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c000 x1875453360859776/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788573298.851412:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573298/real 1788573298]  req@ffff8dc00644c380 x1875453360859264/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573323 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573298.851427:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453360859264/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573323 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573298.851436:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573298.851439:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573298.851443:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360859264:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573298.851450:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360859392:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573298.851472:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573298.851483:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573298/real 1788573298]  req@ffff8dc00644c700 x1875453360859392/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573323 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573298.851491:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453360859392/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573323 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573298.851500:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573298.851503:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573298.851507:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360859392:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573298.851514:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360859520:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788573298.851540:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573298.851554:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573298/real 1788573298]  req@ffff8dc00644f800 x1875453360859520/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573323 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573298.851587:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f800 x1875453360859520/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573323 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573298.851594:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573298.851597:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573298.851601:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360859520:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573298.851625:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360859648:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573298.851644:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573298.851656:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573298/real 1788573298]  req@ffff8dc00644dc00 x1875453360859648/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573323 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573298.851664:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644dc00 x1875453360859648/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573323 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573298.851670:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573298.851672:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573298.851675:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360859648:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573298.851679:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360859776:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573298.851688:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573298.851694:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573298/real 1788573298]  req@ffff8dc00644c000 x1875453360859776/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573323 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573298.851702:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c000 x1875453360859776/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573323 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573298.851708:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573298.851717:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573298.851719:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360859776:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573299.234980:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573299.234980:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573299.234982:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573299.234982:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573299.235014:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573299.235066:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573299.875002:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573300.258983:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573300.258983:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573300.259081:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573300.259095:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573300.259105:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788573300.259135:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573300.898948:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573301.282979:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573301.282997:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573301.283001:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573301.283001:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573301.283028:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573301.283101:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573301.922989:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573302.307002:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573302.307002:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573302.307003:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573302.307045:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573302.307048:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573302.307079:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573302.946988:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573303.331010:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573303.331010:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573303.331014:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573303.331058:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573303.331062:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573303.331069:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1788573303.971018:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788573303.971019:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788573303.971034:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788573303.971041:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573303.971055:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1649
00000100:00080000:3.0:1788573303.971068:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573303.971077:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573303.971126:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d500 x1875453360859904/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573303.971165:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573303.971170:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573303.971172:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573303.971177:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1649
00000100:00080000:3.0:1788573303.971180:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573303.971185:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573303.971197:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573303.971213:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ea00 x1875453360860032/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573303.971223:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573303.971228:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:0.0:1788573303.971232:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360859904:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788573303.971232:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573303.971242:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1649
00000100:00080000:3.0:1788573303.971246:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573303.971251:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573303.971267:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573303.971282:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ce00 x1875453360860160/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573303.971292:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573303.971297:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788573303.971299:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573303.971302:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1649
00000100:00080000:3.0:1788573303.971306:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573303.971311:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573303.971320:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788573303.971327:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573303.971336:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ca80 x1875453360860288/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573303.971347:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573303.971351:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573303.971353:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573303.971358:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1649
00000100:00080000:3.0:1788573303.971362:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573303.971366:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573303.971372:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573303.971389:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c000 x1875453360860416/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788573303.971391:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573303/real 1788573303]  req@ffff8dc00644d500 x1875453360859904/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573328 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573303.971417:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573303.971423:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788573303.971425:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573303.971431:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1649
00000100:00100000:0.0:1788573303.971435:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d500 x1875453360859904/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573328 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573303.971437:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573303.971447:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:0.0:1788573303.971453:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:3.0:1788573303.971455:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1788573303.971460:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573303.971464:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360859904:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788573303.971473:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644dc00 x1875453360860544/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573303.971484:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573303.971488:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:0.0:1788573303.971492:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360860032:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788573303.971492:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573303.971515:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1649
00000100:00080000:3.0:1788573303.971520:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573303.971525:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:0.0:1788573303.971532:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:3.0:1788573303.971532:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573303.971546:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573303/real 1788573303]  req@ffff8dc00644ea00 x1875453360860032/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573328 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573303.971552:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f800 x1875453360860672/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788573303.971562:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ea00 x1875453360860032/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573328 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573303.971575:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573303.971579:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573303.971581:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360860032:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573303.971588:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360860160:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573303.971603:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573303.971610:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573303/real 1788573303]  req@ffff8dc00644ce00 x1875453360860160/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573328 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573303.971618:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ce00 x1875453360860160/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573328 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573303.971624:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573303.971627:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573303.971629:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360860160:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573303.971641:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360860288:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573303.971655:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573303.971661:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573303/real 1788573303]  req@ffff8dc00644ca80 x1875453360860288/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573328 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573303.971669:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ca80 x1875453360860288/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573328 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573303.971676:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573303.971678:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573303.971680:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360860288:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573303.971683:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360860416:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788573303.971694:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573303.971701:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573303/real 1788573303]  req@ffff8dc00644c000 x1875453360860416/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573328 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573303.971708:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c000 x1875453360860416/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573328 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573303.971715:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573303.971716:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573303.971718:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360860416:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573303.971722:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360860544:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573303.971733:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573303.971738:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573303/real 1788573303]  req@ffff8dc00644dc00 x1875453360860544/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573328 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573303.971746:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644dc00 x1875453360860544/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573328 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573303.971752:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573303.971753:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573303.971755:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360860544:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573303.971768:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360860672:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573303.971779:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573303.971785:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573303/real 1788573303]  req@ffff8dc00644f800 x1875453360860672/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573328 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573303.971793:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f800 x1875453360860672/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573328 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573303.971798:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573303.971800:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573303.971802:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360860672:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573304.354942:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573304.354945:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573304.354964:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573304.354976:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573304.354976:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573304.354994:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573304.994981:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573305.378977:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573305.378977:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573305.378982:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573305.379004:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573305.379014:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573305.379015:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573306.019014:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573306.402985:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573306.402985:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788573306.403045:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573306.403097:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573306.403105:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573306.403110:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573307.043055:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573307.427027:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573307.427027:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573307.427031:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573307.427065:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573307.427077:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788573307.427095:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573308.067046:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573308.450966:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573308.450974:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573308.451003:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573308.451006:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573308.451010:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573308.451038:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00080000:3.0:1788573309.091035:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788573309.091047:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788573309.091048:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788573309.091056:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573309.091070:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1654
00000100:00080000:3.0:1788573309.091083:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573309.091092:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573309.091134:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c700 x1875453360860800/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573309.091169:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573309.091174:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573309.091176:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573309.091181:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1654
00000100:00080000:3.0:1788573309.091186:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573309.091191:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573309.091201:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573309.091219:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c380 x1875453360860928/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788573309.091224:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360860800:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788573309.091241:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573309.091246:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788573309.091248:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573309.091254:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1654
00000100:00080000:3.0:1788573309.091259:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573309.091265:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573309.091272:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788573309.091284:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573309.091290:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e300 x1875453360861056/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573309.091304:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573309.091308:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788573309.091311:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573309.091315:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1654
00000100:00080000:3.0:1788573309.091319:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573309.091324:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573309.091331:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573309.091345:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573309/real 1788573309]  req@ffff8dc00644c700 x1875453360860800/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573334 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573309.091346:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644fb80 x1875453360861184/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573309.091378:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573309.091382:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573309.091385:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788573309.091387:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453360860800/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573334 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573309.091395:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1654
00000100:00080000:0.0:1788573309.091402:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573309.091403:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573309.091408:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573309.091415:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360860800:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788573309.091415:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573309.091427:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573309.091456:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360860928:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573309.091459:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f480 x1875453360861312/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573309.091474:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1788573309.091482:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788573309.091482:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788573309.091488:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573309.091496:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1654
00000100:00080000:3.0:1788573309.091501:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573309.091508:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788573309.091511:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573309/real 1788573309]  req@ffff8dc00644c380 x1875453360860928/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573334 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1788573309.091515:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573309.091537:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d180 x1875453360861440/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788573309.091538:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453360860928/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573334 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573309.091567:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573309.091570:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573309.091575:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573309.091579:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788573309.091580:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788573309.091585:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360860928:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788573309.091591:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1654
00000100:00100000:0.0:1788573309.091594:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360861056:192.168.202.140@tcp:8:kworker.0
00000100:00080000:3.0:1788573309.091598:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573309.091606:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573309.091612:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788573309.091621:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573309.091630:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e680 x1875453360861568/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788573309.091639:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573309/real 1788573309]  req@ffff8dc00644e300 x1875453360861056/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573334 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573309.091663:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453360861056/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573334 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573309.091672:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573309.091676:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573309.091679:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360861056:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573309.091685:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360861184:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573309.091704:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573309.091714:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573309/real 1788573309]  req@ffff8dc00644fb80 x1875453360861184/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573334 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573309.091724:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644fb80 x1875453360861184/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573334 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573309.091741:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573309.091745:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573309.091748:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360861184:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573309.091766:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360861312:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788573309.091782:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573309.091790:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573309/real 1788573309]  req@ffff8dc00644f480 x1875453360861312/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573334 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573309.091798:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453360861312/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573334 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573309.091808:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573309.091810:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573309.091812:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360861312:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573309.091816:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360861440:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573309.091827:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573309.091833:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573309/real 1788573309]  req@ffff8dc00644d180 x1875453360861440/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573334 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573309.091840:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453360861440/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573334 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573309.091845:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573309.091847:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573309.091848:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360861440:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573309.091852:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360861568:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573309.091861:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573309.091902:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573309/real 1788573309]  req@ffff8dc00644e680 x1875453360861568/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573334 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573309.091916:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453360861568/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573334 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573309.091921:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573309.091923:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573309.091926:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360861568:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573309.474979:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573309.474979:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788573309.475029:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573309.475029:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573309.475043:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573309.475060:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573310.114976:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573310.498944:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573310.498958:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573310.498967:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573310.498993:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573310.498994:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573310.499037:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573311.138990:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573311.522973:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573311.522973:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573311.523072:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573311.523096:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788573311.523269:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573311.523311:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573312.162961:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573312.546977:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573312.546977:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573312.546977:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573312.547005:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573312.547009:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573312.547015:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573313.186966:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573313.571007:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573313.571022:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573313.571033:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573313.571033:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573313.571075:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788573313.571098:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573314.210992:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788573314.211017:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573314.211029:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788573314.211040:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573314.211054:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1659
00000100:00080000:3.0:1788573314.211068:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573314.211079:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573314.211131:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ed80 x1875453360861696/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573314.211166:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573314.211170:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573314.211172:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573314.211177:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1659
00000100:00080000:3.0:1788573314.211181:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573314.211187:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573314.211201:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573314.211224:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644df80 x1875453360861824/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573314.211233:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573314.211236:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788573314.211240:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573314.211245:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1659
00000100:00080000:3.0:1788573314.211248:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573314.211255:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788573314.211258:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360861696:192.168.202.140@tcp:250:kworker.0
00000008:00100000:3.0:1788573314.211262:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573314.211282:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f100 x1875453360861952/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573314.211292:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573314.211295:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788573314.211296:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573314.211300:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1659
00000100:00080000:3.0:1788573314.211302:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573314.211306:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573314.211310:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573314.211319:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d880 x1875453360862080/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573314.211325:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573314.211328:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573314.211330:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573314.211333:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1659
00000100:00080000:3.0:1788573314.211336:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573314.211339:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573314.211342:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573314.211362:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e680 x1875453360862208/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1788573314.211364:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788573314.211388:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573314.211392:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788573314.211394:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573314.211400:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1659
00000100:00080000:3.0:1788573314.211405:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573314.211409:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573314.211414:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573314.211424:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d180 x1875453360862336/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573314.211431:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573314.211436:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:0.0:1788573314.211439:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573314/real 1788573314]  req@ffff8dc00644ed80 x1875453360861696/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573339 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573314.211439:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573314.211447:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1659
00000100:00080000:3.0:1788573314.211453:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573314.211465:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573314.211477:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573314.211486:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ed80 x1875453360861696/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573339 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573314.211495:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f480 x1875453360862464/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573314.211512:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573314.211523:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573314.211529:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360861696:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788573314.211540:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360861824:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788573314.211570:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573314.211582:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573314/real 1788573314]  req@ffff8dc00644df80 x1875453360861824/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573339 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573314.211595:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644df80 x1875453360861824/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573339 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573314.211606:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573314.211610:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573314.211628:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360861824:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573314.211654:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360861952:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573314.211675:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573314.211687:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573314/real 1788573314]  req@ffff8dc00644f100 x1875453360861952/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573339 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573314.211700:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f100 x1875453360861952/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573339 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573314.211709:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573314.211713:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573314.211716:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360861952:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573314.211722:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360862080:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573314.211739:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573314.211749:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573314/real 1788573314]  req@ffff8dc00644d880 x1875453360862080/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573339 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573314.211761:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d880 x1875453360862080/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573339 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573314.211770:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573314.211773:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573314.211777:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360862080:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573314.211784:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360862208:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788573314.211802:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573314.211812:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573314/real 1788573314]  req@ffff8dc00644e680 x1875453360862208/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573339 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573314.211824:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453360862208/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573339 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573314.211834:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573314.211837:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573314.211841:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360862208:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573314.211847:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360862336:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573314.211940:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573314.211953:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573314/real 1788573314]  req@ffff8dc00644d180 x1875453360862336/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573339 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573314.211965:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453360862336/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573339 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573314.211973:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573314.211977:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573314.211980:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360862336:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573314.211994:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360862464:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573314.212013:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573314.212024:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573314/real 1788573314]  req@ffff8dc00644f480 x1875453360862464/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573339 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573314.212036:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453360862464/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573339 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573314.212054:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573314.212058:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573314.212061:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360862464:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573314.594978:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573314.595002:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573314.595024:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573314.595031:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573314.595056:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788573314.595141:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573315.234952:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573315.618996:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573315.618996:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573315.618996:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573315.618997:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573315.619033:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788573315.619106:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573316.258954:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573316.642947:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573316.642948:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573316.642983:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573316.643001:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573316.643011:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788573316.643054:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573317.282935:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573317.666984:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573317.666985:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573317.666985:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573317.666989:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573317.667026:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788573317.667071:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573318.306959:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573318.691007:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573318.691030:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573318.691030:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573318.691046:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573318.691074:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573318.691080:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573319.330995:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573319.331005:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:2.0:1788573319.331008:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573319.331009:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573319.331019:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1664
00000100:00080000:1.0:1788573319.331030:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573319.331037:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573319.331076:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453360862592/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573319.331099:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573319.331102:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573319.331103:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573319.331106:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1664
00000100:00080000:1.0:1788573319.331109:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573319.331111:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573319.331119:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573319.331132:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360862720/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573319.331140:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573319.331143:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573319.331144:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573319.331146:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1664
00000100:00080000:1.0:1788573319.331148:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573319.331151:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573319.331155:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573319.331159:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360862592:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788573319.331168:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360862848/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573319.331183:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573319.331187:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573319.331189:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573319.331194:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1664
00000100:00080000:1.0:1788573319.331198:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573319.331204:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573319.331211:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573319.331225:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360862976/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573319.331232:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573319.331235:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573319.331236:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573319.331239:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1664
00000100:00080000:1.0:1788573319.331242:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573319.331245:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573319.331248:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573319.331262:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360863104/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1788573319.331266:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788573319.331276:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573319.331279:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573319.331282:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573319.331286:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1664
00000100:00080000:1.0:1788573319.331288:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573319.331290:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573319.331294:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573319.331302:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360863232/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573319.331308:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573319.331310:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573319.331311:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573319.331332:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1664
00000100:00080000:1.0:1788573319.331335:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573319.331338:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573319.331342:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573319.331351:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360863360/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788573319.331375:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573319/real 1788573319]  req@ffff8dc005dc0a80 x1875453360862592/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573344 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573319.331395:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453360862592/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573344 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573319.331405:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573319.331410:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573319.331413:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360862592:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788573319.331420:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360862720:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788573319.331441:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573319.331451:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573319/real 1788573319]  req@ffff8dc005dc3b80 x1875453360862720/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573344 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573319.331460:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360862720/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573344 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573319.331467:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573319.331470:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573319.331473:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360862720:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573319.331498:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360862848:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573319.331511:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573319.331518:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573319/real 1788573319]  req@ffff8dc005dc1c00 x1875453360862848/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573344 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573319.331526:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453360862848/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573344 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573319.331532:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573319.331534:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573319.331537:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360862848:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573319.331540:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360862976:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573319.331551:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573319.331558:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573319/real 1788573319]  req@ffff8dc005dc2d80 x1875453360862976/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573344 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573319.331565:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360862976/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573344 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573319.331571:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573319.331573:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573319.331575:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360862976:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573319.331579:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360863104:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788573319.331590:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573319.331596:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573319/real 1788573319]  req@ffff8dc005dc1180 x1875453360863104/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573344 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573319.331604:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360863104/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573344 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573319.331610:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573319.331612:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573319.331614:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360863104:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573319.331617:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360863232:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573319.331628:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573319.331634:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573319/real 1788573319]  req@ffff8dc005dc0700 x1875453360863232/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573344 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573319.331645:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453360863232/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573344 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573319.331651:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573319.331653:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573319.331655:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360863232:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573319.331658:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360863360:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573319.331668:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573319.331674:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573319/real 1788573319]  req@ffff8dc005dc1500 x1875453360863360/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573344 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573319.331680:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360863360/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573344 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573319.331686:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573319.331688:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573319.331690:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360863360:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573319.714981:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573319.714989:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573319.715021:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573319.715027:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573319.715049:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573319.715070:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573320.354944:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573320.739012:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573320.739047:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573320.739047:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573320.739083:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573320.739085:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573320.739091:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573321.379038:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573321.762993:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573321.762993:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573321.762993:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573321.763032:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573321.763034:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573321.763036:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573322.402936:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573322.787013:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573322.787013:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573322.787013:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573322.787048:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573322.787053:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788573322.787065:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573323.427026:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573323.811001:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573323.811013:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573323.811023:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573323.811041:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573323.811051:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573323.811072:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00080000:0.0:1788573324.451031:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788573324.451031:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788573324.451045:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788573324.451050:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573324.451063:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1670
00000100:00080000:0.0:1788573324.451075:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573324.451083:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788573324.451128:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453360863488/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573324.451161:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573324.451165:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573324.451166:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573324.451169:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1670
00000100:00080000:0.0:1788573324.451172:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573324.451174:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573324.451185:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573324.451195:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453360863616/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573324.451204:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788573324.451208:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360863488:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788573324.451210:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573324.451216:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573324.451221:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1670
00000100:00080000:0.0:1788573324.451225:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573324.451229:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573324.451236:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573324.451265:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453360863744/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573324.451277:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573324.451282:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573324.451284:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573324.451288:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1670
00000100:00080000:0.0:1788573324.451300:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573324.451305:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:2.0:1788573324.451311:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:0.0:1788573324.451313:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573324.451330:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453360863872/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573324.451340:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573324.451344:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573324.451347:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573324.451353:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1670
00000100:00080000:0.0:1788573324.451358:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1788573324.451362:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573324/real 1788573324]  req@ffff8dc006711c00 x1875453360863488/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573349 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573324.451366:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573324.451377:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573324.451387:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453360863488/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573349 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573324.451392:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453360864000/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573324.451402:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573324.451407:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573324.451412:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360863488:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788573324.451413:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573324.451419:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573324.451421:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573324.451426:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1670
00000100:00080000:0.0:1788573324.451430:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573324.451433:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573324.451437:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573324.451441:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360863616:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573324.451449:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453360864128/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573324.451459:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573324.451462:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573324.451463:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:2.0:1788573324.451466:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788573324.451471:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1670
00000100:00080000:0.0:1788573324.451476:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573324.451479:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573324.451482:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573324/real 1788573324]  req@ffff8dc006712680 x1875453360863616/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573349 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1788573324.451485:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573324.451498:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453360863616/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573349 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573324.451501:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453360864256/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573324.451520:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573324.451525:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573324.451528:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360863616:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788573324.451533:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360863744:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573324.451548:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573324.451555:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573324/real 1788573324]  req@ffff8dc006713b80 x1875453360863744/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573349 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573324.451563:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453360863744/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573349 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573324.451569:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573324.451572:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573324.451574:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360863744:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573324.451577:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360863872:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573324.451587:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573324.451593:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573324/real 1788573324]  req@ffff8dc006711500 x1875453360863872/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573349 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573324.451605:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453360863872/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573349 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573324.451611:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573324.451612:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573324.451614:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360863872:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573324.451618:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360864000:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788573324.451628:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573324.451635:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573324/real 1788573324]  req@ffff8dc006710380 x1875453360864000/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573349 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573324.451642:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453360864000/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573349 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573324.451648:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573324.451650:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573324.451652:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360864000:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788573324.451662:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360864128:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573324.451673:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573324.451679:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573324/real 1788573324]  req@ffff8dc006711c00 x1875453360864128/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573349 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573324.451686:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453360864128/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573349 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573324.451696:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573324.451699:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573324.451701:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360864128:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573324.451704:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360864256:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573324.451714:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573324.451719:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573324/real 1788573324]  req@ffff8dc006713480 x1875453360864256/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573349 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573324.451726:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453360864256/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573349 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573324.451731:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573324.451733:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573324.451735:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360864256:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573324.834968:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573324.834971:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573324.834975:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573324.834994:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573324.835003:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788573324.835022:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573325.475012:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573325.858966:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573325.858987:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573325.859004:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573325.859019:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573325.859022:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573325.859048:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573326.499003:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573326.883013:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573326.883013:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573326.883042:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573326.883042:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573326.883083:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788573326.883152:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573327.523037:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573327.906946:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573327.906947:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573327.906953:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573327.907056:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573327.907065:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573327.907160:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573328.546981:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573328.930990:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573328.931028:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788573328.931064:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573328.931065:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573328.931082:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573328.931103:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00080000:0.0:1788573329.571023:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573329.571034:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788573329.571039:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573329.571050:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1675
00000100:00080000:0.0:1788573329.571061:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573329.571069:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573329.571086:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573329.571108:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453360864384/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573329.571131:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573329.571136:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573329.571138:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573329.571144:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1675
00000100:00080000:0.0:1788573329.571149:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573329.571153:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573329.571159:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360864384:192.168.202.140@tcp:250:kworker.0
00000008:00100000:0.0:1788573329.571168:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573329.571189:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453360864512/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573329.571201:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573329.571206:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573329.571224:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573329.571230:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1675
00000100:00080000:0.0:1788573329.571236:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573329.571241:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573329.571247:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573329.571263:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453360864640/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573329.571274:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:2.0:1788573329.571277:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788573329.571285:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573329.571287:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573329.571296:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1675
00000100:00080000:0.0:1788573329.571301:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573329.571306:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573329.571312:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573329.571328:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453360864768/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573329.571339:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788573329.571342:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573329/real 1788573329]  req@ffff8dc006711880 x1875453360864384/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573354 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573329.571344:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573329.571349:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573329.571363:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1675
00000100:00080000:0.0:1788573329.571371:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573329.571377:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573329.571383:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573329.571390:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453360864384/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573354 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573329.571399:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453360864896/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573329.571406:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573329.571417:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788573329.571419:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788573329.571425:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360864384:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788573329.571429:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573329.571434:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573329.571441:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1675
00000100:00080000:0.0:1788573329.571445:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573329.571450:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573329.571455:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573329.571456:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360864512:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573329.571481:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453360865024/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788573329.571492:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788573329.571504:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573329.571509:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573329.571513:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788573329.571513:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573329/real 1788573329]  req@ffff8dc006713800 x1875453360864512/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573354 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573329.571533:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1675
00000100:00100000:2.0:1788573329.571538:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453360864512/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573354 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573329.571541:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573329.571556:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573329.571557:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:2.0:1788573329.571564:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000008:00100000:0.0:1788573329.571569:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573329.571569:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360864512:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788573329.571579:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360864640:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573329.571595:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453360865152/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788573329.571603:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573329.571620:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573329/real 1788573329]  req@ffff8dc006713100 x1875453360864640/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573354 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573329.571635:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453360864640/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573354 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573329.571642:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573329.571645:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573329.571648:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360864640:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573329.571653:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360864768:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573329.571666:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573329.571675:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573329/real 1788573329]  req@ffff8dc006712300 x1875453360864768/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573354 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573329.571687:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453360864768/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573354 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573329.571697:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573329.571701:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573329.571704:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360864768:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573329.571711:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360864896:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788573329.571733:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573329.571743:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573329/real 1788573329]  req@ffff8dc006710e00 x1875453360864896/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573354 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573329.571751:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453360864896/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573354 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573329.571763:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573329.571765:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573329.571767:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360864896:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788573329.571781:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360865024:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573329.571795:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573329.571801:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573329/real 1788573329]  req@ffff8dc006712a00 x1875453360865024/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573354 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573329.571809:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453360865024/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573354 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573329.571814:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573329.571816:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573329.571818:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360865024:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573329.571822:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360865152:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573329.571832:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573329.571839:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573329/real 1788573329]  req@ffff8dc006711880 x1875453360865152/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573354 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573329.571846:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453360865152/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573354 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573329.571851:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573329.571852:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573329.571855:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360865152:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573329.954929:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573329.954936:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573329.954970:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573329.954999:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573329.955026:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573329.955096:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573330.595022:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573330.979029:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573330.979064:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573330.979066:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573330.979084:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788573330.979168:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573330.979184:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573331.618983:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573332.003019:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573332.003056:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573332.003142:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573332.003175:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573332.003178:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573332.003249:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573332.642941:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573333.027018:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573333.027022:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573333.027056:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573333.027060:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573333.027087:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573333.027097:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573333.667031:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573334.051010:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573334.051010:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573334.051021:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573334.051046:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573334.051049:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573334.051051:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00080000:0.0:1788573334.691013:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788573334.691013:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788573334.691027:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788573334.691033:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573334.691047:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1680
00000100:00080000:0.0:1788573334.691063:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573334.691075:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788573334.691124:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453360865280/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573334.691164:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573334.691168:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573334.691170:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573334.691177:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1680
00000100:00080000:0.0:1788573334.691185:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573334.691191:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573334.691205:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573334.691230:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360865280:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788573334.691244:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453360865408/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573334.691270:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573334.691273:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573334.691276:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573334.691282:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1680
00000100:00080000:0.0:1788573334.691288:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573334.691294:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573334.691301:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573334.691314:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453360865536/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788573334.691323:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788573334.691331:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573334.691335:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573334.691336:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573334.691339:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1680
00000100:00080000:0.0:1788573334.691342:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573334.691344:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573334.691347:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573334.691361:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453360865664/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573334.691371:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573334.691374:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573334.691375:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573334.691377:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1680
00000100:00080000:0.0:1788573334.691379:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573334.691382:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573334.691384:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573334.691391:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453360865792/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573334.691396:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573334.691399:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573334.691400:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573334.691404:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1680
00000100:00080000:0.0:1788573334.691405:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573334.691407:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573334.691412:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573334.691420:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453360865920/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573334.691430:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573334.691435:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573334.691437:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573334.691443:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1680
00000100:00080000:0.0:1788573334.691447:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573334.691453:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573334.691461:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573334.691476:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453360866048/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573334.691584:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573334/real 1788573334]  req@ffff8dc006713480 x1875453360865280/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573359 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573334.691641:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453360865280/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573359 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573334.691652:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573334.691658:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573334.691666:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360865280:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788573334.691701:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360865408:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573334.691725:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573334.691735:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573334/real 1788573334]  req@ffff8dc006711c00 x1875453360865408/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573359 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573334.691744:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453360865408/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573359 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573334.691752:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573334.691754:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573334.691756:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360865408:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573334.691761:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360865536:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573334.691774:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573334.691781:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573334/real 1788573334]  req@ffff8dc006710380 x1875453360865536/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573359 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573334.691788:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453360865536/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573359 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573334.691794:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573334.691796:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573334.691799:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360865536:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573334.691803:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360865664:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573334.691817:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573334.691828:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573334/real 1788573334]  req@ffff8dc006711500 x1875453360865664/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573359 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573334.691840:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453360865664/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573359 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573334.691849:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573334.691853:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573334.691857:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360865664:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573334.691893:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360865792:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573334.691916:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573334.691926:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573334/real 1788573334]  req@ffff8dc006713b80 x1875453360865792/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573359 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573334.691934:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453360865792/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573359 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573334.691943:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573334.691947:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573334.691951:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360865792:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573334.691960:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360865920:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573334.691976:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573334.691986:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573334/real 1788573334]  req@ffff8dc006712680 x1875453360865920/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573359 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573334.691993:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453360865920/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573359 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573334.691999:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573334.692001:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573334.692002:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360865920:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573334.692006:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360866048:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573334.692017:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573334.692022:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573334/real 1788573334]  req@ffff8dc006711880 x1875453360866048/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573359 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573334.692029:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453360866048/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573359 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573334.692035:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573334.692036:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573334.692038:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360866048:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573335.074997:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573335.074997:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573335.075005:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573335.075035:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573335.075066:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788573335.075074:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573335.715002:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573336.099007:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573336.099012:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573336.099040:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573336.099041:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573336.099079:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573336.099104:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573336.739006:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573337.122975:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573337.122978:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573337.123008:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573337.123013:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573337.123049:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788573337.123079:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573337.762961:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573338.146981:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573338.146982:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573338.146994:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573338.147027:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573338.147045:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788573338.147066:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573338.787005:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573339.170966:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573339.170989:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573339.171000:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573339.171017:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573339.171019:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573339.171025:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00080000:1.0:1788573339.810967:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788573339.810969:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573339.810983:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788573339.810989:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573339.811001:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1685
00000100:00080000:1.0:1788573339.811013:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573339.811022:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573339.811060:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453360866176/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573339.811097:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573339.811102:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573339.811104:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573339.811109:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1685
00000100:00080000:1.0:1788573339.811113:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573339.811118:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573339.811128:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573339.811143:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360866176:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788573339.811147:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360866304/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573339.811160:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573339.811164:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573339.811166:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573339.811171:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1685
00000100:00080000:1.0:1788573339.811175:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573339.811180:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573339.811185:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573339.811203:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360866432/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788573339.811205:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788573339.811228:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573339.811232:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573339.811234:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573339.811239:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1685
00000100:00080000:1.0:1788573339.811244:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573339.811249:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573339.811255:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573339.811258:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573339/real 1788573339]  req@ffff8dc005dc3800 x1875453360866176/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573364 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573339.811272:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360866560/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573339.811285:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788573339.811286:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453360866176/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573364 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573339.811292:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573339.811296:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573339.811306:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1685
00000100:00080000:1.0:1788573339.811311:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573339.811311:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573339.811320:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:3.0:1788573339.811322:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000008:00100000:1.0:1788573339.811327:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573339.811330:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360866176:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788573339.811343:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360866688/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573339.811355:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573339.811361:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:3.0:1788573339.811361:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360866304:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788573339.811365:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573339.811372:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1685
00000100:00080000:1.0:1788573339.811377:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573339.811381:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573339.811387:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788573339.811393:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573339.811403:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360866816/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573339.811411:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573339/real 1788573339]  req@ffff8dc005dc1500 x1875453360866304/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573364 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573339.811444:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788573339.811449:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360866304/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573364 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573339.811450:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573339.811455:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573339.811463:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1685
00000100:00080000:1.0:1788573339.811469:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573339.811474:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573339.811475:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:3.0:1788573339.811485:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000008:00100000:1.0:1788573339.811486:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573339.811493:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360866304:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573339.811504:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360866944/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573339.811505:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360866432:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573339.811537:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573339.811554:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573339/real 1788573339]  req@ffff8dc005dc0700 x1875453360866432/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573364 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573339.811568:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453360866432/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573364 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573339.811583:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573339.811586:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573339.811588:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360866432:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573339.811592:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360866560:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573339.811608:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573339.811615:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573339/real 1788573339]  req@ffff8dc005dc1180 x1875453360866560/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573364 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573339.811622:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360866560/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573364 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573339.811628:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573339.811630:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573339.811632:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360866560:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573339.811636:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360866688:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573339.811646:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573339.811652:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573339/real 1788573339]  req@ffff8dc005dc2d80 x1875453360866688/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573364 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573339.811659:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360866688/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573364 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573339.811664:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573339.811666:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573339.811669:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360866688:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573339.811681:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360866816:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573339.811692:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573339.811698:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573339/real 1788573339]  req@ffff8dc005dc1c00 x1875453360866816/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573364 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573339.811705:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453360866816/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573364 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573339.811711:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573339.811712:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573339.811714:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360866816:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573339.811718:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360866944:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573339.811727:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573339.811732:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573339/real 1788573339]  req@ffff8dc005dc3b80 x1875453360866944/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573364 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573339.811739:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360866944/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573364 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573339.811744:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573339.811746:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573339.811748:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360866944:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573340.194975:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573340.194975:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573340.194981:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573340.195025:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573340.195029:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788573340.195088:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573340.835044:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573341.218980:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573341.218980:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573341.219024:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573341.219030:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573341.219036:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573341.219061:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573341.858990:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573342.242941:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573342.242945:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573342.242951:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573342.243035:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788573342.243049:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573342.243060:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573342.883023:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573343.266977:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573343.266981:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573343.266981:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573343.267006:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573343.267042:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573343.267092:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573343.907054:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573344.291017:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573344.291017:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573344.291020:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573344.291078:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573344.291091:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573344.291098:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1788573344.930996:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573344.931010:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788573344.931016:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573344.931029:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1690
00000100:00080000:2.0:1788573344.931042:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573344.931053:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573344.931102:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453360867072/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573344.931136:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573344.931140:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573344.931142:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573344.931146:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1690
00000100:00080000:2.0:1788573344.931150:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573344.931154:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573344.931166:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573344.931181:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453360867200/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573344.931199:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360867072:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788573344.931202:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573344.931223:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573344.931225:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573344.931230:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1690
00000100:00080000:2.0:1788573344.931234:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573344.931240:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573344.931246:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573344.931260:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453360867328/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573344.931270:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573344.931274:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573344.931276:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573344.931281:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1690
00000100:00080000:2.0:1788573344.931286:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573344.931290:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573344.931295:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573344.931306:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453360867456/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573344.931316:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573344.931320:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573344.931322:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573344.931330:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1690
00000800:00000100:3.0:1788573344.931333:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788573344.931335:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573344.931342:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573344.931347:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573344.931360:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453360867584/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573344.931370:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573344.931374:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573344.931376:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573344.931381:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1690
00000100:00080000:2.0:1788573344.931385:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573344.931391:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573344.931395:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573344/real 1788573344]  req@ffff8dc020497480 x1875453360867072/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573369 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1788573344.931398:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573344.931416:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453360867712/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573344.931424:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453360867072/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573369 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573344.931429:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573344.931438:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573344.931442:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573344.931449:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1690
00000100:00080000:3.0:1788573344.931450:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573344.931454:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573344.931458:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788573344.931462:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573344.931468:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360867072:192.168.202.140@tcp:250:kworker.0
00000008:00100000:2.0:1788573344.931470:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573344.931489:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453360867840/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573344.931504:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360867200:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573344.931533:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573344.931541:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573344.931550:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573344/real 1788573344]  req@ffff8dc020495180 x1875453360867200/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573369 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573344.931565:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453360867200/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573369 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573344.931577:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573344.931581:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573344.931585:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360867200:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573344.931592:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360867328:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573344.931611:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573344.931621:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573344/real 1788573344]  req@ffff8dc020496d80 x1875453360867328/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573369 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573344.931633:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453360867328/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573369 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573344.931643:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573344.931646:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573344.931650:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360867328:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573344.931656:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360867456:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573344.931674:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573344.931685:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573344/real 1788573344]  req@ffff8dc020494a80 x1875453360867456/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573369 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573344.931696:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453360867456/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573369 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573344.931705:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573344.931709:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573344.931712:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360867456:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573344.931719:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360867584:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573344.931736:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573344.931746:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573344/real 1788573344]  req@ffff8dc020495880 x1875453360867584/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573369 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573344.931759:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453360867584/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573369 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573344.931768:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573344.931771:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573344.931775:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360867584:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573344.931780:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360867712:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573344.931798:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573344.931809:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573344/real 1788573344]  req@ffff8dc020494380 x1875453360867712/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573369 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573344.931820:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453360867712/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573369 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573344.931828:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573344.931831:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573344.931835:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360867712:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573344.931854:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360867840:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573344.931907:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573344.931920:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573344/real 1788573344]  req@ffff8dc020495500 x1875453360867840/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573369 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573344.931932:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453360867840/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573369 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573344.931941:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573344.931945:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573344.931948:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360867840:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573345.314959:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573345.314959:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573345.314959:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573345.314959:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573345.314992:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573345.315034:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573345.955053:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573346.338993:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573346.338993:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573346.339009:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573346.339029:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573346.339039:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573346.339048:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573346.979016:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573347.363001:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573347.363001:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573347.363005:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573347.363035:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573347.363071:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573347.363096:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573348.003022:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573348.386986:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573348.387004:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573348.387032:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573348.387142:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573348.387151:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788573348.387255:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573349.027012:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573349.410992:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573349.410992:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573349.411009:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573349.411035:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573349.411038:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788573349.411056:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1788573350.051033:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573350.051045:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788573350.051051:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573350.051064:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1695
00000100:00100000:0.0:1788573350.051070:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788573350.051077:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573350.051086:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573350.051133:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453360867968/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573350.051166:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573350.051169:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573350.051171:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573350.051174:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1695
00000100:00080000:2.0:1788573350.051177:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573350.051181:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573350.051193:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573350.051203:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453360868096/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573350.051226:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360867968:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788573350.051228:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573350.051241:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573350.051244:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573350.051248:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1695
00000100:00080000:2.0:1788573350.051250:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573350.051253:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573350.051258:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573350.051269:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453360868224/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573350.051277:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573350.051280:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573350.051281:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573350.051284:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1695
00000100:00080000:2.0:1788573350.051300:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573350.051304:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573350.051308:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788573350.051316:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573350.051318:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453360868352/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573350.051330:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573350.051334:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573350.051336:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573350.051343:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1695
00000100:00080000:2.0:1788573350.051345:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573350.051348:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573350.051352:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573350.051378:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453360868480/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573350.051379:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573350/real 1788573350]  req@ffff8dc020494000 x1875453360867968/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573375 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573350.051436:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573350.051440:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573350.051442:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573350.051452:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1695
00000100:00100000:3.0:1788573350.051453:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453360867968/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573375 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573350.051461:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573350.051475:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573350.051481:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788573350.051482:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573350.051497:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573350.051502:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360867968:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788573350.051513:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453360868608/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573350.051521:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573350.051523:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573350.051525:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573350.051528:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1695
00000100:00080000:2.0:1788573350.051530:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573350.051535:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573350.051535:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360868096:192.168.202.140@tcp:38:kworker.0
00000008:00100000:2.0:1788573350.051545:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573350.051557:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453360868736/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788573350.051578:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573350.051594:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573350/real 1788573350]  req@ffff8dc020497100 x1875453360868096/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573375 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573350.051609:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453360868096/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573375 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573350.051629:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573350.051631:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573350.051634:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360868096:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573350.051639:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360868224:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573350.051654:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573350.051662:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573350/real 1788573350]  req@ffff8dc020494e00 x1875453360868224/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573375 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573350.051670:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453360868224/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573375 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573350.051676:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573350.051678:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573350.051680:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360868224:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573350.051684:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360868352:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573350.051695:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573350.051701:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573350/real 1788573350]  req@ffff8dc020496a00 x1875453360868352/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573375 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573350.051708:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453360868352/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573375 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573350.051718:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573350.051721:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573350.051723:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360868352:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573350.051727:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360868480:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573350.051737:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573350.051743:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573350/real 1788573350]  req@ffff8dc020494700 x1875453360868480/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573375 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573350.051750:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453360868480/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573375 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573350.051756:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573350.051758:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573350.051760:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360868480:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573350.051763:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360868608:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573350.051774:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573350.051780:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573350/real 1788573350]  req@ffff8dc020495500 x1875453360868608/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573375 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573350.051787:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453360868608/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573375 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573350.051791:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573350.051793:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573350.051796:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360868608:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573350.051810:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360868736:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573350.051821:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573350.051827:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573350/real 1788573350]  req@ffff8dc020494380 x1875453360868736/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573375 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573350.051833:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453360868736/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573375 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573350.051839:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573350.051841:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573350.051843:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360868736:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573350.434982:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573350.435019:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573350.435056:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573350.435126:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573350.435139:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788573350.435240:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573351.074982:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573351.459006:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573351.459016:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573351.459017:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573351.459145:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573351.459178:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788573351.459202:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573352.099031:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573352.482997:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573352.482997:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573352.483019:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573352.483038:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573352.483050:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573352.483066:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573353.123019:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573353.507046:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573353.507047:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573353.507048:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573353.507094:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788573353.507096:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573353.507122:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573354.147001:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573354.530973:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573354.530973:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573354.530982:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573354.531021:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573354.531023:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573354.531073:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573355.170979:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788573355.171001:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573355.171013:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788573355.171019:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573355.171030:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1700
00000100:00080000:3.0:1788573355.171041:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573355.171050:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573355.171091:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644fb80 x1875453360868864/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573355.171127:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573355.171132:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573355.171134:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573355.171139:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1700
00000100:00080000:3.0:1788573355.171145:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573355.171152:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573355.171163:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573355.171174:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360868864:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788573355.171185:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e300 x1875453360868992/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573355.171202:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573355.171241:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788573355.171244:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573355.171251:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1700
00000100:00080000:3.0:1788573355.171258:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573355.171264:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573355.171270:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573355.171299:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c380 x1875453360869120/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573355.171308:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573355.171311:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788573355.171313:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573355.171316:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1700
00000100:00080000:3.0:1788573355.171320:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573355.171324:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573355.171329:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573355.171339:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c700 x1875453360869248/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573355.171347:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573355.171350:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573355.171353:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573355.171360:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1700
00000100:00080000:3.0:1788573355.171363:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573355.171366:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573355.171369:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573355.171385:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f800 x1875453360869376/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788573355.171387:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360868992:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788573355.171414:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573355.171417:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788573355.171421:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573355.171426:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1700
00000100:00080000:3.0:1788573355.171434:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573355.171436:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573355.171443:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573355.171448:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360869120:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573355.171457:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644dc00 x1875453360869504/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573355.171468:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573355.171471:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788573355.171473:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573355.171479:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1700
00000100:00080000:3.0:1788573355.171482:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1788573355.171484:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360869248:192.168.202.140@tcp:8:kworker.0
00000100:00080000:3.0:1788573355.171490:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573355.171498:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573355.171516:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c000 x1875453360869632/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788573355.171531:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360869376:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788573355.171552:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360869504:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573355.171567:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360869632:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573355.554990:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573355.554993:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573355.555015:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573355.555052:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573355.555061:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788573355.555081:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573356.194992:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573356.579022:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573356.579022:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573356.579024:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573356.579026:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573356.579096:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573356.579117:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573357.218973:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573357.603024:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573357.603044:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573357.603046:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573357.603088:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573357.603100:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573357.603108:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573358.242986:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000400:00000100:0.0:1788573358.243267:0:2335:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.140:988
00000400:00000100:0.0:1788573358.243340:0:2335:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.140@tcp at host 192.168.202.140 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:0.0:1788573358.243371:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:0.0:1788573358.243430:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:0.0:1788573358.243442:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:0.0:1788573358.243457:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:0.0:1788573358.243469:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:0.0:1788573358.243497:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:2.0:1788573358.243509:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573355/real 1788573358]  req@ffff8dc00644e300 x1875453360868992/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573380 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:0.0:1788573358.243511:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:2.0:1788573358.243556:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453360868992/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573380 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573358.243571:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573358.243577:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573358.243581:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360868992:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788573358.243589:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573355/real 1788573358]  req@ffff8dc00644c380 x1875453360869120/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573380 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573358.243602:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453360869120/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573380 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573358.243610:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573358.243614:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573358.243618:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360869120:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573358.243626:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573355/real 1788573358]  req@ffff8dc00644c700 x1875453360869248/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573380 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573358.243638:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453360869248/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573380 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573358.243648:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573358.243652:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573358.243656:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360869248:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573358.243666:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573355/real 1788573358]  req@ffff8dc00644fb80 x1875453360868864/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573380 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573358.243679:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644fb80 x1875453360868864/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573380 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573358.243686:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573358.243689:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573358.243693:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360868864:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788573358.243726:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573355/real 1788573358]  req@ffff8dc00644f800 x1875453360869376/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573380 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573358.243739:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f800 x1875453360869376/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573380 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573358.243748:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573358.243751:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573358.243754:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360869376:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788573358.243761:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573355/real 1788573358]  req@ffff8dc00644dc00 x1875453360869504/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573380 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573358.243773:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644dc00 x1875453360869504/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573380 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573358.243780:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573358.243783:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573358.243786:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360869504:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573358.243792:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573355/real 1788573358]  req@ffff8dc00644c000 x1875453360869632/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573380 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573358.243803:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c000 x1875453360869632/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573380 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573358.243811:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573358.243815:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573358.243818:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360869632:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573358.626987:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573358.626987:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573358.626999:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573358.627060:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573358.627060:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788573358.627068:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573359.266936:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573359.650963:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573359.650976:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573359.650996:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573359.651022:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573359.651033:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573359.651063:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1788573360.291032:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788573360.291037:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788573360.291048:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788573360.291055:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573360.291070:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1705
00000100:00080000:3.0:1788573360.291085:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573360.291094:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573360.291142:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ca80 x1875453360869760/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573360.291179:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573360.291184:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573360.291186:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573360.291190:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1705
00000100:00080000:3.0:1788573360.291194:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573360.291199:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573360.291226:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573360.291259:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ce00 x1875453360869888/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788573360.291267:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360869760:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788573360.291288:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573360.291295:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788573360.291297:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573360.291304:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1705
00000100:00080000:3.0:1788573360.291309:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573360.291316:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573360.291324:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573360.291344:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ea00 x1875453360870016/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573360.291356:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573360.291361:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788573360.291363:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573360.291368:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1705
00000800:00000100:2.0:1788573360.291375:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788573360.291378:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573360.291388:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573360.291396:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573360.291412:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d500 x1875453360870144/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573360.291424:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788573360.291432:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573360/real 1788573360]  req@ffff8dc00644ca80 x1875453360869760/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573385 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573360.291432:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573360.291439:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573360.291456:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1705
00000100:00080000:3.0:1788573360.291468:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1788573360.291478:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ca80 x1875453360869760/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573385 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573360.291478:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573360.291498:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1788573360.291507:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573360.291514:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573360.291527:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360869760:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788573360.291528:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c000 x1875453360870272/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573360.291551:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573360.291556:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788573360.291560:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788573360.291567:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360869888:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788573360.291571:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1705
00000100:00080000:3.0:1788573360.291586:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573360.291594:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573360.291602:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788573360.291609:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573360.291624:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644dc00 x1875453360870400/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788573360.291633:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573360/real 1788573360]  req@ffff8dc00644ce00 x1875453360869888/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573385 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573360.291667:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788573360.291674:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ce00 x1875453360869888/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573385 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573360.291676:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788573360.291686:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573360.291709:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1705
00000100:00080000:3.0:1788573360.291723:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573360.291724:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573360.291732:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:2.0:1788573360.291733:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573360.291745:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360869888:192.168.202.140@tcp:38:kworker.0
00000008:00100000:3.0:1788573360.291750:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573360.291758:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360870016:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573360.291774:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f800 x1875453360870528/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788573360.291791:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573360.291812:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573360/real 1788573360]  req@ffff8dc00644ea00 x1875453360870016/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573385 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573360.291828:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ea00 x1875453360870016/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573385 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573360.291839:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573360.291844:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573360.291847:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360870016:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573360.291854:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360870144:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573360.291898:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573360.291909:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573360/real 1788573360]  req@ffff8dc00644d500 x1875453360870144/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573385 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573360.291922:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d500 x1875453360870144/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573385 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573360.291932:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573360.291935:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573360.291938:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360870144:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573360.291945:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360870272:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788573360.291963:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573360.291981:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573360/real 1788573360]  req@ffff8dc00644c000 x1875453360870272/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573385 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573360.291995:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c000 x1875453360870272/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573385 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573360.292004:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573360.292008:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573360.292011:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360870272:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788573360.292030:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360870400:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573360.292047:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573360.292057:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573360/real 1788573360]  req@ffff8dc00644dc00 x1875453360870400/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573385 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573360.292068:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644dc00 x1875453360870400/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573385 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573360.292084:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573360.292087:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573360.292091:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360870400:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573360.292097:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360870528:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573360.292111:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573360.292122:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573360/real 1788573360]  req@ffff8dc00644f800 x1875453360870528/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573385 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573360.292134:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f800 x1875453360870528/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573385 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573360.292142:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573360.292146:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573360.292150:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360870528:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573360.675015:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573360.675016:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573360.675025:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573360.675040:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573360.675059:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573360.675082:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573361.314932:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573361.698976:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573361.698976:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573361.698978:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573361.699026:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573361.699028:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573361.699053:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573362.338944:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573362.722942:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573362.722946:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573362.722949:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573362.722976:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573362.722987:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788573362.722993:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573363.363035:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573363.746961:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573363.746961:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573363.746985:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573363.747006:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573363.747011:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573363.747025:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573364.386952:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573364.770950:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573364.770951:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573364.770966:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573364.770985:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573364.770995:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788573364.771003:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1788573365.410965:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788573365.410967:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788573365.410976:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788573365.410980:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573365.410988:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1711
00000100:00080000:3.0:1788573365.410998:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573365.411004:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573365.411037:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644fb80 x1875453360870656/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573365.411065:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573365.411069:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573365.411071:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573365.411076:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1711
00000100:00080000:3.0:1788573365.411080:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573365.411086:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573365.411096:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573365.411108:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c700 x1875453360870784/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788573365.411117:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360870656:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788573365.411125:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573365.411128:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788573365.411130:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573365.411133:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1711
00000100:00080000:3.0:1788573365.411136:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573365.411138:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573365.411142:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573365.411151:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c380 x1875453360870912/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573365.411166:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573365.411169:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788573365.411171:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573365.411173:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1711
00000100:00080000:3.0:1788573365.411176:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1788573365.411180:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788573365.411180:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573365.411185:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573365.411196:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e300 x1875453360871040/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573365.411239:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788573365.411240:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573365/real 1788573365]  req@ffff8dc00644fb80 x1875453360870656/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573390 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573365.411247:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573365.411251:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573365.411264:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1711
00000100:00080000:3.0:1788573365.411269:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1788573365.411270:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644fb80 x1875453360870656/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573390 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573365.411277:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573365.411286:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1788573365.411291:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573365.411298:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573365.411300:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f480 x1875453360871168/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788573365.411307:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360870656:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788573365.411311:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573365.411316:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788573365.411318:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573365.411322:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1711
00000100:00080000:3.0:1788573365.411324:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573365.411326:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573365.411329:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573365.411335:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d180 x1875453360871296/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573365.411341:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573365.411344:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788573365.411345:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573365.411350:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1711
00000100:00100000:2.0:1788573365.411351:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360870784:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788573365.411352:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573365.411358:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573365.411361:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573365.411369:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e680 x1875453360871424/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788573365.411381:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573365.411395:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573365/real 1788573365]  req@ffff8dc00644c700 x1875453360870784/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573390 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573365.411404:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453360870784/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573390 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573365.411412:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573365.411414:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573365.411416:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360870784:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788573365.411420:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360870912:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573365.411432:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573365.411438:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573365/real 1788573365]  req@ffff8dc00644c380 x1875453360870912/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573390 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573365.411446:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453360870912/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573390 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573365.411456:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573365.411458:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573365.411460:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360870912:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573365.411464:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360871040:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573365.411473:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573365.411478:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573365/real 1788573365]  req@ffff8dc00644e300 x1875453360871040/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573390 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573365.411485:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453360871040/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573390 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573365.411491:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573365.411493:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573365.411494:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360871040:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573365.411498:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360871168:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788573365.411507:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573365.411513:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573365/real 1788573365]  req@ffff8dc00644f480 x1875453360871168/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573390 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573365.411519:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453360871168/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573390 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573365.411524:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573365.411526:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573365.411529:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360871168:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788573365.411532:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360871296:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573365.411542:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573365.411547:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573365/real 1788573365]  req@ffff8dc00644d180 x1875453360871296/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573390 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573365.411554:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453360871296/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573390 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573365.411561:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573365.411565:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573365.411568:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360871296:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573365.411586:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360871424:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573365.411607:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573365.411618:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573365/real 1788573365]  req@ffff8dc00644e680 x1875453360871424/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573390 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573365.411627:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453360871424/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573390 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573365.411632:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573365.411634:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573365.411636:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360871424:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573365.794982:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573365.794983:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573365.794985:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573365.795001:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573365.795014:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573365.795026:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573366.434943:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573366.819038:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573366.819042:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573366.819042:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573366.819086:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788573366.819105:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573366.819106:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573367.459022:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573367.843013:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573367.843013:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573367.843013:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573367.843055:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573367.843056:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573367.843058:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573368.482944:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573368.866947:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573368.866963:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573368.866995:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788573368.866996:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573368.867004:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573368.867019:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573369.506996:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573369.890984:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573369.890984:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573369.891017:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573369.891017:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573369.891053:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573369.891078:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573370.531014:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788573370.531080:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573370.531087:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788573370.531092:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573370.531104:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1716
00000100:00080000:3.0:1788573370.531117:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573370.531127:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573370.531170:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d880 x1875453360871552/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573370.531197:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573370.531201:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573370.531216:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573370.531221:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1716
00000100:00080000:3.0:1788573370.531225:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573370.531229:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573370.531235:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360871552:192.168.202.140@tcp:250:kworker.0
00000008:00100000:3.0:1788573370.531241:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573370.531256:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f100 x1875453360871680/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573370.531264:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573370.531266:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788573370.531269:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573370.531272:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1716
00000100:00080000:3.0:1788573370.531276:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573370.531287:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573370.531292:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573370.531301:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644df80 x1875453360871808/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573370.531308:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573370.531312:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788573370.531313:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573370.531317:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1716
00000100:00080000:3.0:1788573370.531321:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573370.531325:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573370.531329:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1788573370.531332:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573370.531339:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ed80 x1875453360871936/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573370.531346:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573370.531348:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573370.531351:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573370.531356:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1716
00000100:00080000:3.0:1788573370.531360:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573370.531365:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573370.531371:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573370.531388:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573370/real 1788573370]  req@ffff8dc00644d880 x1875453360871552/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573395 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573370.531414:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d880 x1875453360871552/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573395 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573370.531424:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573370.531428:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573370.531432:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360871552:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788573370.531457:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360871680:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573370.531467:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e680 x1875453360872064/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573370.531479:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1788573370.531484:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788573370.531484:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788573370.531487:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573370.531493:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1716
00000100:00100000:1.0:1788573370.531501:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573370/real 1788573370]  req@ffff8dc00644f100 x1875453360871680/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573395 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573370.531504:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573370.531512:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573370.531518:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f100 x1875453360871680/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573395 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1788573370.531519:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1788573370.531532:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573370.531535:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573370.531537:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360871680:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573370.531541:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360871808:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573370.531555:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573370.531562:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573370/real 1788573370]  req@ffff8dc00644df80 x1875453360871808/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573395 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573370.531575:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644df80 x1875453360871808/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573395 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573370.531581:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573370.531583:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573370.531585:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360871808:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573370.531589:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360871936:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573370.531602:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573370.531608:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573370/real 1788573370]  req@ffff8dc00644ed80 x1875453360871936/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573395 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573370.531617:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ed80 x1875453360871936/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573395 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573370.531624:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573370.531627:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573370.531630:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360871936:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573370.531642:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360872064:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573370.531649:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d180 x1875453360872192/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788573370.531660:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788573370.531660:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573370.531665:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788573370.531668:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573370.531673:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1716
00000100:00100000:1.0:1788573370.531676:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573370/real 1788573370]  req@ffff8dc00644e680 x1875453360872064/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573395 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573370.531678:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573370.531687:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573370.531693:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453360872064/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573395 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573370.531705:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573370.531709:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573370.531717:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360872064:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573370.531737:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360872192:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573370.531756:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:3.0:1788573370.531758:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573370.531767:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573370/real 1788573370]  req@ffff8dc00644d180 x1875453360872192/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573395 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573370.531778:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453360872192/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573395 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573370.531778:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f480 x1875453360872320/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573370.531806:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573370.531809:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573370.531811:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360872192:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573370.531835:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360872320:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573370.531849:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573370.531859:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573370/real 1788573370]  req@ffff8dc00644f480 x1875453360872320/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573395 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573370.531891:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453360872320/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573395 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573370.531901:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573370.531905:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573370.531912:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360872320:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573370.915005:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573370.915005:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573370.915005:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573370.915005:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573370.915040:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788573370.915101:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573371.554985:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573371.939029:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573371.939039:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573371.939073:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573371.939080:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573371.939094:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573371.939117:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573372.578961:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573372.962968:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573372.962968:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573372.962968:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573372.962997:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573372.963003:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573372.963006:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573373.603011:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573373.986967:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573373.986970:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573373.986970:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573373.986994:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573373.986997:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573373.987003:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573374.626948:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573375.011007:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573375.011011:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573375.011045:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573375.011050:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573375.011062:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573375.011073:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573375.650999:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788573375.650999:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573375.651014:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788573375.651020:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573375.651031:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1721
00000100:00080000:3.0:1788573375.651043:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573375.651051:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573375.651097:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e300 x1875453360872448/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573375.651125:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573375.651128:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573375.651129:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573375.651132:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1721
00000100:00080000:3.0:1788573375.651135:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573375.651138:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573375.651149:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573375.651158:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c380 x1875453360872576/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788573375.651164:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360872448:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788573375.651188:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573375.651190:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788573375.651192:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573375.651198:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1721
00000100:00080000:3.0:1788573375.651234:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573375.651242:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573375.651249:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573375.651265:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c700 x1875453360872704/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788573375.651279:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788573375.651281:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573375.651287:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788573375.651290:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573375.651296:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1721
00000100:00080000:3.0:1788573375.651302:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573375.651307:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573375.651312:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573375.651327:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644fb80 x1875453360872832/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573375.651339:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788573375.651341:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573375/real 1788573375]  req@ffff8dc00644e300 x1875453360872448/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573400 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573375.651347:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573375.651354:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573375.651369:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1721
00000100:00080000:3.0:1788573375.651375:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788573375.651377:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453360872448/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573400 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573375.651386:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:1.0:1788573375.651392:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:3.0:1788573375.651396:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1788573375.651399:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573375.651411:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360872448:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788573375.651423:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f800 x1875453360872960/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788573375.651435:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360872576:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788573375.651439:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573375.651445:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788573375.651449:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573375.651457:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1721
00000800:00000100:1.0:1788573375.651462:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788573375.651467:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573375.651478:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573375.651479:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573375/real 1788573375]  req@ffff8dc00644c380 x1875453360872576/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573400 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1788573375.651488:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573375.651512:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644dc00 x1875453360873088/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788573375.651517:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453360872576/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573400 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573375.651553:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573375.651557:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573375.651559:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573375.651564:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788573375.651565:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1788573375.651570:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360872576:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788573375.651577:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1721
00000100:00100000:1.0:1788573375.651581:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360872704:192.168.202.140@tcp:8:kworker.0
00000100:00080000:3.0:1788573375.651585:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573375.651594:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573375.651602:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1788573375.651608:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573375.651627:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573375/real 1788573375]  req@ffff8dc00644c700 x1875453360872704/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573400 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573375.651629:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c000 x1875453360873216/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788573375.651702:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453360872704/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573400 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573375.651710:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573375.651713:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573375.651715:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360872704:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573375.651720:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360872832:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573375.651735:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573375.651742:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573375/real 1788573375]  req@ffff8dc00644fb80 x1875453360872832/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573400 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573375.651750:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644fb80 x1875453360872832/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573400 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573375.651761:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573375.651763:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573375.651765:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360872832:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573375.651778:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360872960:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788573375.651789:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573375.651795:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573375/real 1788573375]  req@ffff8dc00644f800 x1875453360872960/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573400 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573375.651802:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f800 x1875453360872960/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573400 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573375.651808:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573375.651810:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573375.651813:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360872960:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573375.651819:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360873088:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573375.651839:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573375.651851:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573375/real 1788573375]  req@ffff8dc00644dc00 x1875453360873088/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573400 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573375.651864:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644dc00 x1875453360873088/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573400 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573375.651907:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573375.651912:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573375.651917:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360873088:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573375.651926:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360873216:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573375.651949:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573375.651959:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573375/real 1788573375]  req@ffff8dc00644c000 x1875453360873216/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573400 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573375.651973:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c000 x1875453360873216/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573400 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573375.651981:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573375.651985:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573375.651988:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360873216:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573376.035070:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573376.035070:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573376.035070:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573376.035085:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573376.035122:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573376.035146:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573376.674929:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573377.059007:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573377.059009:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573377.059013:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573377.059018:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573377.059063:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573377.059140:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573377.698991:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573378.082987:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573378.082994:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573378.083040:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573378.083174:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573378.083196:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573378.083274:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573378.722976:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573379.107000:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573379.107001:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573379.107001:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573379.107074:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573379.107164:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573379.107171:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573379.747004:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573380.130981:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573380.130982:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573380.130982:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573380.130985:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573380.131023:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573380.131103:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1788573380.770984:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573380.770996:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788573380.771001:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573380.771015:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1726
00000100:00100000:0.0:1788573380.771018:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573380.771030:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573380.771040:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573380.771097:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453360873344/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573380.771127:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573380.771130:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573380.771132:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573380.771135:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1726
00000100:00080000:1.0:1788573380.771144:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573380.771151:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573380.771166:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573380.771183:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360873344:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788573380.771189:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360873472/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573380.771216:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573380.771220:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573380.771223:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573380.771227:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1726
00000100:00080000:1.0:1788573380.771233:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573380.771240:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573380.771247:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573380.771265:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360873600/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573380.771277:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:2.0:1788573380.771286:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788573380.771289:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573380.771293:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573380.771300:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1726
00000100:00080000:1.0:1788573380.771308:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573380.771314:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573380.771328:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573380.771346:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573380/real 1788573380]  req@ffff8dc005dc0a80 x1875453360873344/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573405 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573380.771350:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360873728/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573380.771397:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573380.771400:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573380.771402:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573380.771410:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1726
00000100:00100000:2.0:1788573380.771413:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453360873344/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573405 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573380.771415:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573380.771422:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573380.771431:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1788573380.771438:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1788573380.771447:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360873856/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573380.771447:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573380.771461:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360873344:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788573380.771466:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573380.771472:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573380.771474:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573380.771479:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1726
00000100:00080000:1.0:1788573380.771481:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573380.771484:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573380.771490:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573380.771493:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360873472:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573380.771505:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360873984/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573380.771523:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:2.0:1788573380.771526:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788573380.771531:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573380.771534:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573380.771538:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1726
00000100:00080000:1.0:1788573380.771543:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573380.771549:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573380.771555:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573380.771561:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573380/real 1788573380]  req@ffff8dc005dc3b80 x1875453360873472/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573405 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573380.771570:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360874112/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788573380.771583:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360873472/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573405 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573380.771598:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573380.771600:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573380.771603:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360873472:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788573380.771613:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360873600:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573380.771628:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573380.771635:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573380/real 1788573380]  req@ffff8dc005dc1c00 x1875453360873600/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573405 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573380.771643:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453360873600/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573405 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573380.771648:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573380.771650:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573380.771652:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360873600:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573380.771656:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360873728:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573380.771667:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573380.771673:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573380/real 1788573380]  req@ffff8dc005dc2d80 x1875453360873728/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573405 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573380.771681:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360873728/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573405 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573380.771687:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573380.771689:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573380.771691:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360873728:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573380.771694:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360873856:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788573380.771705:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573380.771712:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573380/real 1788573380]  req@ffff8dc005dc1180 x1875453360873856/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573405 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573380.771719:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360873856/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573405 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573380.771724:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573380.771726:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573380.771728:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360873856:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788573380.771741:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360873984:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573380.771751:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573380.771758:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573380/real 1788573380]  req@ffff8dc005dc0700 x1875453360873984/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573405 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573380.771765:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453360873984/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573405 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573380.771774:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573380.771776:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573380.771778:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360873984:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573380.771781:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360874112:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573380.771791:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573380.771797:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573380/real 1788573380]  req@ffff8dc005dc1500 x1875453360874112/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573405 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573380.771804:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360874112/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573405 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573380.771808:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573380.771810:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573380.771812:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360874112:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573381.154982:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573381.154982:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573381.155039:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573381.155040:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573381.155040:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573381.155130:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573381.794976:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573382.178967:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573382.178967:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573382.178967:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573382.178977:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573382.179003:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573382.179051:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573382.818935:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573383.202982:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573383.202982:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573383.202988:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573383.203013:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573383.203024:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573383.203029:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573383.842976:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573384.226956:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573384.226956:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573384.226958:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573384.226990:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573384.226999:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573384.227026:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573384.866973:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573385.250970:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573385.250970:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573385.251000:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573385.251010:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573385.251021:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573385.251024:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573385.890972:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788573385.891022:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573385.891033:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788573385.891038:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573385.891052:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1731
00000100:00080000:2.0:1788573385.891066:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573385.891075:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573385.891137:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453360874240/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573385.891173:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573385.891177:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573385.891179:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573385.891184:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1731
00000100:00080000:2.0:1788573385.891188:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573385.891195:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573385.891221:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573385.891237:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453360874368/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573385.891257:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788573385.891259:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360874240:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788573385.891262:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573385.891268:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573385.891276:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1731
00000100:00080000:2.0:1788573385.891282:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573385.891289:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573385.891297:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573385.891314:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453360874496/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788573385.891332:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788573385.891347:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573385.891352:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573385.891354:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573385.891360:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1731
00000100:00080000:2.0:1788573385.891367:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573385.891372:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573385.891379:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573385/real 1788573385]  req@ffff8dc020495880 x1875453360874240/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573410 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1788573385.891383:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573385.891409:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453360874240/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573410 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573385.891411:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453360874624/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573385.891492:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573385.891492:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573385.891504:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788573385.891509:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:1.0:1788573385.891514:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360874240:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788573385.891517:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573385.891527:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1731
00000100:00080000:2.0:1788573385.891533:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788573385.891539:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360874368:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788573385.891542:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573385.891554:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1788573385.891561:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573385.891579:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453360874752/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788573385.891580:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573385/real 1788573385]  req@ffff8dc020494a80 x1875453360874368/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573410 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573385.891658:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788573385.891662:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453360874368/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573410 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573385.891669:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573385.891673:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573385.891687:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1731
00000100:00080000:1.0:1788573385.891690:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573385.891694:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573385.891697:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573385.891704:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360874368:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788573385.891709:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573385.891716:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360874496:192.168.202.140@tcp:8:kworker.0
00000008:00100000:2.0:1788573385.891720:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573385.891743:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453360874880/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788573385.891757:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788573385.891771:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788573385.891778:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573385/real 1788573385]  req@ffff8dc020496d80 x1875453360874496/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573410 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573385.891779:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573385.891784:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573385.891796:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1731
00000100:00080000:2.0:1788573385.891805:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573385.891812:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573385.891817:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453360874496/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573410 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1788573385.891822:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1788573385.891841:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1788573385.891847:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453360875008/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573385.891851:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573385.891864:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360874496:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573385.891901:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360874624:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573385.891933:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573385.891951:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573385/real 1788573385]  req@ffff8dc020495180 x1875453360874624/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573410 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573385.891966:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453360874624/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573410 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573385.891977:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573385.891981:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573385.891985:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360874624:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573385.892005:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360874752:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788573385.892028:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573385.892053:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573385/real 1788573385]  req@ffff8dc020497480 x1875453360874752/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573410 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573385.892067:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453360874752/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573410 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573385.892077:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573385.892081:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573385.892085:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360874752:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573385.892092:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360874880:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573385.892112:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573385.892123:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573385/real 1788573385]  req@ffff8dc020495880 x1875453360874880/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573410 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573385.892137:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453360874880/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573410 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573385.892145:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573385.892149:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573385.892152:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360874880:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573385.892159:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360875008:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573385.892178:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573385.892188:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573385/real 1788573385]  req@ffff8dc020494380 x1875453360875008/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573410 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573385.892215:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453360875008/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573410 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573385.892225:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573385.892229:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573385.892233:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360875008:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573386.274965:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573386.274983:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573386.275018:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573386.275024:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573386.275061:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573386.275072:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573386.915009:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573387.299019:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573387.299019:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573387.299019:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573387.299050:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573387.299063:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573387.299064:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573387.939034:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573388.323028:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573388.323029:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573388.323029:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573388.323034:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573388.323072:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788573388.323148:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573388.963036:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573389.347019:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573389.347019:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573389.347019:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573389.347019:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573389.347060:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573389.347111:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573389.986999:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573390.371007:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573390.371007:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573390.371007:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573390.371007:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573390.371043:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788573390.371112:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1788573391.010997:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788573391.011001:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788573391.011009:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788573391.011016:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573391.011027:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1736
00000100:00080000:2.0:1788573391.011040:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573391.011048:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573391.011095:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453360875136/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573391.011130:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573391.011135:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573391.011137:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573391.011142:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1736
00000100:00080000:2.0:1788573391.011146:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573391.011151:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573391.011162:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573391.011174:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453360875264/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788573391.011182:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360875136:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788573391.011185:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573391.011192:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573391.011196:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573391.011221:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1736
00000100:00080000:2.0:1788573391.011224:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573391.011228:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573391.011233:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573391.011243:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453360875392/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573391.011251:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573391.011254:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573391.011256:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573391.011258:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1736
00000100:00080000:2.0:1788573391.011261:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573391.011263:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573391.011266:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573391.011273:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453360875520/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573391.011279:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573391.011282:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573391.011283:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573391.011286:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1736
00000100:00080000:2.0:1788573391.011288:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573391.011291:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573391.011293:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573391.011303:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453360875648/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788573391.011304:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788573391.011313:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573391.011317:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573391.011318:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573391.011321:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1736
00000100:00080000:2.0:1788573391.011323:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573391.011326:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573391.011330:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573391.011337:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453360875776/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573391.011343:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573391.011346:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573391.011347:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573391.011350:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1736
00000100:00080000:2.0:1788573391.011353:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788573391.011358:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573391/real 1788573391]  req@ffff8dc020495500 x1875453360875136/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573416 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573391.011364:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573391.011374:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573391.011386:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453360875136/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573416 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573391.011386:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453360875904/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573391.011419:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573391.011424:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573391.011428:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360875136:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788573391.011451:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360875264:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788573391.011469:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573391.011477:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573391/real 1788573391]  req@ffff8dc020494700 x1875453360875264/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573416 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573391.011486:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453360875264/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573416 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573391.011494:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573391.011496:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573391.011499:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360875264:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573391.011503:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360875392:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573391.011516:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573391.011522:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573391/real 1788573391]  req@ffff8dc020496a00 x1875453360875392/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573416 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573391.011535:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453360875392/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573416 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573391.011540:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573391.011542:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573391.011544:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360875392:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573391.011548:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360875520:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573391.011559:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573391.011565:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573391/real 1788573391]  req@ffff8dc020494e00 x1875453360875520/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573416 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573391.011573:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453360875520/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573416 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573391.011579:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573391.011581:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573391.011583:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360875520:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573391.011586:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360875648:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788573391.011598:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573391.011604:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573391/real 1788573391]  req@ffff8dc020497100 x1875453360875648/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573416 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573391.011611:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453360875648/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573416 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573391.011622:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573391.011624:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573391.011626:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360875648:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573391.011630:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360875776:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573391.011639:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573391.011645:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573391/real 1788573391]  req@ffff8dc020494000 x1875453360875776/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573416 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573391.011652:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453360875776/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573416 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573391.011658:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573391.011660:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573391.011662:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360875776:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573391.011666:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360875904:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573391.011676:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573391.011681:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573391/real 1788573391]  req@ffff8dc020494380 x1875453360875904/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573416 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573391.011688:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453360875904/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573416 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573391.011693:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573391.011695:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573391.011698:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360875904:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573391.395002:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573391.395016:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573391.395020:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573391.395040:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573391.395045:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573391.395094:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573392.035009:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573392.419013:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573392.419013:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788573392.419060:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573392.419071:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573392.419140:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573392.419144:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573393.059038:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573393.442965:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573393.442982:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573393.442990:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573393.443005:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573393.443007:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573393.443013:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573394.082954:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573394.466974:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573394.466974:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573394.466974:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573394.467002:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788573394.467002:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573394.467015:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573395.106977:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573395.490988:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573395.490997:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573395.491011:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573395.491015:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573395.491026:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573395.491033:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00080000:2.0:1788573396.130993:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573396.131001:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788573396.131005:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788573396.131011:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788573396.131015:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1741
00000100:00080000:2.0:1788573396.131025:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573396.131032:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573396.131065:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453360876032/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573396.131085:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573396.131088:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573396.131089:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573396.131092:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1741
00000100:00080000:2.0:1788573396.131094:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573396.131096:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573396.131107:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573396.131116:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453360876160/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573396.131124:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788573396.131126:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360876032:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788573396.131131:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573396.131134:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573396.131138:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1741
00000100:00080000:2.0:1788573396.131141:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573396.131143:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573396.131147:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573396.131156:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453360876288/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573396.131167:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573396.131170:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573396.131171:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573396.131173:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1741
00000100:00080000:2.0:1788573396.131175:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573396.131177:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573396.131180:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573396.131188:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453360876416/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788573396.131196:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788573396.131204:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573396.131206:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573396.131208:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573396.131212:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1741
00000100:00080000:2.0:1788573396.131214:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573396.131217:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573396.131221:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573396.131228:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453360876544/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573396.131235:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573396.131237:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573396.131238:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573396.131243:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1741
00000100:00100000:1.0:1788573396.131244:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573396/real 1788573396]  req@ffff8dc020495880 x1875453360876032/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573421 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573396.131246:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573396.131253:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573396.131282:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573396.131286:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453360876032/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573421 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573396.131297:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1788573396.131301:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453360876672/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573396.131304:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788573396.131314:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788573396.131315:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360876032:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788573396.131320:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573396.131323:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573396.131328:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1741
00000100:00080000:2.0:1788573396.131331:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573396.131334:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573396.131338:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573396.131349:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453360876800/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788573396.131359:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360876160:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788573396.131383:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573396.131394:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573396/real 1788573396]  req@ffff8dc020497480 x1875453360876160/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573421 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573396.131402:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453360876160/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573421 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573396.131415:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573396.131417:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573396.131419:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360876160:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573396.131424:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360876288:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573396.131436:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573396.131443:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573396/real 1788573396]  req@ffff8dc020495180 x1875453360876288/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573421 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573396.131450:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453360876288/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573421 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573396.131456:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573396.131459:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573396.131461:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360876288:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573396.131464:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360876416:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573396.131474:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573396.131480:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573396/real 1788573396]  req@ffff8dc020496d80 x1875453360876416/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573421 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573396.131487:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453360876416/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573421 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573396.131493:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573396.131495:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573396.131498:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360876416:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573396.131501:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360876544:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788573396.131512:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573396.131517:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573396/real 1788573396]  req@ffff8dc020494a80 x1875453360876544/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573421 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573396.131524:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453360876544/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573421 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573396.131530:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573396.131532:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573396.131533:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360876544:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573396.131537:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360876672:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573396.131547:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573396.131552:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573396/real 1788573396]  req@ffff8dc020494380 x1875453360876672/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573421 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573396.131560:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453360876672/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573421 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573396.131565:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573396.131566:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573396.131568:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360876672:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573396.131582:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360876800:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573396.131592:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573396.131598:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573396/real 1788573396]  req@ffff8dc020494000 x1875453360876800/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573421 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573396.131606:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453360876800/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573421 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573396.131611:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573396.131613:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573396.131615:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360876800:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573396.514954:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573396.514973:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573396.514976:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573396.514998:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573396.515014:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788573396.515121:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573397.155018:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573397.538977:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573397.538977:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573397.538994:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573397.539007:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573397.539037:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573397.539044:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573398.178964:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573398.562966:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573398.562976:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573398.562985:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573398.563008:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573398.563016:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573398.563038:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573399.202961:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573399.586952:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573399.586961:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573399.586984:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573399.586997:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573399.587003:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573399.587020:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573400.226941:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573400.610982:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573400.611004:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573400.611005:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573400.611047:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573400.611051:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788573400.611070:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1788573401.251045:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788573401.251053:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788573401.251057:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788573401.251065:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573401.251077:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1746
00000100:00080000:3.0:1788573401.251089:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573401.251096:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573401.251142:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d500 x1875453360876928/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573401.251171:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573401.251175:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573401.251177:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573401.251180:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1746
00000100:00080000:3.0:1788573401.251183:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573401.251186:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573401.251197:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573401.251208:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ea00 x1875453360877056/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573401.251215:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573401.251218:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788573401.251219:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573401.251222:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1746
00000100:00080000:3.0:1788573401.251224:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573401.251227:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573401.251231:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573401.251238:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360876928:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788573401.251240:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ce00 x1875453360877184/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573401.251255:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573401.251258:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788573401.251259:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573401.251261:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1746
00000100:00080000:3.0:1788573401.251263:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573401.251265:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573401.251268:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573401.251278:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ca80 x1875453360877312/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573401.251286:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573401.251290:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573401.251292:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573401.251297:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1746
00000100:00080000:3.0:1788573401.251301:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573401.251305:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573401.251310:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1788573401.251329:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573401.251330:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c000 x1875453360877440/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573401.251344:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573401.251348:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788573401.251365:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573401.251371:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1746
00000100:00080000:3.0:1788573401.251376:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573401.251381:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573401.251388:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573401.251404:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644dc00 x1875453360877568/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573401.251412:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573401.251415:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788573401.251419:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1788573401.251420:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573401/real 1788573401]  req@ffff8dc00644d500 x1875453360876928/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573426 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573401.251432:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1746
00000100:00080000:3.0:1788573401.251439:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573401.251445:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573401.251450:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573401.251459:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d500 x1875453360876928/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573426 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573401.251462:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f800 x1875453360877696/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573401.251483:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573401.251490:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573401.251494:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360876928:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788573401.251502:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360877056:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788573401.251524:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573401.251535:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573401/real 1788573401]  req@ffff8dc00644ea00 x1875453360877056/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573426 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573401.251544:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ea00 x1875453360877056/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573426 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573401.251552:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573401.251554:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573401.251557:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360877056:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573401.251580:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360877184:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573401.251594:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573401.251605:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573401/real 1788573401]  req@ffff8dc00644ce00 x1875453360877184/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573426 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573401.251618:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ce00 x1875453360877184/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573426 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573401.251628:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573401.251631:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573401.251635:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360877184:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573401.251642:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360877312:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573401.251665:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573401.251675:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573401/real 1788573401]  req@ffff8dc00644ca80 x1875453360877312/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573426 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573401.251684:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ca80 x1875453360877312/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573426 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573401.251691:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573401.251693:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573401.251696:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360877312:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573401.251700:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360877440:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788573401.251719:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573401.251730:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573401/real 1788573401]  req@ffff8dc00644c000 x1875453360877440/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573426 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573401.251743:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c000 x1875453360877440/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573426 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573401.251754:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573401.251758:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573401.251761:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360877440:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573401.251767:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360877568:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573401.251783:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573401.251791:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573401/real 1788573401]  req@ffff8dc00644dc00 x1875453360877568/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573426 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573401.251805:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644dc00 x1875453360877568/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573426 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573401.251811:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573401.251813:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573401.251815:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360877568:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573401.251818:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360877696:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573401.251829:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573401.251835:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573401/real 1788573401]  req@ffff8dc00644f800 x1875453360877696/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573426 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573401.251842:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f800 x1875453360877696/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573426 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573401.251848:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573401.251849:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573401.251851:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360877696:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573401.634985:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573401.634985:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573401.635012:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573401.635046:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573401.635065:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573401.635081:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573402.274990:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573402.659031:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573402.659031:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573402.659031:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788573402.659073:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573402.659076:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573402.659104:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573403.299058:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573403.682979:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573403.682979:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573403.682987:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573403.683020:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573403.683035:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788573403.683118:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573404.322999:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573404.707033:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573404.707033:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573404.707033:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788573404.707072:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573404.707080:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573404.707091:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573405.346960:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573405.730943:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573405.730991:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573405.730993:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573405.731025:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573405.731025:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573405.731144:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1788573406.371041:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788573406.371041:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573406.371055:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788573406.371061:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573406.371071:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1752
00000100:00080000:1.0:1788573406.371082:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573406.371090:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573406.371133:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453360877824/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573406.371156:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573406.371159:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573406.371161:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573406.371166:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1752
00000100:00080000:1.0:1788573406.371169:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573406.371173:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573406.371184:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573406.371197:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360877824:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788573406.371210:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360877952/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573406.371220:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573406.371223:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573406.371224:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573406.371227:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1752
00000100:00080000:1.0:1788573406.371230:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573406.371233:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573406.371237:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573406.371248:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360878080/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573406.371256:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573406.371259:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573406.371261:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573406.371264:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1752
00000100:00080000:1.0:1788573406.371267:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573406.371269:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573406.371273:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573406.371284:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360878208/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573406.371290:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573406.371293:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573406.371295:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573406.371298:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1752
00000100:00080000:1.0:1788573406.371302:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1788573406.371307:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788573406.371309:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573406.371315:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573406.371323:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360878336/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573406.371331:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573406.371334:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573406.371335:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573406.371338:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1752
00000100:00080000:1.0:1788573406.371341:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573406.371344:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573406.371348:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573406.371355:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360878464/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573406.371362:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573406.371367:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:3.0:1788573406.371368:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573406/real 1788573406]  req@ffff8dc005dc3800 x1875453360877824/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573431 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573406.371369:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573406.371374:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1752
00000100:00080000:1.0:1788573406.371377:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573406.371379:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573406.371382:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573406.371388:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360878592/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573406.371519:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453360877824/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573431 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573406.371533:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573406.371538:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573406.371543:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360877824:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788573406.371573:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360877952:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573406.371603:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573406.371758:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573406/real 1788573406]  req@ffff8dc005dc1500 x1875453360877952/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573431 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573406.371785:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360877952/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573431 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573406.371800:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573406.371804:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573406.371856:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360877952:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573406.371894:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360878080:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573406.371927:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573406.371945:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573406/real 1788573406]  req@ffff8dc005dc0700 x1875453360878080/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573431 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573406.371963:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453360878080/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573431 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573406.371974:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573406.371979:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573406.371983:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360878080:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573406.371990:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360878208:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573406.372015:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573406.372028:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573406/real 1788573406]  req@ffff8dc005dc1180 x1875453360878208/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573431 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573406.372042:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360878208/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573431 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573406.372059:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573406.372062:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573406.372066:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360878208:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573406.372072:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360878336:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573406.372096:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573406.372109:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573406/real 1788573406]  req@ffff8dc005dc2d80 x1875453360878336/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573431 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573406.372122:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360878336/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573431 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573406.372132:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573406.372136:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573406.372139:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360878336:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573406.372146:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360878464:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573406.372170:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573406.372182:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573406/real 1788573406]  req@ffff8dc005dc1c00 x1875453360878464/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573431 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573406.372194:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453360878464/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573431 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573406.372203:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573406.372206:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573406.372210:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360878464:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573406.372216:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360878592:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573406.372237:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573406.372248:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573406/real 1788573406]  req@ffff8dc005dc3b80 x1875453360878592/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573431 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573406.372261:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360878592/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573431 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573406.372270:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573406.372273:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573406.372277:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360878592:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573406.755006:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573406.755012:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573406.755013:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573406.755053:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573406.755078:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788573406.755097:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573407.395017:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573407.778984:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573407.778985:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573407.779001:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788573407.779027:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573407.779032:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573407.779059:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573408.418989:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573408.802958:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573408.802977:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573408.803000:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788573408.803013:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573408.803021:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573408.803028:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573409.442953:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573409.826986:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573409.826986:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573409.826986:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573409.827046:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573409.827048:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573409.827081:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573410.467040:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573410.850981:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573410.850982:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573410.851005:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573410.851043:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573410.851083:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788573410.851103:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573411.490982:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573411.491019:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573411.491032:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788573411.491037:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573411.491048:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1757
00000100:00080000:1.0:1788573411.491059:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573411.491069:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573411.491115:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453360878720/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573411.491143:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573411.491150:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573411.491152:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573411.491155:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1757
00000100:00080000:1.0:1788573411.491157:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573411.491160:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573411.491171:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573411.491183:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360878848/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573411.491193:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788573411.491198:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360878720:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788573411.491199:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573411.491206:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573411.491217:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1757
00000100:00080000:1.0:1788573411.491222:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573411.491226:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573411.491229:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573411.491239:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360878976/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573411.491246:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573411.491249:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573411.491252:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573411.491255:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1757
00000100:00080000:1.0:1788573411.491258:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573411.491261:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573411.491265:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573411.491273:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360879104/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573411.491280:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573411.491283:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573411.491284:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573411.491287:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1757
00000100:00080000:1.0:1788573411.491291:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573411.491299:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:3.0:1788573411.491299:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:1.0:1788573411.491311:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573411.491320:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360879232/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573411.491328:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573411.491331:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573411.491333:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573411.491336:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1757
00000100:00080000:1.0:1788573411.491340:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573411.491346:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573411.491352:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573411.491359:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573411/real 1788573411]  req@ffff8dc005dc0a80 x1875453360878720/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573436 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573411.491372:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360879360/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573411.491385:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788573411.491387:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453360878720/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573436 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573411.491399:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573411.491403:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573411.491419:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1757
00000100:00080000:3.0:1788573411.491422:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573411.491425:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573411.491432:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788573411.491438:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573411.491444:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360878720:192.168.202.140@tcp:250:kworker.0
00000008:00100000:1.0:1788573411.491447:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573411.491466:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360879488/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573411.491476:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360878848:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573411.491500:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573411.491511:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573411/real 1788573411]  req@ffff8dc005dc3b80 x1875453360878848/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573436 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573411.491520:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360878848/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573436 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573411.491527:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573411.491530:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573411.491532:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360878848:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573411.491548:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360878976:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573411.491568:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573411.491582:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573411/real 1788573411]  req@ffff8dc005dc1c00 x1875453360878976/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573436 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573411.491591:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453360878976/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573436 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573411.491597:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573411.491599:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573411.491601:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360878976:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573411.491606:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360879104:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573411.491618:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573411.491625:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573411/real 1788573411]  req@ffff8dc005dc2d80 x1875453360879104/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573436 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573411.491633:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360879104/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573436 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573411.491638:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573411.491640:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573411.491642:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360879104:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573411.491646:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360879232:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573411.491657:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573411.491663:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573411/real 1788573411]  req@ffff8dc005dc1180 x1875453360879232/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573436 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573411.491671:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360879232/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573436 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573411.491682:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573411.491685:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573411.491687:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360879232:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573411.491691:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360879360:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573411.491703:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573411.491709:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573411/real 1788573411]  req@ffff8dc005dc0700 x1875453360879360/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573436 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573411.491716:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453360879360/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573436 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573411.491726:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573411.491728:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573411.491730:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360879360:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573411.491744:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360879488:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573411.491754:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573411.491760:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573411/real 1788573411]  req@ffff8dc005dc1500 x1875453360879488/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573436 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573411.491767:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360879488/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573436 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573411.491772:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573411.491774:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573411.491776:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360879488:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573411.874990:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573411.874990:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573411.875016:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573411.875020:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573411.875055:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573411.875061:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573412.514985:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573412.898950:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573412.898950:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573412.898950:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573412.898953:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573412.898983:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788573412.899035:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573413.538971:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573413.923026:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573413.923026:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573413.923033:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573413.923064:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573413.923075:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788573413.923100:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573414.563003:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573414.946984:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573414.946984:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573414.946985:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573414.946985:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573414.947018:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788573414.947069:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573415.586927:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573415.970975:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573415.970979:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788573415.971014:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573415.971143:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573415.971166:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573415.971207:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573416.610965:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788573416.611016:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573416.611022:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788573416.611026:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573416.611036:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1762
00000100:00080000:0.0:1788573416.611048:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573416.611056:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788573416.611097:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453360879616/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573416.611123:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573416.611126:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573416.611127:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573416.611130:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1762
00000100:00080000:0.0:1788573416.611133:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573416.611135:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573416.611145:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573416.611154:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453360879744/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573416.611162:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573416.611166:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573416.611167:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573416.611170:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1762
00000100:00080000:0.0:1788573416.611172:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573416.611174:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573416.611179:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573416.611186:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360879616:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788573416.611189:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453360879872/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573416.611202:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573416.611206:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573416.611208:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573416.611212:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1762
00000100:00080000:0.0:1788573416.611216:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573416.611220:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573416.611225:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573416.611240:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453360880000/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573416.611250:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573416.611255:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573416.611256:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573416.611261:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1762
00000100:00080000:0.0:1788573416.611266:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573416.611270:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573416.611275:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573416.611286:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453360880128/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573416.611297:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573416.611301:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573416.611305:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1788573416.611306:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788573416.611316:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1762
00000100:00080000:0.0:1788573416.611321:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573416.611326:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573416.611332:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573416.611347:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453360880256/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573416.611355:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573416.611358:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573416.611360:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573416.611363:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1762
00000100:00080000:0.0:1788573416.611367:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788573416.611369:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573416/real 1788573416]  req@ffff8dc006712a00 x1875453360879616/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573441 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573416.611373:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573416.611379:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573416.611391:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453360880384/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573416.611414:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453360879616/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573441 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573416.611427:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573416.611432:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573416.611436:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360879616:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788573416.611444:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360879744:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573416.611467:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573416.611479:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573416/real 1788573416]  req@ffff8dc006710e00 x1875453360879744/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573441 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573416.611491:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453360879744/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573441 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573416.611502:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573416.611506:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573416.611509:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360879744:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573416.611538:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360879872:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573416.611560:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573416.611573:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573416/real 1788573416]  req@ffff8dc006712300 x1875453360879872/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573441 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573416.611586:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453360879872/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573441 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573416.611602:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573416.611606:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573416.611610:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360879872:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573416.611616:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360880000:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573416.611654:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573416.611667:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573416/real 1788573416]  req@ffff8dc006713100 x1875453360880000/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573441 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573416.611679:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453360880000/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573441 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573416.611688:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573416.611692:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573416.611695:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360880000:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573416.611702:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360880128:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573416.611724:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573416.611736:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573416/real 1788573416]  req@ffff8dc006713800 x1875453360880128/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573441 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573416.611749:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453360880128/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573441 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573416.611758:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573416.611761:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573416.611766:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360880128:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573416.611772:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360880256:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573416.611793:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573416.611804:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573416/real 1788573416]  req@ffff8dc006711880 x1875453360880256/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573441 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573416.611816:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453360880256/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573441 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573416.611825:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573416.611828:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573416.611832:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360880256:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573416.611838:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360880384:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573416.611859:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573416.611904:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573416/real 1788573416]  req@ffff8dc006712680 x1875453360880384/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573441 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573416.611918:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453360880384/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573441 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573416.611927:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573416.611931:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573416.611935:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360880384:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573416.994972:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573416.994979:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573416.995006:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573416.995006:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573416.995054:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573416.995091:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573417.634927:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573418.019054:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573418.019067:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573418.019083:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573418.019101:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788573418.019121:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573418.019134:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573418.658971:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573419.042951:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573419.042957:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573419.042960:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573419.042960:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573419.042990:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788573419.043025:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573419.682938:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573420.066980:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573420.067001:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573420.067029:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573420.067039:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573420.067043:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573420.067075:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573420.706930:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573421.090950:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573421.090950:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573421.090957:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573421.091042:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573421.091065:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788573421.091110:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573421.730974:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788573421.730993:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573421.731000:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788573421.731004:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573421.731012:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1767
00000100:00080000:3.0:1788573421.731021:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573421.731027:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573421.731060:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644fb80 x1875453360880512/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573421.731094:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573421.731098:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573421.731100:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573421.731104:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1767
00000100:00080000:3.0:1788573421.731108:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573421.731113:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573421.731123:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573421.731135:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c700 x1875453360880640/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788573421.731142:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360880512:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788573421.731150:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573421.731154:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788573421.731156:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573421.731160:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1767
00000100:00080000:3.0:1788573421.731163:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573421.731166:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573421.731170:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573421.731181:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c380 x1875453360880768/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573421.731188:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573421.731190:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788573421.731191:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573421.731194:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1767
00000100:00080000:3.0:1788573421.731196:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573421.731199:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573421.731202:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573421.731209:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e300 x1875453360880896/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573421.731216:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573421.731218:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573421.731220:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573421.731223:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1767
00000100:00080000:3.0:1788573421.731225:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573421.731228:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573421.731231:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573421.731242:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f480 x1875453360881024/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573421.731251:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788573421.731256:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360880640:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788573421.731256:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788573421.731258:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573421.731271:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1767
00000100:00080000:3.0:1788573421.731275:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573421.731278:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573421.731282:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573421.731293:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d180 x1875453360881152/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573421.731300:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788573421.731303:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360880768:192.168.202.140@tcp:8:kworker.0
00000100:00080000:3.0:1788573421.731304:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788573421.731307:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573421.731313:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1767
00000100:00080000:3.0:1788573421.731316:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573421.731319:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573421.731322:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573421.731332:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e680 x1875453360881280/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788573421.731349:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360880896:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573421.731380:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360881024:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573421.731408:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360881152:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573421.731430:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360881280:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573422.114989:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573422.114991:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573422.115039:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573422.115039:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573422.115061:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573422.115130:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573422.754986:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573423.138962:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573423.139021:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573423.139026:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573423.139028:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573423.139079:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573423.139130:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573423.778978:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573424.162991:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573424.163005:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573424.163024:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788573424.163037:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573424.163055:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573424.163060:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573424.803000:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000400:00000100:0.0:1788573424.803154:0:2337:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.140:988
00000400:00000100:0.0:1788573424.803201:0:2337:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.140@tcp at host 192.168.202.140 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:0.0:1788573424.803216:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:0.0:1788573424.803250:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:0.0:1788573424.803260:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:0.0:1788573424.803269:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:0.0:1788573424.803279:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:0.0:1788573424.803290:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:0.0:1788573424.803307:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:1.0:1788573424.803329:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573421/real 1788573424]  req@ffff8dc00644f480 x1875453360881024/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573446 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573424.803373:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453360881024/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573446 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573424.803390:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573424.803397:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573424.803402:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360881024:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573424.803413:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573421/real 1788573424]  req@ffff8dc00644d180 x1875453360881152/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573446 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573424.803428:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453360881152/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573446 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573424.803437:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573424.803443:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573424.803447:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360881152:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573424.803456:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573421/real 1788573424]  req@ffff8dc00644e680 x1875453360881280/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573446 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573424.803469:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453360881280/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573446 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573424.803478:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573424.803482:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573424.803486:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360881280:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573424.803494:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573421/real 1788573424]  req@ffff8dc00644c700 x1875453360880640/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573446 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573424.803508:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453360880640/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573446 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573424.803523:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573424.803528:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573424.803532:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360880640:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573424.803541:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573421/real 1788573424]  req@ffff8dc00644c380 x1875453360880768/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573446 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573424.803556:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453360880768/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573446 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573424.803566:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573424.803570:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573424.803574:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360880768:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573424.803582:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573421/real 1788573424]  req@ffff8dc00644e300 x1875453360880896/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573446 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573424.803597:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453360880896/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573446 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573424.803608:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573424.803619:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573424.803623:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360880896:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573424.803634:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573421/real 1788573424]  req@ffff8dc00644fb80 x1875453360880512/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573446 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573424.803650:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644fb80 x1875453360880512/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573446 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573424.803660:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573424.803664:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573424.803668:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360880512:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788573425.187002:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573425.187002:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573425.187012:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573425.187021:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573425.187063:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573425.187118:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573425.827066:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573426.210973:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573426.210973:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573426.210973:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573426.210973:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573426.211015:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788573426.211058:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1788573426.850986:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573426.850997:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788573426.851001:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573426.851012:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1772
00000100:00080000:3.0:1788573426.851024:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573426.851032:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573426.851038:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573426.851064:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ed80 x1875453360881408/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573426.851087:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573426.851090:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573426.851092:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573426.851095:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1772
00000100:00080000:3.0:1788573426.851098:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573426.851101:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573426.851108:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573426.851118:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644df80 x1875453360881536/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573426.851126:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573426.851130:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788573426.851132:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573426.851137:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1772
00000100:00080000:3.0:1788573426.851141:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573426.851145:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573426.851152:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573426.851167:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f100 x1875453360881664/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788573426.851174:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360881408:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788573426.851183:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573426.851189:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788573426.851191:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573426.851194:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1772
00000100:00080000:3.0:1788573426.851197:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573426.851201:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573426.851205:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573426.851217:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d880 x1875453360881792/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573426.851224:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573426.851226:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573426.851227:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573426.851231:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1772
00000100:00080000:3.0:1788573426.851234:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573426.851237:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573426.851240:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573426.851251:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644fb80 x1875453360881920/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573426.851257:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573426.851260:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788573426.851262:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573426.851266:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1772
00000100:00080000:3.0:1788573426.851269:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573426.851272:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573426.851275:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573426.851285:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e300 x1875453360882048/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788573426.851288:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788573426.851301:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573426.851305:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788573426.851308:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573426.851320:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1772
00000100:00080000:3.0:1788573426.851323:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573426.851328:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573426.851337:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573426.851353:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c380 x1875453360882176/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788573426.851383:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573426/real 1788573426]  req@ffff8dc00644ed80 x1875453360881408/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573451 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573426.851420:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ed80 x1875453360881408/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573451 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573426.851434:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573426.851440:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573426.851445:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360881408:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788573426.851456:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360881536:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788573426.851488:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573426.851503:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573426/real 1788573426]  req@ffff8dc00644df80 x1875453360881536/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573451 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573426.851517:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644df80 x1875453360881536/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573451 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573426.851528:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573426.851533:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573426.851536:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360881536:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573426.851574:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360881664:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573426.851602:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573426.851616:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573426/real 1788573426]  req@ffff8dc00644f100 x1875453360881664/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573451 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573426.851629:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f100 x1875453360881664/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573451 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573426.851646:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573426.851651:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573426.851654:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360881664:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573426.851661:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360881792:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573426.851684:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573426.851697:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573426/real 1788573426]  req@ffff8dc00644d880 x1875453360881792/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573451 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573426.851709:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d880 x1875453360881792/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573451 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573426.851720:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573426.851725:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573426.851728:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360881792:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573426.851737:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360881920:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788573426.851760:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573426.851774:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573426/real 1788573426]  req@ffff8dc00644fb80 x1875453360881920/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573451 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573426.851787:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644fb80 x1875453360881920/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573451 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573426.851796:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573426.851800:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573426.851805:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360881920:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573426.851813:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360882048:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573426.852104:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573426.852120:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573426/real 1788573426]  req@ffff8dc00644e300 x1875453360882048/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573451 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573426.852133:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453360882048/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573451 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573426.852142:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573426.852147:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573426.852151:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360882048:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573426.852159:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360882176:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573426.852183:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573426.852195:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573426/real 1788573426]  req@ffff8dc00644c380 x1875453360882176/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573451 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573426.852212:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453360882176/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573451 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573426.852220:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573426.852225:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573426.852228:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360882176:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573427.235034:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573427.235035:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573427.235035:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573427.235092:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573427.235110:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788573427.235146:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573427.875059:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573428.259002:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573428.259002:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573428.259017:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573428.259038:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573428.259053:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573428.259102:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573428.898946:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573429.283006:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573429.283051:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573429.283052:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573429.283058:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573429.283099:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788573429.283168:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573429.923005:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573430.306981:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573430.306990:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573430.307012:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573430.307013:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573430.307060:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788573430.307118:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573430.946949:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573431.331068:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573431.331068:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573431.331071:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573431.331072:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573431.331134:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788573431.331192:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1788573431.971029:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573431.971041:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:0.0:1788573431.971042:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573431.971046:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573431.971061:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1777
00000100:00080000:1.0:1788573431.971074:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573431.971082:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573431.971129:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453360882304/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573431.971158:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573431.971161:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573431.971163:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573431.971166:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1777
00000100:00080000:1.0:1788573431.971169:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573431.971172:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573431.971183:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573431.971195:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360882432/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573431.971206:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360882304:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788573431.971209:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573431.971216:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573431.971220:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573431.971228:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1777
00000100:00080000:1.0:1788573431.971231:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573431.971233:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573431.971237:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573431.971247:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360882560/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573431.971255:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573431.971259:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573431.971261:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573431.971266:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1777
00000100:00080000:1.0:1788573431.971269:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573431.971276:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573431.971283:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573431.971299:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360882688/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788573431.971299:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788573431.971315:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573431.971318:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573431.971320:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573431.971325:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1777
00000100:00080000:1.0:1788573431.971330:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573431.971334:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573431.971340:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573431.971347:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573431/real 1788573431]  req@ffff8dc005dc3800 x1875453360882304/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573456 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573431.971354:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360882816/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573431.971404:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573431.971418:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573431.971425:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788573431.971425:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453360882304/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573456 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573431.971441:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1777
00000100:00080000:1.0:1788573431.971448:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573431.971449:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573431.971463:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:3.0:1788573431.971464:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000008:00100000:1.0:1788573431.971479:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573431.971479:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360882304:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788573431.971501:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360882944/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573431.971511:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573431.971515:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573431.971517:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788573431.971519:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360882432:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788573431.971527:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1777
00000100:00080000:1.0:1788573431.971531:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573431.971533:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573431.971538:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788573431.971544:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573431.971552:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360883072/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573431.971563:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573431/real 1788573431]  req@ffff8dc005dc1500 x1875453360882432/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573456 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573431.971586:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360882432/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573456 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573431.971594:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573431.971597:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573431.971600:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360882432:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573431.971606:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360882560:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573431.971620:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573431.971627:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573431/real 1788573431]  req@ffff8dc005dc0700 x1875453360882560/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573456 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573431.971634:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453360882560/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573456 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573431.971644:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573431.971646:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573431.971648:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360882560:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573431.971652:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360882688:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573431.971663:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573431.971672:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573431/real 1788573431]  req@ffff8dc005dc1180 x1875453360882688/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573456 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573431.971683:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360882688/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573456 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573431.971692:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573431.971696:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573431.971700:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360882688:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573431.971707:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360882816:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573431.971728:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573431.971737:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573431/real 1788573431]  req@ffff8dc005dc2d80 x1875453360882816/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573456 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573431.971745:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360882816/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573456 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573431.971751:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573431.971753:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573431.971756:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360882816:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573431.971761:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360882944:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573431.971774:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573431.971780:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573431/real 1788573431]  req@ffff8dc005dc1c00 x1875453360882944/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573456 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573431.971788:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453360882944/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573456 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573431.971793:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573431.971794:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573431.971796:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360882944:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573431.971810:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360883072:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573431.971821:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573431.971828:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573431/real 1788573431]  req@ffff8dc005dc3b80 x1875453360883072/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573456 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573431.971835:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360883072/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573456 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573431.971840:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573431.971843:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573431.971845:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360883072:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573432.355002:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573432.355031:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573432.355035:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788573432.355064:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573432.355078:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573432.355081:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573432.994959:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573433.379026:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573433.379026:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573433.379026:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573433.379026:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573433.379061:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788573433.379139:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573434.019073:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573434.403000:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573434.403031:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573434.403031:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573434.403075:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573434.403081:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573434.403083:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573435.043016:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573435.427019:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573435.427020:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573435.427024:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573435.427053:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573435.427061:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573435.427063:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573436.067052:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573436.451020:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573436.451021:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573436.451056:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573436.451066:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573436.451067:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573436.451097:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573437.090954:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573437.090954:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573437.090967:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788573437.090972:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573437.090984:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1782
00000100:00080000:1.0:1788573437.090996:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573437.091004:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573437.091069:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453360883200/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573437.091097:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573437.091100:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573437.091102:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573437.091105:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1782
00000100:00080000:1.0:1788573437.091108:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573437.091110:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573437.091120:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573437.091138:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360883328/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573437.091146:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573437.091149:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573437.091152:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788573437.091156:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360883200:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788573437.091157:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1782
00000100:00080000:1.0:1788573437.091162:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573437.091168:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573437.091172:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573437.091180:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360883456/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573437.091186:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573437.091189:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573437.091190:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573437.091193:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1782
00000100:00080000:1.0:1788573437.091195:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573437.091197:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573437.091200:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573437.091208:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360883584/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573437.091213:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573437.091215:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573437.091217:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573437.091220:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1782
00000100:00080000:1.0:1788573437.091223:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573437.091226:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573437.091228:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573437.091238:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360883712/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573437.091244:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573437.091247:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573437.091248:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573437.091253:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1782
00000100:00080000:1.0:1788573437.091255:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573437.091257:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573437.091260:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788573437.091266:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573437.091268:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360883840/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573437.091280:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573437.091283:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573437.091285:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573437.091289:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1782
00000100:00080000:1.0:1788573437.091294:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573437.091296:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573437.091299:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573437.091307:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360883968/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573437.091322:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573437/real 1788573437]  req@ffff8dc005dc0a80 x1875453360883200/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573462 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573437.091339:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453360883200/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573462 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573437.091349:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573437.091352:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573437.091355:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360883200:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788573437.091379:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360883328:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573437.091397:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573437.091406:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573437/real 1788573437]  req@ffff8dc005dc3b80 x1875453360883328/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573462 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573437.091414:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360883328/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573462 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573437.091421:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573437.091424:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573437.091427:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360883328:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573437.091430:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360883456:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573437.091445:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573437.091452:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573437/real 1788573437]  req@ffff8dc005dc1c00 x1875453360883456/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573462 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573437.091459:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453360883456/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573462 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573437.091465:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573437.091467:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573437.091469:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360883456:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573437.091473:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360883584:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573437.091483:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573437.091489:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573437/real 1788573437]  req@ffff8dc005dc2d80 x1875453360883584/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573462 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573437.091496:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360883584/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573462 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573437.091502:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573437.091504:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573437.091506:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360883584:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573437.091510:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360883712:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573437.091520:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573437.091527:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573437/real 1788573437]  req@ffff8dc005dc1180 x1875453360883712/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573462 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573437.091540:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360883712/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573462 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573437.091546:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573437.091548:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573437.091549:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360883712:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573437.091553:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360883840:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573437.091564:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573437.091570:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573437/real 1788573437]  req@ffff8dc005dc0700 x1875453360883840/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573462 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573437.091577:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453360883840/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573462 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573437.091583:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573437.091585:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573437.091586:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360883840:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573437.091590:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360883968:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573437.091599:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573437.091605:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573437/real 1788573437]  req@ffff8dc005dc1500 x1875453360883968/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573462 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573437.091612:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360883968/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573462 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573437.091622:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573437.091624:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573437.091626:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360883968:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573437.475025:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573437.475026:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573437.475032:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573437.475065:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573437.475066:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573437.475073:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573438.114980:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573438.498948:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573438.498954:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573438.498962:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573438.498964:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573438.498987:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573438.499064:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573439.139018:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573439.522976:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573439.522977:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573439.522977:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573439.522977:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573439.523008:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573439.523045:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573440.162979:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573440.546936:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573440.546941:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573440.546945:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573440.546972:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573440.546993:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573440.547030:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573441.186948:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573441.570969:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573441.570977:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573441.571003:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573441.571077:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573441.571103:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573441.571132:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00080000:3.0:1788573442.210974:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788573442.210980:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788573442.210982:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788573442.210989:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573442.210999:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1787
00000100:00080000:3.0:1788573442.211008:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573442.211015:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573442.211051:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c700 x1875453360884096/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573442.211081:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573442.211085:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573442.211088:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573442.211097:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1787
00000100:00080000:3.0:1788573442.211114:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573442.211119:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573442.211128:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573442.211138:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360884096:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788573442.211144:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e680 x1875453360884224/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573442.211158:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573442.211162:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788573442.211164:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573442.211169:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1787
00000100:00080000:3.0:1788573442.211174:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573442.211179:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573442.211185:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573442.211198:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d180 x1875453360884352/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573442.211206:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573442.211208:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788573442.211209:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573442.211212:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1787
00000100:00080000:3.0:1788573442.211215:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573442.211217:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573442.211221:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1788573442.211224:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573442.211232:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f480 x1875453360884480/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573442.211247:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573442.211250:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573442.211252:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573442.211254:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1787
00000100:00080000:3.0:1788573442.211258:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573442.211261:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573442.211264:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573442.211269:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573442/real 1788573442]  req@ffff8dc00644c700 x1875453360884096/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573467 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573442.211275:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f800 x1875453360884608/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573442.211303:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573442.211306:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788573442.211307:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573442.211310:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1787
00000100:00080000:3.0:1788573442.211312:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788573442.211316:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453360884096/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573467 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573442.211317:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573442.211322:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573442.211333:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644dc00 x1875453360884736/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573442.211336:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573442.211343:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573442.211347:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788573442.211348:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788573442.211352:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1788573442.211357:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360884096:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788573442.211358:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1787
00000100:00080000:3.0:1788573442.211361:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573442.211363:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573442.211367:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573442.211376:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c000 x1875453360884864/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788573442.211396:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360884224:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788573442.211423:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573442.211438:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573442/real 1788573442]  req@ffff8dc00644e680 x1875453360884224/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573467 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573442.211453:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453360884224/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573467 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573442.211466:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573442.211471:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573442.211475:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360884224:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573442.211485:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360884352:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573442.211511:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573442.211521:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573442/real 1788573442]  req@ffff8dc00644d180 x1875453360884352/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573467 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573442.211531:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453360884352/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573467 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573442.211538:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573442.211540:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573442.211542:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360884352:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573442.211548:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360884480:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573442.211567:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573442.211577:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573442/real 1788573442]  req@ffff8dc00644f480 x1875453360884480/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573467 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573442.211589:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453360884480/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573467 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573442.211596:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573442.211598:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573442.211600:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360884480:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573442.211604:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360884608:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788573442.211616:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573442.211627:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573442/real 1788573442]  req@ffff8dc00644f800 x1875453360884608/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573467 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573442.211642:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f800 x1875453360884608/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573467 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573442.211649:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573442.211652:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573442.211655:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360884608:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573442.211660:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360884736:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573442.211673:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573442.211679:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573442/real 1788573442]  req@ffff8dc00644dc00 x1875453360884736/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573467 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573442.211687:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644dc00 x1875453360884736/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573467 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573442.211692:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573442.211694:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573442.211695:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360884736:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573442.211699:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360884864:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573442.211710:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573442.211718:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573442/real 1788573442]  req@ffff8dc00644c000 x1875453360884864/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573467 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573442.211729:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c000 x1875453360884864/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573467 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573442.211745:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573442.211749:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573442.211753:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360884864:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573442.594936:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573442.594938:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573442.594958:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573442.594966:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573442.594977:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573442.595026:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573443.234982:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573443.618980:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573443.618980:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573443.618980:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573443.619011:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573443.619031:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573443.619070:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573444.258985:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573444.642951:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573444.642967:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573444.643010:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573444.643028:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573444.643030:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573444.643127:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573445.282971:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573445.666992:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573445.666992:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573445.667012:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573445.667023:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573445.667039:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573445.667050:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573446.307002:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573446.690929:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573446.690938:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573446.690947:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573446.690972:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573446.690979:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573446.691005:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573447.330983:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788573447.330988:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573447.330998:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788573447.331004:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573447.331014:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1792
00000100:00080000:3.0:1788573447.331027:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573447.331035:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573447.331078:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ca80 x1875453360884992/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573447.331105:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573447.331108:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573447.331110:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573447.331113:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1792
00000100:00080000:3.0:1788573447.331115:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573447.331118:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573447.331130:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573447.331139:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ce00 x1875453360885120/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573447.331147:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573447.331150:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788573447.331152:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573447.331154:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1792
00000100:00080000:3.0:1788573447.331156:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573447.331162:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573447.331166:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360884992:192.168.202.140@tcp:250:kworker.0
00000008:00100000:3.0:1788573447.331166:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573447.331180:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ea00 x1875453360885248/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573447.331187:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573447.331189:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788573447.331190:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573447.331213:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1792
00000100:00080000:3.0:1788573447.331217:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573447.331221:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573447.331226:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573447.331241:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d500 x1875453360885376/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573447.331248:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573447.331251:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573447.331254:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573447.331257:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1792
00000100:00080000:3.0:1788573447.331268:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1788573447.331269:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788573447.331279:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573447.331288:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573447.331301:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c000 x1875453360885504/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573447.331308:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573447.331311:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788573447.331312:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573447.331315:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1792
00000100:00080000:3.0:1788573447.331319:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573447.331323:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573447.331329:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573447.331337:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573447/real 1788573447]  req@ffff8dc00644ca80 x1875453360884992/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573472 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573447.331341:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644dc00 x1875453360885632/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573447.331380:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788573447.331381:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ca80 x1875453360884992/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573472 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573447.331398:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788573447.331401:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573447.331403:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573447.331409:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1792
00000100:00080000:1.0:1788573447.331410:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788573447.331424:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788573447.331426:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360884992:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788573447.331434:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573447.331440:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573447.331441:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360885120:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573447.331466:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f800 x1875453360885760/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788573447.331475:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573447.331490:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573447/real 1788573447]  req@ffff8dc00644ce00 x1875453360885120/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573472 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573447.331500:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ce00 x1875453360885120/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573472 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573447.331507:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573447.331510:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573447.331512:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360885120:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573447.331533:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360885248:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573447.331546:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573447.331553:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573447/real 1788573447]  req@ffff8dc00644ea00 x1875453360885248/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573472 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573447.331562:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ea00 x1875453360885248/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573472 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573447.331567:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573447.331569:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573447.331571:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360885248:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573447.331576:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360885376:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573447.331587:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573447.331593:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573447/real 1788573447]  req@ffff8dc00644d500 x1875453360885376/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573472 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573447.331600:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d500 x1875453360885376/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573472 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573447.331607:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573447.331609:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573447.331611:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360885376:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573447.331615:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360885504:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788573447.331626:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573447.331632:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573447/real 1788573447]  req@ffff8dc00644c000 x1875453360885504/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573472 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573447.331639:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c000 x1875453360885504/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573472 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573447.331645:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573447.331647:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573447.331649:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360885504:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573447.331653:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360885632:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573447.331664:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573447.331670:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573447/real 1788573447]  req@ffff8dc00644dc00 x1875453360885632/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573472 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573447.331677:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644dc00 x1875453360885632/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573472 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573447.331682:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573447.331684:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573447.331686:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360885632:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573447.331691:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360885760:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573447.331701:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573447.331707:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573447/real 1788573447]  req@ffff8dc00644f800 x1875453360885760/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573472 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573447.331714:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f800 x1875453360885760/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573472 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573447.331719:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573447.331721:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573447.331723:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360885760:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573447.715010:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573447.715028:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573447.715028:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573447.715028:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573447.715042:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573447.715144:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573448.354954:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573448.739009:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573448.739013:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573448.739033:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573448.739037:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573448.739077:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573448.739111:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573449.379052:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573449.762942:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573449.762946:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573449.762991:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573449.763002:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573449.763021:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573449.763028:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573450.402987:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573450.786976:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573450.786976:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573450.786978:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573450.786999:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573450.787004:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573450.787020:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573451.426980:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573451.811016:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573451.811016:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573451.811026:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573451.811061:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573451.811076:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573451.811076:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1788573452.450997:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788573452.450998:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788573452.451014:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788573452.451021:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573452.451034:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1798
00000100:00080000:3.0:1788573452.451048:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573452.451056:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573452.451098:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f480 x1875453360885888/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573452.451123:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573452.451126:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573452.451127:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573452.451130:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1798
00000100:00080000:3.0:1788573452.451139:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573452.451142:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573452.451154:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573452.451164:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d180 x1875453360886016/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788573452.451168:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360885888:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788573452.451183:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573452.451186:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788573452.451188:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573452.451191:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1798
00000100:00080000:3.0:1788573452.451194:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573452.451197:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573452.451201:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573452.451209:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e680 x1875453360886144/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573452.451216:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573452.451220:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788573452.451221:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573452.451223:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1798
00000100:00080000:3.0:1788573452.451226:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573452.451228:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573452.451231:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573452.451238:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c700 x1875453360886272/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573452.451245:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573452.451247:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573452.451249:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1788573452.451252:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788573452.451256:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1798
00000100:00080000:3.0:1788573452.451261:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573452.451266:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573452.451272:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573452.451316:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c380 x1875453360886400/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788573452.451318:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573452/real 1788573452]  req@ffff8dc00644f480 x1875453360885888/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573477 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573452.451344:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573452.451348:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788573452.451350:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1788573452.451355:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453360885888/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573477 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573452.451356:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1798
00000100:00080000:3.0:1788573452.451362:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573452.451368:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573452.451375:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573452.451390:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e300 x1875453360886528/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573452.451391:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573452.451402:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788573452.451403:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573452.451406:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788573452.451407:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573452.451410:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1798
00000100:00080000:3.0:1788573452.451411:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573452.451417:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573452.451421:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360885888:192.168.202.140@tcp:250:kworker.0
00000008:00100000:3.0:1788573452.451421:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573452.451432:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644fb80 x1875453360886656/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788573452.451453:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360886016:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788573452.451484:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573452.451495:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573452/real 1788573452]  req@ffff8dc00644d180 x1875453360886016/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573477 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573452.451505:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453360886016/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573477 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573452.451513:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573452.451515:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573452.451518:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360886016:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573452.451522:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360886144:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573452.451536:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573452.451543:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573452/real 1788573452]  req@ffff8dc00644e680 x1875453360886144/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573477 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573452.451551:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453360886144/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573477 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573452.451558:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573452.451560:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573452.451562:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360886144:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573452.451566:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360886272:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573452.451578:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573452.451584:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573452/real 1788573452]  req@ffff8dc00644c700 x1875453360886272/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573477 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573452.451591:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453360886272/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573477 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573452.451598:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573452.451600:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573452.451601:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360886272:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573452.451605:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360886400:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788573452.451616:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573452.451622:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573452/real 1788573452]  req@ffff8dc00644c380 x1875453360886400/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573477 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573452.451629:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453360886400/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573477 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573452.451635:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573452.451637:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573452.451639:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360886400:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573452.451643:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360886528:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573452.451654:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573452.451660:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573452/real 1788573452]  req@ffff8dc00644e300 x1875453360886528/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573477 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573452.451668:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453360886528/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573477 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573452.451673:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573452.451675:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573452.451677:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360886528:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573452.451680:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360886656:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573452.451690:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573452.451696:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573452/real 1788573452]  req@ffff8dc00644fb80 x1875453360886656/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573477 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573452.451703:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644fb80 x1875453360886656/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573477 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573452.451709:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573452.451710:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573452.451712:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360886656:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573452.835016:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573452.835017:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573452.835017:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573452.835059:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573452.835062:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573452.835062:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573453.475010:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573453.858989:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573453.859012:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573453.859012:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573453.859021:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573453.859039:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573453.859047:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573454.499026:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573454.883012:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573454.883012:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573454.883034:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573454.883043:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573454.883080:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573454.883082:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573455.523026:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573455.906963:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573455.906963:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573455.906965:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573455.906972:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573455.906999:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573455.907025:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573456.546997:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573456.931003:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573456.931013:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573456.931041:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573456.931042:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573456.931091:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788573456.931160:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573457.570976:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573457.571015:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573457.571024:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788573457.571029:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573457.571039:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1803
00000100:00080000:1.0:1788573457.571052:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573457.571060:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573457.571106:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453360886784/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573457.571133:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573457.571136:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573457.571138:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573457.571141:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1803
00000100:00080000:1.0:1788573457.571144:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573457.571147:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573457.571158:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573457.571172:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360886912/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573457.571174:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360886784:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788573457.571188:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573457.571191:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573457.571192:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573457.571195:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1803
00000100:00080000:1.0:1788573457.571197:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573457.571200:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573457.571205:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573457.571213:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360887040/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573457.571220:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573457.571223:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573457.571224:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573457.571226:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1803
00000100:00080000:1.0:1788573457.571228:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573457.571230:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573457.571233:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573457.571241:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360887168/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573457.571246:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573457.571248:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573457.571250:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573457.571253:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1803
00000100:00080000:1.0:1788573457.571256:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573457.571259:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573457.571262:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788573457.571268:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573457.571275:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360887296/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573457.571285:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573457.571289:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573457.571292:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573457.571298:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1803
00000100:00080000:1.0:1788573457.571302:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573457.571307:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573457.571313:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573457.571327:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360887424/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573457.571332:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573457/real 1788573457]  req@ffff8dc005dc3800 x1875453360886784/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573482 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573457.571336:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573457.571343:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573457.571347:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573457.571356:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1803
00000100:00080000:1.0:1788573457.571360:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573457.571365:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573457.571368:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453360886784/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573482 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573457.571394:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573457.571399:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000008:00100000:1.0:1788573457.571401:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573457.571403:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360886784:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788573457.571420:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360887552/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573457.571436:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360886912:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573457.571468:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573457.571484:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573457/real 1788573457]  req@ffff8dc005dc1500 x1875453360886912/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573482 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573457.571499:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360886912/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573482 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573457.571521:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573457.571526:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573457.571530:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360886912:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573457.571537:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360887040:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573457.571558:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573457.571576:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573457/real 1788573457]  req@ffff8dc005dc0700 x1875453360887040/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573482 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573457.571584:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453360887040/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573482 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573457.571591:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573457.571594:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573457.571596:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360887040:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573457.571600:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360887168:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573457.571613:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573457.571620:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573457/real 1788573457]  req@ffff8dc005dc1180 x1875453360887168/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573482 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573457.571628:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360887168/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573482 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573457.571634:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573457.571636:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573457.571638:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360887168:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573457.571642:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360887296:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573457.571654:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573457.571661:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573457/real 1788573457]  req@ffff8dc005dc2d80 x1875453360887296/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573482 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573457.571669:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360887296/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573482 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573457.571675:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573457.571677:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573457.571679:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360887296:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573457.571682:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360887424:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573457.571694:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573457.571700:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573457/real 1788573457]  req@ffff8dc005dc1c00 x1875453360887424/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573482 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573457.571708:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453360887424/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573482 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573457.571714:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573457.571717:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573457.571721:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360887424:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573457.571727:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360887552:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573457.571747:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573457.571760:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573457/real 1788573457]  req@ffff8dc005dc3b80 x1875453360887552/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573482 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573457.571777:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360887552/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573482 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573457.571784:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573457.571786:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573457.571788:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360887552:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573457.955014:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573457.955051:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573457.955067:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573457.955094:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573457.955104:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573457.955120:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573458.594969:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573458.979017:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573458.979017:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573458.979022:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573458.979055:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573458.979058:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573458.979142:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573459.619005:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573460.003035:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573460.003035:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573460.003077:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573460.003082:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573460.003108:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573460.003178:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573460.642974:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573461.026982:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573461.026982:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573461.026982:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573461.026986:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573461.027018:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573461.027060:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573461.666965:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573462.050949:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573462.050966:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573462.050966:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573462.050993:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573462.051012:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573462.051024:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573462.690951:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788573462.690953:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573462.690960:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788573462.690964:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573462.690974:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1808
00000100:00080000:1.0:1788573462.690985:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573462.690993:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573462.691026:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453360887680/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573462.691050:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573462.691053:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573462.691054:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573462.691057:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1808
00000100:00080000:1.0:1788573462.691060:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573462.691062:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573462.691070:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573462.691081:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360887808/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573462.691089:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573462.691093:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573462.691095:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573462.691102:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1808
00000100:00100000:3.0:1788573462.691102:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360887680:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788573462.691106:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573462.691112:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573462.691118:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573462.691133:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360887936/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573462.691146:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573462.691149:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573462.691150:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573462.691153:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1808
00000100:00080000:1.0:1788573462.691159:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573462.691162:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573462.691165:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788573462.691171:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573462.691176:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360888064/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573462.691184:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573462.691186:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573462.691188:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573462.691191:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1808
00000100:00080000:1.0:1788573462.691194:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573462.691196:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573462.691199:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573462.691207:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360888192/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573462.691213:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573462.691215:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573462.691218:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788573462.691220:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573462/real 1788573462]  req@ffff8dc005dc0a80 x1875453360887680/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573487 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573462.691226:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1808
00000100:00080000:1.0:1788573462.691233:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573462.691241:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573462.691249:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573462.691257:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453360887680/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573487 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573462.691270:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1788573462.691276:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360888320/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573462.691279:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788573462.691286:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573462.691289:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573462.691292:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573462.691300:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1808
00000100:00100000:3.0:1788573462.691301:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360887680:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788573462.691305:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788573462.691313:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360887808:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788573462.691314:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573462.691326:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573462.691343:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360888448/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788573462.691352:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573462.691387:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573462/real 1788573462]  req@ffff8dc005dc3b80 x1875453360887808/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573487 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573462.691403:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360887808/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573487 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573462.691423:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573462.691427:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573462.691431:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360887808:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573462.691455:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360887936:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573462.691474:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573462.691483:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573462/real 1788573462]  req@ffff8dc005dc1c00 x1875453360887936/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573487 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573462.691491:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453360887936/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573487 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573462.691497:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573462.691500:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573462.691502:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360887936:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573462.691506:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360888064:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573462.691517:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573462.691536:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573462/real 1788573462]  req@ffff8dc005dc2d80 x1875453360888064/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573487 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573462.691549:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360888064/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573487 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573462.691558:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573462.691562:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573462.691566:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360888064:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573462.691573:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360888192:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573462.691601:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573462.691616:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573462/real 1788573462]  req@ffff8dc005dc1180 x1875453360888192/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573487 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573462.691628:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360888192/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573487 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573462.691638:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573462.691641:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573462.691645:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360888192:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573462.691652:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360888320:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573462.691674:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573462.691687:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573462/real 1788573462]  req@ffff8dc005dc0700 x1875453360888320/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573487 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573462.691701:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453360888320/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573487 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573462.691717:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573462.691720:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573462.691722:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360888320:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573462.691727:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360888448:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573462.691750:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573462.691763:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573462/real 1788573462]  req@ffff8dc005dc1500 x1875453360888448/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573487 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573462.691776:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360888448/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573487 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573462.691784:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573462.691788:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573462.691791:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360888448:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573463.075009:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573463.075010:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573463.075011:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573463.075061:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573463.075094:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573463.075094:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573463.715021:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573464.098980:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573464.098989:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573464.099014:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573464.099035:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573464.099044:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573464.099064:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573464.738993:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573465.123040:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573465.123055:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573465.123064:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573465.123077:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573465.123087:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573465.123108:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573465.762943:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573466.147004:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573466.147004:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573466.147010:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573466.147042:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573466.147044:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573466.147070:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573466.787045:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573467.171007:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573467.171007:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573467.171034:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573467.171038:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573467.171045:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573467.171047:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573467.810955:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788573467.810960:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573467.810969:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788573467.810974:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573467.810988:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1813
00000100:00080000:1.0:1788573467.811002:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573467.811012:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573467.811055:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453360888576/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573467.811083:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573467.811085:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573467.811087:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573467.811091:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1813
00000100:00080000:1.0:1788573467.811093:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573467.811096:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573467.811106:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573467.811117:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360888704/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573467.811124:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573467.811127:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573467.811128:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573467.811131:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1813
00000100:00080000:1.0:1788573467.811133:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573467.811135:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573467.811139:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573467.811146:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360888832/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573467.811160:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360888576:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788573467.811161:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573467.811168:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573467.811173:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573467.811176:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1813
00000100:00080000:1.0:1788573467.811178:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573467.811180:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573467.811183:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573467.811192:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360888960/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573467.811198:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573467.811201:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573467.811202:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573467.811205:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1813
00000100:00080000:1.0:1788573467.811208:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573467.811211:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573467.811213:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573467.811221:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360889088/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573467.811227:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573467.811230:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573467.811231:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573467.811234:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1813
00000100:00080000:1.0:1788573467.811238:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573467.811240:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573467.811245:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788573467.811252:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573467.811266:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360889216/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573467.811279:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573467.811283:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573467.811285:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573467.811290:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1813
00000100:00080000:1.0:1788573467.811295:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573467.811300:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573467.811305:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573467.811310:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573467/real 1788573467]  req@ffff8dc005dc3800 x1875453360888576/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573492 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573467.811319:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360889344/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573467.811343:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453360888576/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573492 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573467.811372:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573467.811378:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573467.811383:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360888576:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788573467.811391:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360888704:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573467.811415:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573467.811428:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573467/real 1788573467]  req@ffff8dc005dc1500 x1875453360888704/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573492 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573467.811441:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360888704/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573492 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573467.811452:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573467.811456:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573467.811460:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360888704:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573467.811486:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360888832:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573467.811507:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573467.811518:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573467/real 1788573467]  req@ffff8dc005dc0700 x1875453360888832/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573492 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573467.811530:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453360888832/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573492 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573467.811540:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573467.811544:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573467.811547:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360888832:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573467.811555:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360888960:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573467.811572:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573467.811582:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573467/real 1788573467]  req@ffff8dc005dc1180 x1875453360888960/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573492 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573467.811594:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360888960/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573492 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573467.811604:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573467.811607:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573467.811611:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360888960:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573467.811617:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360889088:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573467.811637:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573467.811647:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573467/real 1788573467]  req@ffff8dc005dc2d80 x1875453360889088/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573492 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573467.811659:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360889088/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573492 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573467.811668:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573467.811672:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573467.811675:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360889088:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573467.811681:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360889216:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573467.811698:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573467.811708:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573467/real 1788573467]  req@ffff8dc005dc1c00 x1875453360889216/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573492 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573467.811721:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453360889216/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573492 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573467.811729:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573467.811732:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573467.811736:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360889216:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573467.811742:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360889344:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573467.811760:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573467.811770:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573467/real 1788573467]  req@ffff8dc005dc3b80 x1875453360889344/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573492 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573467.811782:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360889344/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573492 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573467.811791:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573467.811794:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573467.811798:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360889344:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573468.194970:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573468.194970:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573468.194981:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573468.195008:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573468.195010:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573468.195017:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573468.835000:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573469.219013:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573469.219013:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573469.219013:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573469.219051:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573469.219058:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573469.219062:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573469.858967:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573470.242970:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573470.242970:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573470.242998:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573470.242998:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573470.243036:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573470.243046:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573470.882983:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573471.266954:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573471.266955:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573471.266998:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573471.267006:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573471.267006:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788573471.267046:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573471.906978:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573472.290974:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573472.290974:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573472.290985:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573472.291024:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573472.291027:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573472.291059:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1788573472.930965:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788573472.930966:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573472.930976:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788573472.930982:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573472.930993:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1818
00000100:00080000:1.0:1788573472.931005:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573472.931013:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573472.931052:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453360889472/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573472.931085:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573472.931094:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573472.931096:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573472.931101:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1818
00000100:00080000:1.0:1788573472.931105:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573472.931110:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573472.931120:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573472.931128:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360889472:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788573472.931138:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360889600/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573472.931150:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573472.931155:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573472.931157:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573472.931161:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1818
00000100:00080000:1.0:1788573472.931166:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573472.931170:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573472.931176:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788573472.931183:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573472.931189:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360889728/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573472.931206:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573472.931209:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573472.931211:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573472.931216:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1818
00000100:00100000:3.0:1788573472.931219:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573472/real 1788573472]  req@ffff8dc005dc0a80 x1875453360889472/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573497 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573472.931222:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573472.931232:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573472.931238:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573472.931240:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453360889472/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573497 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573472.931250:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1788573472.931255:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360889856/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573472.931255:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573472.931262:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360889472:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788573472.931276:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573472.931280:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573472.931282:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573472.931288:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1818
00000100:00080000:1.0:1788573472.931291:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573472.931296:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573472.931302:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573472.931304:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360889600:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573472.931317:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360889984/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573472.931331:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1788573472.931336:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788573472.931337:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573472.931354:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573472.931361:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1818
00000100:00080000:1.0:1788573472.931367:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788573472.931368:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573472/real 1788573472]  req@ffff8dc005dc3b80 x1875453360889600/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573497 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573472.931376:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573472.931385:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360889600/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573497 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1788573472.931386:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788573472.931399:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573472.931403:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573472.931407:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360890112/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573472.931408:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360889600:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573472.931419:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360889728:192.168.202.140@tcp:8:kworker.0
00000100:00080000:1.0:1788573472.931433:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573472.931438:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573472.931441:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1788573472.931445:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788573472.931449:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1818
00000100:00080000:1.0:1788573472.931455:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788573472.931457:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573472/real 1788573472]  req@ffff8dc005dc1c00 x1875453360889728/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573497 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573472.931463:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573472.931472:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573472.931478:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453360889728/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573497 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573472.931486:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1788573472.931490:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360890240/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573472.931491:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573472.931496:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360889728:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573472.931506:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360889856:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573472.931524:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573472.931532:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573472/real 1788573472]  req@ffff8dc005dc2d80 x1875453360889856/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573497 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573472.931541:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360889856/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573497 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573472.931547:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573472.931550:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573472.931552:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360889856:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573472.931563:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360889984:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573472.931574:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573472.931581:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573472/real 1788573472]  req@ffff8dc005dc1180 x1875453360889984/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573497 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573472.931588:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360889984/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573497 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573472.931598:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573472.931600:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573472.931602:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360889984:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573472.931606:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360890112:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573472.931616:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573472.931621:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573472/real 1788573472]  req@ffff8dc005dc0700 x1875453360890112/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573497 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573472.931628:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453360890112/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573497 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573472.931634:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573472.931635:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573472.931637:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360890112:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573472.931640:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360890240:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573472.931650:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573472.931655:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573472/real 1788573472]  req@ffff8dc005dc1500 x1875453360890240/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573497 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573472.931662:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360890240/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573497 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573472.931667:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573472.931669:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573472.931672:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360890240:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573473.314975:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573473.314976:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573473.314976:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573473.315010:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573473.315138:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788573473.315213:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573473.954995:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573474.339022:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573474.339022:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573474.339022:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573474.339023:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573474.339067:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573474.339133:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573474.978974:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573475.362979:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573475.363015:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573475.363016:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573475.363016:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573475.363049:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788573475.363127:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573476.002956:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573476.387029:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573476.387029:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573476.387034:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573476.387034:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573476.387090:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788573476.387150:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573477.026984:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573477.410960:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573477.410971:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573477.410978:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573477.410982:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573477.411012:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788573477.411064:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1788573478.051049:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573478.051065:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788573478.051072:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573478.051087:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1823
00000100:00100000:2.0:1788573478.051095:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788573478.051103:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573478.051116:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788573478.051173:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453360890368/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573478.051210:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573478.051216:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573478.051218:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573478.051225:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1823
00000100:00080000:0.0:1788573478.051231:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573478.051237:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573478.051253:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573478.051269:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360890368:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788573478.051278:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453360890496/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573478.051294:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573478.051300:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573478.051303:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573478.051308:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1823
00000100:00080000:0.0:1788573478.051314:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573478.051322:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573478.051329:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573478.051363:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453360890624/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788573478.051377:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788573478.051385:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573478.051391:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573478.051394:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573478.051401:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1823
00000100:00080000:0.0:1788573478.051407:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573478.051415:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573478.051421:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573478.051432:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573478/real 1788573478]  req@ffff8dc006713b80 x1875453360890368/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573503 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573478.051442:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453360890752/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573478.051469:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573478.051475:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573478.051479:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1788573478.051479:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453360890368/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573503 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573478.051492:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1823
00000100:00080000:0.0:1788573478.051499:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573478.051510:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:1.0:1788573478.051511:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1788573478.051521:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1788573478.051525:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573478.051535:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360890368:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788573478.051546:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453360890880/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573478.051558:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573478.051562:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573478.051565:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1788573478.051571:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360890496:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788573478.051577:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1823
00000100:00080000:0.0:1788573478.051584:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573478.051590:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573478.051596:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1788573478.051607:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573478.051616:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453360891008/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788573478.051631:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573478/real 1788573478]  req@ffff8dc006711500 x1875453360890496/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573503 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573478.051645:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573478.051648:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573478.051650:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573478.051662:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1823
00000100:00080000:0.0:1788573478.051671:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573478.051680:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573478.051687:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573478.051692:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453360890496/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573503 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573478.051703:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453360891136/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573478.051711:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573478.051721:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573478.051726:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360890496:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573478.051738:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360890624:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573478.051770:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573478.051788:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573478/real 1788573478]  req@ffff8dc006710380 x1875453360890624/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573503 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573478.051813:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453360890624/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573503 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573478.051824:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573478.051828:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573478.051831:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360890624:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573478.051839:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360890752:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573478.051862:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573478.051911:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573478/real 1788573478]  req@ffff8dc006711c00 x1875453360890752/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573503 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573478.051932:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453360890752/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573503 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573478.051948:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573478.051952:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573478.051956:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360890752:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573478.051963:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360890880:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788573478.051984:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573478.051994:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573478/real 1788573478]  req@ffff8dc006713480 x1875453360890880/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573503 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573478.052006:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453360890880/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573503 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573478.052023:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573478.052027:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573478.052031:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360890880:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573478.052051:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360891008:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573478.052073:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573478.052085:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573478/real 1788573478]  req@ffff8dc006713b80 x1875453360891008/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573503 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573478.052097:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453360891008/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573503 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573478.052106:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573478.052110:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573478.052114:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360891008:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573478.052121:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360891136:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573478.052144:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573478.052156:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573478/real 1788573478]  req@ffff8dc006712680 x1875453360891136/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573503 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573478.052171:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453360891136/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573503 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573478.052180:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573478.052184:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573478.052188:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360891136:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573478.434995:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573478.435022:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573478.435030:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788573478.435046:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573478.435048:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573478.435061:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573479.075044:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573479.458977:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573479.458977:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573479.458985:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573479.458996:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573479.459035:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788573479.459107:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573480.099106:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573480.482977:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573480.482998:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573480.482998:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573480.483051:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573480.483053:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788573480.483068:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573481.123004:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573481.506972:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573481.506972:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573481.506975:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573481.506976:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573481.507017:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788573481.507081:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573482.147025:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573482.531007:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573482.531018:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573482.531046:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573482.531190:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573482.531211:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573482.531267:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00080000:0.0:1788573483.170981:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788573483.170985:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788573483.170993:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788573483.170998:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573483.171007:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1828
00000100:00080000:0.0:1788573483.171016:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573483.171023:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788573483.171056:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453360891264/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573483.171079:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573483.171083:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573483.171084:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573483.171087:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1828
00000100:00080000:0.0:1788573483.171089:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573483.171092:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573483.171100:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573483.171109:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453360891392/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788573483.171117:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360891264:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788573483.171119:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573483.171127:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573483.171128:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573483.171131:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1828
00000100:00080000:0.0:1788573483.171133:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573483.171135:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573483.171139:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573483.171147:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453360891520/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573483.171153:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573483.171155:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573483.171156:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573483.171159:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1828
00000100:00080000:0.0:1788573483.171176:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573483.171179:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573483.171182:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1788573483.171189:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573483.171191:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453360891648/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573483.171198:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573483.171201:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573483.171202:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573483.171205:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1828
00000100:00080000:0.0:1788573483.171207:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573483.171209:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573483.171212:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573483.171219:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453360891776/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573483.171225:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573483.171228:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573483.171230:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573483.171233:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1828
00000100:00080000:0.0:1788573483.171235:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788573483.171237:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573483/real 1788573483]  req@ffff8dc006711880 x1875453360891264/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573508 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573483.171240:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573483.171246:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573483.171258:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453360891904/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788573483.171263:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453360891264/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573508 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573483.171286:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573483.171288:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573483.171289:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573483.171295:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1828
00000100:00080000:0.0:1788573483.171297:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573483.171301:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:1.0:1788573483.171302:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1788573483.171304:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1788573483.171308:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573483.171312:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360891264:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788573483.171315:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453360892032/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788573483.171357:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360891392:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788573483.171376:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573483.171386:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573483/real 1788573483]  req@ffff8dc006713800 x1875453360891392/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573508 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573483.171395:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453360891392/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573508 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573483.171407:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573483.171409:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573483.171411:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360891392:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573483.171416:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360891520:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573483.171427:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573483.171434:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573483/real 1788573483]  req@ffff8dc006713100 x1875453360891520/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573508 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573483.171441:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453360891520/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573508 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573483.171447:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573483.171449:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573483.171452:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360891520:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573483.171455:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360891648:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573483.171465:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573483.171470:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573483/real 1788573483]  req@ffff8dc006712300 x1875453360891648/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573508 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573483.171477:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453360891648/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573508 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573483.171482:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573483.171484:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573483.171487:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360891648:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573483.171490:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360891776:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788573483.171500:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573483.171506:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573483/real 1788573483]  req@ffff8dc006710e00 x1875453360891776/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573508 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573483.171513:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453360891776/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573508 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573483.171519:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573483.171520:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573483.171522:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360891776:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573483.171526:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360891904:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573483.171536:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573483.171541:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573483/real 1788573483]  req@ffff8dc006712a00 x1875453360891904/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573508 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573483.171549:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453360891904/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573508 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573483.171553:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573483.171555:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573483.171557:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360891904:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573483.171560:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360892032:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573483.171569:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573483.171575:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573483/real 1788573483]  req@ffff8dc006712680 x1875453360892032/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573508 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573483.171583:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453360892032/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573508 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573483.171588:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573483.171589:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573483.171591:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360892032:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573483.554961:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573483.554981:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573483.555002:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573483.555017:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573483.555037:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788573483.555087:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573484.195039:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573484.579018:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573484.579018:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573484.579018:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573484.579018:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573484.579057:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573484.579101:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573485.219003:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573485.602999:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573485.602999:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573485.603007:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573485.603011:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573485.603045:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788573485.603116:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573486.243013:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573486.626965:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573486.626966:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573486.627019:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573486.627022:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573486.627026:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788573486.627031:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573487.267007:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573487.650991:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573487.650991:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573487.651008:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573487.651042:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573487.651171:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788573487.651223:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1788573488.291018:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788573488.291027:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788573488.291029:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788573488.291043:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573488.291056:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1833
00000100:00080000:0.0:1788573488.291068:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573488.291075:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788573488.291113:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453360892160/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573488.291147:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573488.291150:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573488.291152:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573488.291155:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1833
00000100:00080000:0.0:1788573488.291158:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573488.291161:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573488.291170:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573488.291181:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453360892288/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573488.291189:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573488.291194:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:1.0:1788573488.291194:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360892160:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788573488.291198:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573488.291206:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1833
00000100:00080000:0.0:1788573488.291208:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573488.291210:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573488.291213:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573488.291224:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453360892416/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573488.291230:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573488.291233:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573488.291235:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573488.291238:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1833
00000100:00080000:0.0:1788573488.291249:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573488.291252:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573488.291255:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573488.291263:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453360892544/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573488.291269:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573488.291272:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573488.291273:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573488.291276:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1833
00000100:00080000:0.0:1788573488.291277:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573488.291280:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573488.291284:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573488.291295:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453360892672/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788573488.291300:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360892288:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788573488.291305:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573488.291309:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573488.291310:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573488.291331:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1833
00000100:00080000:0.0:1788573488.291337:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573488.291340:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573488.291345:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573488.291346:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360892416:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573488.291368:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453360892800/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788573488.291376:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360892544:192.168.202.140@tcp:8:kworker.0
00000100:00080000:0.0:1788573488.291390:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573488.291394:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573488.291397:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573488.291403:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1833
00000100:00100000:1.0:1788573488.291405:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360892672:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788573488.291415:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573488.291421:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573488.291424:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360892800:192.168.202.140@tcp:8:kworker.0
00000008:00100000:0.0:1788573488.291431:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573488.291451:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453360892928/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788573488.291491:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360892928:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573488.674999:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573488.674999:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573488.675030:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573488.675089:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573488.675105:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788573488.675195:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573489.315046:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573489.698951:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573489.698953:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573489.698978:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573489.699009:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573489.699027:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788573489.699106:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573490.339104:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573490.722977:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573490.722978:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573490.723019:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573490.723019:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573490.723079:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788573490.723112:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573491.363145:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000400:00000100:1.0:1788573491.363281:0:2336:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.140:988
00000400:00000100:1.0:1788573491.363356:0:2336:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.140@tcp at host 192.168.202.140 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:1.0:1788573491.363379:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788573491.363437:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788573491.363448:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788573491.363458:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788573491.363469:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788573491.363481:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788573491.363494:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:3.0:1788573491.363506:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573488/real 1788573491]  req@ffff8dc006711500 x1875453360892672/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573513 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573491.363544:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453360892672/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573513 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573491.363564:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573491.363572:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573491.363579:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360892672:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573491.363594:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573488/real 1788573491]  req@ffff8dc006712680 x1875453360892800/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573513 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573491.363610:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453360892800/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573513 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573491.363620:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573491.363624:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573491.363628:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360892800:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573491.363635:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573488/real 1788573491]  req@ffff8dc006713480 x1875453360892288/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573513 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573491.363647:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453360892288/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573513 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573491.363659:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573491.363663:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573491.363668:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360892288:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573491.363674:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573488/real 1788573491]  req@ffff8dc006711c00 x1875453360892416/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573513 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573491.363686:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453360892416/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573513 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573491.363695:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573491.363698:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573491.363703:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360892416:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573491.363710:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573488/real 1788573491]  req@ffff8dc006710380 x1875453360892544/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573513 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573491.363723:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453360892544/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573513 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573491.363732:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573491.363735:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573491.363739:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360892544:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573491.363747:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573488/real 1788573491]  req@ffff8dc006713b80 x1875453360892160/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573513 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573491.363760:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453360892160/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573513 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573491.363768:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573491.363772:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573491.363775:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360892160:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788573491.363819:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573488/real 1788573491]  req@ffff8dc006712a00 x1875453360892928/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573513 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573491.363943:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453360892928/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573513 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573491.363955:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573491.363959:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573491.363964:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360892928:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573491.746973:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573491.746973:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788573491.747007:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573491.747147:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573491.747152:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573491.747175:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573492.387106:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573492.770980:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573492.770981:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573492.771013:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573492.771019:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573492.771020:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788573492.771038:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573493.410994:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788573493.411056:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573493.411065:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788573493.411069:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573493.411079:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1839
00000100:00080000:2.0:1788573493.411091:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573493.411098:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573493.411145:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453360893056/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573493.411180:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573493.411184:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573493.411186:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573493.411189:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1839
00000100:00080000:2.0:1788573493.411193:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573493.411196:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573493.411208:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573493.411220:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453360893184/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573493.411232:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573493.411236:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573493.411239:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573493.411245:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1839
00000100:00080000:2.0:1788573493.411248:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573493.411253:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573493.411260:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573493.411269:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360893056:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788573493.411278:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453360893312/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573493.411291:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573493.411296:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573493.411298:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573493.411316:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1839
00000100:00080000:2.0:1788573493.411322:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573493.411327:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573493.411334:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573493.411351:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453360893440/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573493.411361:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573493.411365:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573493.411379:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573493.411385:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1839
00000800:00000100:3.0:1788573493.411400:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788573493.411404:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573493.411414:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573493.411421:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573493.411442:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453360893568/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573493.411455:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573493.411460:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573493.411462:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573493.411471:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1839
00000100:00080000:2.0:1788573493.411477:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573493.411485:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573493.411492:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573493.411499:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573493/real 1788573493]  req@ffff8dc020497100 x1875453360893056/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573518 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573493.411519:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453360893696/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573493.411539:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788573493.411546:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453360893056/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573518 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573493.411548:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573493.411554:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573493.411569:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1839
00000100:00080000:2.0:1788573493.411580:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573493.411593:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573493.411604:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788573493.411605:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1788573493.411623:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453360893824/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573493.411628:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573493.411655:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360893056:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788573493.411669:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360893184:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573493.411707:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573493.411725:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573493/real 1788573493]  req@ffff8dc020494e00 x1875453360893184/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573518 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573493.411738:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453360893184/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573518 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573493.411751:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573493.411755:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573493.411758:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360893184:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573493.411798:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360893312:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573493.411825:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573493.411837:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573493/real 1788573493]  req@ffff8dc020496a00 x1875453360893312/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573518 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573493.411848:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453360893312/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573518 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573493.412011:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573493.412017:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573493.412021:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360893312:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573493.412029:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360893440:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573493.412056:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573493.412069:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573493/real 1788573493]  req@ffff8dc020494700 x1875453360893440/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573518 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573493.412084:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453360893440/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573518 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573493.412093:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573493.412096:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573493.412099:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360893440:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573493.412106:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360893568:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573493.412128:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573493.412139:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573493/real 1788573493]  req@ffff8dc020495500 x1875453360893568/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573518 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573493.412159:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453360893568/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573518 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573493.412169:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573493.412172:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573493.412175:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360893568:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573493.412181:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360893696:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573493.412202:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573493.412214:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573493/real 1788573493]  req@ffff8dc020494000 x1875453360893696/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573518 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573493.412226:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453360893696/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573518 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573493.412234:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573493.412237:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573493.412240:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360893696:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573493.412247:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360893824:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573493.412265:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573493.412276:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573493/real 1788573493]  req@ffff8dc020494380 x1875453360893824/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573518 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573493.412287:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453360893824/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573518 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573493.412301:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573493.412318:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573493.412322:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360893824:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573493.795006:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573493.795006:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573493.795025:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573493.795026:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573493.795056:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788573493.795100:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573494.434987:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573494.818963:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573494.818987:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573494.818992:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573494.819010:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573494.819022:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573494.819023:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573495.458973:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573495.843032:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573495.843033:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573495.843036:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573495.843053:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573495.843093:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573495.843096:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573496.482986:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573496.866931:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573496.866979:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573496.866979:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573496.866987:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573496.866991:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573496.867062:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573497.506990:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573497.891010:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573497.891010:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573497.891010:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573497.891013:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573497.891045:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573497.891088:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573498.530963:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788573498.530979:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573498.530988:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788573498.530992:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573498.531004:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1844
00000100:00080000:2.0:1788573498.531017:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573498.531025:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573498.531072:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453360893952/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573498.531100:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573498.531103:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573498.531104:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573498.531107:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1844
00000100:00080000:2.0:1788573498.531110:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573498.531113:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573498.531125:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573498.531136:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453360894080/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573498.531144:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573498.531148:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573498.531154:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788573498.531155:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360893952:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788573498.531165:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1844
00000100:00080000:2.0:1788573498.531170:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573498.531175:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573498.531180:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573498.531190:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453360894208/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573498.531197:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573498.531200:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573498.531201:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573498.531205:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1844
00000100:00080000:2.0:1788573498.531224:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573498.531228:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573498.531232:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573498.531243:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453360894336/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788573498.531243:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788573498.531258:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573498.531262:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573498.531263:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573498.531268:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1844
00000100:00080000:2.0:1788573498.531272:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573498.531275:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573498.531278:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573498.531286:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453360894464/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573498.531293:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788573498.531307:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573498/real 1788573498]  req@ffff8dc020494a80 x1875453360893952/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573523 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573498.531308:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573498.531311:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573498.531325:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1844
00000100:00080000:2.0:1788573498.531335:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573498.531341:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573498.531346:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573498.531347:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453360893952/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573523 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573498.531363:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1788573498.531365:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453360894592/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573498.531374:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788573498.531375:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573498.531382:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:3.0:1788573498.531383:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360893952:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788573498.531387:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573498.531399:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1844
00000100:00080000:2.0:1788573498.531402:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573498.531405:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573498.531410:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573498.531420:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360894080:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788573498.531423:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453360894720/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788573498.531449:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573498.531461:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573498/real 1788573498]  req@ffff8dc020496d80 x1875453360894080/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573523 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573498.531471:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453360894080/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573523 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573498.531479:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573498.531482:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573498.531484:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360894080:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573498.531489:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360894208:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573498.531501:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573498.531508:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573498/real 1788573498]  req@ffff8dc020495180 x1875453360894208/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573523 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573498.531516:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453360894208/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573523 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573498.531521:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573498.531524:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573498.531526:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360894208:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573498.531530:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360894336:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573498.531540:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573498.531546:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573498/real 1788573498]  req@ffff8dc020497480 x1875453360894336/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573523 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573498.531553:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453360894336/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573523 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573498.531563:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573498.531565:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573498.531567:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360894336:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573498.531571:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360894464:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573498.531581:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573498.531587:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573498/real 1788573498]  req@ffff8dc020495880 x1875453360894464/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573523 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573498.531594:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453360894464/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573523 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573498.531600:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573498.531602:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573498.531604:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360894464:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573498.531607:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360894592:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573498.531618:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573498.531623:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573498/real 1788573498]  req@ffff8dc020494380 x1875453360894592/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573523 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573498.531630:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453360894592/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573523 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573498.531635:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573498.531637:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573498.531640:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360894592:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573498.531653:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360894720:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573498.531663:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573498.531669:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573498/real 1788573498]  req@ffff8dc020494000 x1875453360894720/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573523 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573498.531676:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453360894720/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573523 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573498.531681:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573498.531683:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573498.531685:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360894720:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573498.914974:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573498.914974:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573498.915026:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573498.915028:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573498.915062:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573498.915079:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573499.555009:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573499.938976:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573499.938976:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573499.938986:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573499.938995:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573499.939020:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573499.939056:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573500.579004:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573500.962947:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573500.962992:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573500.963026:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573500.963035:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573500.963060:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573500.963132:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573501.602987:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573501.986976:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573501.986976:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573501.986978:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573501.986995:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573501.987028:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573501.987045:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573502.626961:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573503.010969:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573503.010969:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573503.010969:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573503.010978:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573503.011004:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573503.011049:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1788573503.650978:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788573503.650980:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573503.650988:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788573503.650993:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573503.651001:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1849
00000100:00080000:1.0:1788573503.651009:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573503.651016:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573503.651047:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453360894848/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573503.651067:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573503.651070:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573503.651071:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573503.651073:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1849
00000100:00080000:1.0:1788573503.651076:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573503.651078:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573503.651086:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573503.651096:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360894976/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573503.651104:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573503.651106:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573503.651109:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788573503.651112:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360894848:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788573503.651113:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1849
00000100:00080000:1.0:1788573503.651119:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573503.651123:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573503.651126:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573503.651135:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360895104/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573503.651141:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573503.651143:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573503.651145:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573503.651147:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1849
00000100:00080000:1.0:1788573503.651151:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573503.651154:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573503.651156:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573503.651163:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360895232/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573503.651169:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1788573503.651174:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788573503.651175:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573503.651179:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573503.651182:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1849
00000100:00080000:1.0:1788573503.651185:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573503.651188:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573503.651191:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573503.651200:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360895360/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573503.651205:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573503.651208:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573503.651209:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573503.651212:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1849
00000100:00080000:1.0:1788573503.651214:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573503.651217:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573503.651220:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573503.651225:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573503/real 1788573503]  req@ffff8dc005dc3800 x1875453360894848/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573528 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573503.651229:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360895488/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573503.651259:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573503.651263:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573503.651264:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573503.651268:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1849
00000100:00080000:1.0:1788573503.651270:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788573503.651272:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453360894848/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573528 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573503.651275:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573503.651281:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573503.651308:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360895616/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573503.651311:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573503.651320:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573503.651325:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360894848:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788573503.651345:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360894976:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573503.651364:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573503.651374:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573503/real 1788573503]  req@ffff8dc005dc1500 x1875453360894976/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573528 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573503.651382:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360894976/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573528 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573503.651389:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573503.651391:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573503.651393:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360894976:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573503.651397:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360895104:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573503.651409:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573503.651423:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573503/real 1788573503]  req@ffff8dc005dc0700 x1875453360895104/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573528 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573503.651431:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453360895104/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573528 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573503.651442:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573503.651444:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573503.651446:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360895104:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573503.651450:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360895232:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573503.651461:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573503.651467:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573503/real 1788573503]  req@ffff8dc005dc1180 x1875453360895232/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573528 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573503.651480:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360895232/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573528 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573503.651486:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573503.651488:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573503.651490:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360895232:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573503.651493:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360895360:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573503.651504:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573503.651510:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573503/real 1788573503]  req@ffff8dc005dc2d80 x1875453360895360/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573528 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573503.651517:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360895360/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573528 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573503.651523:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573503.651524:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573503.651527:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360895360:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573503.651531:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360895488:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573503.651541:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573503.651546:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573503/real 1788573503]  req@ffff8dc005dc1c00 x1875453360895488/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573528 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573503.651553:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453360895488/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573528 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573503.651558:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573503.651560:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573503.651562:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360895488:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573503.651565:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360895616:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573503.651575:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573503.651580:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573503/real 1788573503]  req@ffff8dc005dc3b80 x1875453360895616/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573528 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573503.651587:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360895616/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573528 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573503.651598:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573503.651600:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573503.651602:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360895616:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573504.034985:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573504.034985:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573504.034985:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573504.034985:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573504.035019:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573504.035069:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573504.674940:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573505.058980:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573505.058980:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573505.058980:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573505.058980:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573505.059017:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573505.059057:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573505.698979:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573506.082954:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573506.082954:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573506.082960:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573506.082969:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573506.082989:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573506.083015:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573506.722951:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573507.107064:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573507.107064:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573507.107064:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573507.107065:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573507.107117:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573507.107175:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573507.746973:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573508.130958:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573508.130958:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573508.131018:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573508.131041:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573508.131053:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573508.131064:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573508.770932:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573508.770940:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573508.770946:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788573508.770950:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573508.770961:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1854
00000100:00080000:1.0:1788573508.770971:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573508.770980:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573508.771027:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453360895744/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573508.771056:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573508.771059:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573508.771061:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573508.771064:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1854
00000100:00080000:1.0:1788573508.771068:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573508.771071:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573508.771079:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573508.771090:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360895872/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573508.771097:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573508.771099:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573508.771101:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573508.771103:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1854
00000100:00080000:1.0:1788573508.771106:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573508.771108:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573508.771112:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573508.771119:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360896000/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573508.771127:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573508.771130:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573508.771132:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788573508.771134:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360895744:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788573508.771136:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1854
00000100:00080000:1.0:1788573508.771141:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573508.771145:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573508.771147:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573508.771155:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360896128/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573508.771161:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573508.771163:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573508.771165:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573508.771167:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1854
00000100:00080000:1.0:1788573508.771169:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573508.771172:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573508.771175:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573508.771181:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360896256/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573508.771187:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573508.771189:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573508.771191:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573508.771194:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1854
00000800:00000100:3.0:1788573508.771199:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788573508.771200:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573508.771205:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573508.771209:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573508.771218:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360896384/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573508.771225:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573508.771227:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573508.771228:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573508.771231:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1854
00000100:00080000:1.0:1788573508.771234:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573508.771236:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573508.771240:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573508/real 1788573508]  req@ffff8dc005dc0a80 x1875453360895744/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573533 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1788573508.771241:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573508.771253:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360896512/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573508.771260:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453360895744/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573533 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573508.771270:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573508.771273:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573508.771293:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360895744:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788573508.771299:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360895872:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573508.771315:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573508.771324:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573508/real 1788573508]  req@ffff8dc005dc3b80 x1875453360895872/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573533 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573508.771332:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360895872/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573533 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573508.771339:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573508.771341:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573508.771351:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360895872:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573508.771370:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360896000:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573508.771383:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573508.771390:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573508/real 1788573508]  req@ffff8dc005dc1c00 x1875453360896000/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573533 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573508.771397:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453360896000/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573533 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573508.771403:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573508.771405:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573508.771407:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360896000:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573508.771410:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360896128:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573508.771419:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573508.771425:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573508/real 1788573508]  req@ffff8dc005dc2d80 x1875453360896128/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573533 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573508.771432:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360896128/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573533 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573508.771438:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573508.771439:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573508.771441:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360896128:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573508.771445:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360896256:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573508.771454:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573508.771466:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573508/real 1788573508]  req@ffff8dc005dc1180 x1875453360896256/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573533 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573508.771475:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360896256/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573533 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573508.771481:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573508.771483:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573508.771485:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360896256:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573508.771488:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360896384:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573508.771499:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573508.771505:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573508/real 1788573508]  req@ffff8dc005dc0700 x1875453360896384/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573533 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573508.771512:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453360896384/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573533 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573508.771517:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573508.771519:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573508.771521:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360896384:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573508.771524:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360896512:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573508.771533:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573508.771539:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573508/real 1788573508]  req@ffff8dc005dc1500 x1875453360896512/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573533 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573508.771545:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360896512/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573533 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573508.771551:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573508.771553:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573508.771555:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360896512:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573509.155002:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573509.155002:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573509.155012:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573509.155013:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573509.155073:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788573509.155114:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573509.794984:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573510.178957:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573510.178964:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573510.178981:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573510.178983:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573510.179005:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573510.179038:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573510.818945:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573511.202981:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573511.202981:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573511.202981:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573511.202983:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573511.203013:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788573511.203067:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573511.842980:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573512.226950:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573512.226952:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573512.226952:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573512.226984:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573512.226995:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573512.227035:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573512.866933:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573513.250961:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573513.250961:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573513.250962:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573513.250976:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573513.250991:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788573513.251050:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1788573513.891019:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573513.891028:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:2.0:1788573513.891029:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788573513.891032:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573513.891042:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1859
00000100:00080000:0.0:1788573513.891051:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573513.891058:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788573513.891091:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453360896640/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573513.891111:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573513.891114:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573513.891115:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573513.891118:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1859
00000100:00080000:0.0:1788573513.891120:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573513.891123:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573513.891131:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573513.891140:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453360896768/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573513.891148:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573513.891151:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573513.891152:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573513.891157:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1859
00000100:00100000:3.0:1788573513.891159:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360896640:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788573513.891160:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573513.891166:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573513.891171:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573513.891179:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453360896896/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573513.891187:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573513.891190:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573513.891191:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573513.891193:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1859
00000100:00080000:0.0:1788573513.891196:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573513.891198:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573513.891201:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573513.891209:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453360897024/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573513.891219:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573513.891223:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573513.891225:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573513.891229:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1859
00000100:00080000:0.0:1788573513.891233:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1788573513.891238:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788573513.891242:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573513.891248:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573513.891276:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453360897152/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573513.891284:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573513.891287:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573513.891288:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573513.891292:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1859
00000100:00080000:0.0:1788573513.891297:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788573513.891298:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573513/real 1788573513]  req@ffff8dc006710e00 x1875453360896640/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573538 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573513.891304:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573513.891312:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573513.891323:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453360896640/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573538 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573513.891325:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453360897280/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573513.891353:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573513.891354:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573513.891356:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573513.891359:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573513.891365:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1859
00000100:00080000:3.0:1788573513.891365:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788573513.891370:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573513.891376:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573513.891377:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360896640:192.168.202.140@tcp:250:kworker.0
00000008:00100000:0.0:1788573513.891379:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573513.891390:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453360897408/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573513.891396:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360896768:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573513.891427:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573513.891438:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573513/real 1788573513]  req@ffff8dc006712300 x1875453360896768/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573538 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573513.891454:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453360896768/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573538 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573513.891462:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573513.891465:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573513.891469:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360896768:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573513.891490:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360896896:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573513.891509:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573513.891516:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573513/real 1788573513]  req@ffff8dc006713100 x1875453360896896/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573538 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573513.891527:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453360896896/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573538 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573513.891533:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573513.891535:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573513.891537:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360896896:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573513.891541:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360897024:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573513.891556:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573513.891565:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573513/real 1788573513]  req@ffff8dc006713800 x1875453360897024/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573538 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573513.891573:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453360897024/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573538 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573513.891584:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573513.891587:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573513.891590:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360897024:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573513.891594:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360897152:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573513.891608:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573513.891616:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573513/real 1788573513]  req@ffff8dc006711880 x1875453360897152/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573538 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573513.891625:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453360897152/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573538 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573513.891632:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573513.891635:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573513.891637:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360897152:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573513.891642:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360897280:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573513.891716:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573513.891726:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573513/real 1788573513]  req@ffff8dc006712a00 x1875453360897280/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573538 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573513.891737:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453360897280/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573538 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573513.891743:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573513.891745:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573513.891748:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360897280:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573513.891755:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360897408:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573513.891767:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573513.891773:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573513/real 1788573513]  req@ffff8dc006713b80 x1875453360897408/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573538 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573513.891781:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453360897408/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573538 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573513.891786:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573513.891787:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573513.891789:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360897408:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573514.274966:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573514.274966:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573514.274967:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573514.274973:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573514.275001:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573514.275031:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573514.914921:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573515.299043:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573515.299051:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573515.299051:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573515.299055:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573515.299105:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788573515.299167:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573515.938972:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573516.322968:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573516.322972:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573516.323003:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573516.323015:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573516.323031:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573516.323075:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573516.962992:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573517.347012:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573517.347017:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573517.347018:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573517.347057:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573517.347070:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788573517.347087:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573517.986964:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573518.370937:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573518.370938:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573518.370957:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573518.370972:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573518.370983:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573518.371020:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573519.010972:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573519.010993:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573519.011003:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788573519.011008:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573519.011020:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1864
00000100:00080000:1.0:1788573519.011031:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573519.011054:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573519.011100:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453360897536/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573519.011123:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573519.011126:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573519.011128:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573519.011131:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1864
00000100:00080000:1.0:1788573519.011135:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573519.011138:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573519.011146:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573519.011159:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360897664/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573519.011173:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788573519.011176:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360897536:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788573519.011177:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573519.011181:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573519.011188:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1864
00000100:00080000:1.0:1788573519.011192:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573519.011196:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573519.011202:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573519.011216:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360897792/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573519.011227:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573519.011232:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573519.011234:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573519.011239:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1864
00000100:00080000:1.0:1788573519.011245:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1788573519.011245:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788573519.011279:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573519.011285:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573519.011310:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360897920/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573519.011310:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573519/real 1788573519]  req@ffff8dc005dc3800 x1875453360897536/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573544 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573519.011337:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573519.011341:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573519.011342:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573519.011348:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1864
00000100:00100000:3.0:1788573519.011349:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453360897536/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573544 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573519.011356:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573519.011364:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573519.011371:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788573519.011383:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1788573519.011386:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360898048/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573519.011391:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573519.011401:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360897536:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788573519.011405:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573519.011409:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573519.011411:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573519.011416:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1864
00000100:00080000:1.0:1788573519.011419:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573519.011421:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573519.011424:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573519.011430:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360897664:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573519.011436:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360898176/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573519.011445:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573519.011448:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573519.011450:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573519.011454:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1864
00000100:00080000:1.0:1788573519.011458:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1788573519.011462:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788573519.011466:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573519.011471:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573519.011481:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573519/real 1788573519]  req@ffff8dc005dc1500 x1875453360897664/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573544 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573519.011482:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360898304/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573519.011543:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360897664/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573544 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573519.011556:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573519.011559:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573519.011563:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360897664:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573519.011579:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360897792:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573519.011605:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573519.011614:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573519/real 1788573519]  req@ffff8dc005dc0700 x1875453360897792/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573544 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573519.011624:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453360897792/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573544 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573519.011631:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573519.011634:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573519.011636:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360897792:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573519.011641:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360897920:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573519.011665:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573519.011672:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573519/real 1788573519]  req@ffff8dc005dc1180 x1875453360897920/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573544 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573519.011681:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360897920/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573544 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573519.011688:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573519.011690:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573519.011692:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360897920:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573519.011696:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360898048:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573519.011708:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573519.011715:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573519/real 1788573519]  req@ffff8dc005dc2d80 x1875453360898048/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573544 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573519.011724:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360898048/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573544 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573519.011731:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573519.011733:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573519.011735:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360898048:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573519.011759:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360898176:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573519.011772:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573519.011779:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573519/real 1788573519]  req@ffff8dc005dc1c00 x1875453360898176/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573544 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573519.011788:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453360898176/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573544 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573519.011794:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573519.011796:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573519.011798:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360898176:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573519.011803:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360898304:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573519.011814:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573519.011832:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573519/real 1788573519]  req@ffff8dc005dc3b80 x1875453360898304/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573544 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573519.011840:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360898304/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573544 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573519.011847:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573519.011849:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573519.011851:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360898304:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573519.395012:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573519.395012:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573519.395013:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573519.395019:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573519.395066:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788573519.395102:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573520.034943:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573520.418959:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573520.418989:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573520.418999:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573520.419018:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573520.419037:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573520.419108:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573521.059023:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573521.443001:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573521.443007:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573521.443050:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573521.443055:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573521.443064:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573521.443074:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573522.082959:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573522.466925:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573522.466940:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573522.466962:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573522.466966:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573522.466973:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573522.467009:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573523.107019:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573523.490974:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573523.490974:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573523.490975:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573523.490999:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573523.491005:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573523.491009:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00080000:1.0:1788573524.131001:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788573524.131002:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573524.131016:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788573524.131021:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573524.131033:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1869
00000100:00080000:1.0:1788573524.131046:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573524.131054:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573524.131107:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453360898432/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573524.131135:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573524.131138:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573524.131140:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573524.131143:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1869
00000100:00080000:1.0:1788573524.131145:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573524.131148:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573524.131159:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573524.131170:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360898560/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573524.131182:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573524.131185:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573524.131186:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573524.131189:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1869
00000100:00080000:1.0:1788573524.131191:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573524.131194:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573524.131197:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573524.131207:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360898688/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573524.131213:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360898432:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788573524.131225:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573524.131230:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573524.131232:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573524.131237:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1869
00000100:00080000:1.0:1788573524.131241:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573524.131246:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573524.131264:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573524.131280:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360898816/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573524.131289:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573524.131292:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573524.131293:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573524.131296:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1869
00000100:00080000:1.0:1788573524.131302:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573524.131306:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573524.131310:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788573524.131316:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573524.131320:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360898944/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573524.131327:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573524.131330:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573524.131332:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573524.131335:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1869
00000100:00080000:1.0:1788573524.131339:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573524.131341:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573524.131344:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573524.131351:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360899072/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573524.131358:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573524.131361:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573524.131362:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573524.131365:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1869
00000100:00080000:1.0:1788573524.131368:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788573524.131369:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573524/real 1788573524]  req@ffff8dc005dc0a80 x1875453360898432/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573549 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573524.131373:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573524.131383:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573524.131394:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453360898432/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573549 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573524.131399:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360899200/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573524.131409:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573524.131416:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573524.131424:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360898432:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788573524.131432:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360898560:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573524.131453:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573524.131461:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573524/real 1788573524]  req@ffff8dc005dc3b80 x1875453360898560/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573549 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573524.131470:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360898560/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573549 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573524.131477:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573524.131479:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573524.131481:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360898560:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573524.131503:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360898688:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573524.131516:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573524.131523:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573524/real 1788573524]  req@ffff8dc005dc1c00 x1875453360898688/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573549 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573524.131531:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453360898688/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573549 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573524.131541:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573524.131543:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573524.131546:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360898688:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573524.131549:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360898816:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573524.131559:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573524.131564:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573524/real 1788573524]  req@ffff8dc005dc2d80 x1875453360898816/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573549 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573524.131571:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360898816/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573549 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573524.131578:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573524.131580:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573524.131582:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360898816:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573524.131585:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360898944:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573524.131596:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573524.131602:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573524/real 1788573524]  req@ffff8dc005dc1180 x1875453360898944/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573549 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573524.131608:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360898944/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573549 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573524.131614:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573524.131616:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573524.131618:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360898944:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573524.131622:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360899072:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573524.131633:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573524.131639:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573524/real 1788573524]  req@ffff8dc005dc0700 x1875453360899072/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573549 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573524.131646:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453360899072/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573549 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573524.131651:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573524.131653:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573524.131655:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360899072:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573524.131658:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360899200:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573524.131668:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573524.131673:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573524/real 1788573524]  req@ffff8dc005dc1500 x1875453360899200/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573549 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573524.131680:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360899200/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573549 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573524.131685:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573524.131686:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573524.131688:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360899200:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573524.514997:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573524.515002:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573524.515019:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573524.515042:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573524.515047:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573524.515064:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573525.155035:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573525.538963:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573525.538964:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573525.538973:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573525.538995:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573525.539001:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573525.539015:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573526.178953:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573526.562977:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573526.562978:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788573526.563027:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573526.563031:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573526.563033:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573526.563049:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573527.203004:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573527.586987:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573527.586988:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573527.586988:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573527.586993:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573527.587019:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573527.587054:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573528.226980:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573528.610976:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573528.610976:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573528.610976:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573528.610976:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573528.611011:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788573528.611063:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573529.250923:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573529.250956:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573529.250961:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788573529.250964:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573529.250972:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1874
00000100:00080000:1.0:1788573529.250981:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573529.250987:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573529.251020:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453360899328/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573529.251052:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573529.251056:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573529.251058:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573529.251063:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1874
00000100:00080000:1.0:1788573529.251067:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573529.251072:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573529.251080:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573529.251093:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360899456/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573529.251102:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360899328:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788573529.251103:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573529.251111:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573529.251115:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573529.251119:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1874
00000100:00080000:1.0:1788573529.251121:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573529.251124:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573529.251127:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573529.251136:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360899584/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573529.251143:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573529.251145:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573529.251147:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573529.251149:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1874
00000100:00080000:1.0:1788573529.251151:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573529.251153:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573529.251156:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573529.251163:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360899712/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573529.251168:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573529.251171:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573529.251172:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573529.251174:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1874
00000100:00080000:1.0:1788573529.251177:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1788573529.251180:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788573529.251185:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573529.251191:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573529.251206:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360899840/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573529.251217:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788573529.251219:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573529/real 1788573529]  req@ffff8dc005dc3800 x1875453360899328/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573554 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573529.251223:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573529.251228:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573529.251237:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1874
00000100:00080000:1.0:1788573529.251241:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788573529.251242:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453360899328/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573554 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573529.251247:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:3.0:1788573529.251256:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573529.251274:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000008:00100000:1.0:1788573529.251276:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573529.251281:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360899328:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788573529.251289:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360899968/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573529.251301:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573529.251304:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573529.251305:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573529.251308:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1874
00000100:00080000:1.0:1788573529.251311:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573529.251314:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573529.251317:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573529.251323:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360899456:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573529.251326:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360900096/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788573529.251351:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573529.251364:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573529/real 1788573529]  req@ffff8dc005dc1500 x1875453360899456/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573554 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573529.251372:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360899456/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573554 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573529.251380:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573529.251382:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573529.251385:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360899456:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573529.251389:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360899584:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573529.251402:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573529.251408:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573529/real 1788573529]  req@ffff8dc005dc0700 x1875453360899584/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573554 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573529.251416:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453360899584/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573554 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573529.251422:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573529.251424:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573529.251426:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360899584:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573529.251430:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360899712:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573529.251439:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573529.251445:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573529/real 1788573529]  req@ffff8dc005dc1180 x1875453360899712/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573554 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573529.251452:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360899712/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573554 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573529.251458:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573529.251460:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573529.251462:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360899712:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573529.251466:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360899840:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573529.251476:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573529.251482:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573529/real 1788573529]  req@ffff8dc005dc2d80 x1875453360899840/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573554 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573529.251494:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360899840/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573554 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573529.251500:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573529.251502:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573529.251504:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360899840:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573529.251507:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360899968:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573529.251517:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573529.251523:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573529/real 1788573529]  req@ffff8dc005dc1c00 x1875453360899968/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573554 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573529.251531:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453360899968/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573554 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573529.251536:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573529.251537:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573529.251539:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360899968:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573529.251551:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360900096:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573529.251561:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573529.251568:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573529/real 1788573529]  req@ffff8dc005dc3b80 x1875453360900096/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573554 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573529.251575:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360900096/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573554 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573529.251584:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573529.251586:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573529.251588:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360900096:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573529.634962:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573529.634963:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573529.634963:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573529.634977:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573529.635003:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573529.635032:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573530.274915:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573530.658984:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573530.658984:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573530.659025:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573530.659030:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573530.659033:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573530.659049:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573531.298976:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573531.682968:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573531.682997:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573531.683000:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573531.683008:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573531.683028:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573531.683044:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573532.322957:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573532.706950:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573532.706952:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573532.706970:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573532.706985:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573532.706992:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573532.706998:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573533.346987:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573533.730943:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573533.730959:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573533.730966:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573533.730987:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573533.731014:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573533.731019:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573534.370940:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788573534.370983:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573534.370988:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788573534.370992:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573534.371002:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1880
00000100:00080000:2.0:1788573534.371013:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573534.371021:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573534.371060:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453360900224/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573534.371084:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573534.371087:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573534.371089:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573534.371092:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1880
00000100:00080000:2.0:1788573534.371095:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573534.371098:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573534.371106:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573534.371121:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453360900352/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573534.371134:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573534.371140:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:3.0:1788573534.371141:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360900224:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788573534.371156:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573534.371163:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1880
00000100:00080000:2.0:1788573534.371167:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573534.371170:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573534.371176:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573534.371187:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453360900480/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573534.371194:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573534.371197:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573534.371198:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573534.371201:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1880
00000100:00080000:2.0:1788573534.371204:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573534.371206:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573534.371219:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788573534.371225:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573534.371229:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453360900608/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573534.371236:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573534.371239:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573534.371240:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573534.371244:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1880
00000100:00080000:2.0:1788573534.371247:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573534.371250:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573534.371252:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573534.371261:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453360900736/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573534.371284:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573534.371287:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573534.371288:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573534.371292:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1880
00000100:00080000:2.0:1788573534.371295:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573534.371300:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573534.371301:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573534/real 1788573534]  req@ffff8dc020495500 x1875453360900224/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573559 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1788573534.371304:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573534.371316:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453360900864/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573534.371346:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573534.371349:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573534.371350:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573534.371353:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1880
00000100:00080000:2.0:1788573534.371356:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788573534.371360:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453360900224/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573559 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573534.371361:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573534.371366:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573534.371376:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453360900992/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573534.371383:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573534.371391:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573534.371398:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360900224:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788573534.371419:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360900352:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573534.371439:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573534.371449:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573534/real 1788573534]  req@ffff8dc020494700 x1875453360900352/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573559 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573534.371462:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453360900352/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573559 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573534.371469:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573534.371471:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573534.371474:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360900352:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573534.371478:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360900480:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573534.371489:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573534.371495:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573534/real 1788573534]  req@ffff8dc020496a00 x1875453360900480/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573559 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573534.371503:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453360900480/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573559 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573534.371509:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573534.371511:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573534.371512:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360900480:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573534.371516:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360900608:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573534.371526:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573534.371531:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573534/real 1788573534]  req@ffff8dc020494e00 x1875453360900608/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573559 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573534.371548:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453360900608/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573559 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573534.371558:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573534.371560:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573534.371562:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360900608:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573534.371566:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360900736:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573534.371577:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573534.371584:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573534/real 1788573534]  req@ffff8dc020497100 x1875453360900736/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573559 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573534.371591:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453360900736/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573559 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573534.371597:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573534.371599:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573534.371601:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360900736:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573534.371605:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360900864:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573534.371614:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573534.371620:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573534/real 1788573534]  req@ffff8dc020494000 x1875453360900864/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573559 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573534.371627:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453360900864/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573559 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573534.371632:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573534.371633:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573534.371636:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360900864:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573534.371639:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360900992:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573534.371649:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573534.371654:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573534/real 1788573534]  req@ffff8dc020494380 x1875453360900992/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573559 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573534.371661:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453360900992/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573559 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573534.371665:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573534.371667:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573534.371669:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360900992:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573534.754953:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573534.754953:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573534.754954:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573534.754997:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788573534.755009:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573534.755011:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573535.394975:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573535.778977:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573535.778985:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573535.778986:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573535.778989:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573535.779016:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573535.779031:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573536.418970:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573536.802974:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573536.802974:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573536.802984:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573536.803006:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573536.803020:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573536.803023:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573537.443005:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573537.826962:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573537.826965:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573537.826966:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573537.826993:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573537.826997:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573537.827016:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573538.466994:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573538.851004:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573538.851005:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573538.851015:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573538.851016:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573538.851057:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573538.851114:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573539.490972:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788573539.491031:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573539.491041:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788573539.491047:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573539.491060:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1885
00000100:00080000:3.0:1788573539.491074:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573539.491083:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573539.491146:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d880 x1875453360901120/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573539.491187:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573539.491192:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573539.491194:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573539.491199:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1885
00000100:00080000:3.0:1788573539.491204:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573539.491209:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573539.491223:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573539.491240:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360901120:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788573539.491241:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f100 x1875453360901248/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573539.491259:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573539.491263:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788573539.491266:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573539.491270:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1885
00000100:00080000:3.0:1788573539.491291:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573539.491297:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573539.491303:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573539.491329:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644df80 x1875453360901376/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573539.491341:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1788573539.491345:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788573539.491349:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788573539.491353:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573539.491359:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1885
00000100:00080000:3.0:1788573539.491365:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573539.491370:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573539.491377:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573539.491393:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ed80 x1875453360901504/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788573539.491401:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573539/real 1788573539]  req@ffff8dc00644d880 x1875453360901120/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573564 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573539.491411:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573539.491417:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573539.491420:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1788573539.491425:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d880 x1875453360901120/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573564 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573539.491435:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573539.491438:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1885
00000100:00080000:1.0:1788573539.491441:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573539.491447:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360901120:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788573539.491448:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573539.491458:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573539.491465:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573539.491475:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360901248:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573539.491484:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d880 x1875453360901632/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788573539.491498:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788573539.491499:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573539.491505:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788573539.491507:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1788573539.491510:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573539/real 1788573539]  req@ffff8dc00644f100 x1875453360901248/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573564 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573539.491517:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1885
00000100:00080000:3.0:1788573539.491526:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788573539.491532:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f100 x1875453360901248/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573564 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573539.491536:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:1.0:1788573539.491549:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:3.0:1788573539.491549:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1788573539.491556:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573539.491559:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360901248:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573539.491564:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360901376:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573539.491570:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644fb80 x1875453360901760/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573539.491584:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1788573539.491589:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788573539.491591:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788573539.491596:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1788573539.491600:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573539/real 1788573539]  req@ffff8dc00644df80 x1875453360901376/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573564 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573539.491603:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1885
00000100:00080000:3.0:1788573539.491613:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788573539.491622:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644df80 x1875453360901376/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573564 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573539.491622:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573539.491633:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1788573539.491639:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573539.491646:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573539.491652:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e300 x1875453360901888/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788573539.491653:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360901376:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573539.491667:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360901504:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573539.491698:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573539.491713:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573539/real 1788573539]  req@ffff8dc00644ed80 x1875453360901504/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573564 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573539.491724:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ed80 x1875453360901504/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573564 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573539.491740:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573539.491744:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573539.491748:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360901504:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573539.491764:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360901632:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788573539.491786:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573539.491796:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573539/real 1788573539]  req@ffff8dc00644d880 x1875453360901632/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573564 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573539.491807:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d880 x1875453360901632/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573564 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573539.491816:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573539.491819:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573539.491822:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360901632:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573539.491828:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360901760:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573539.491849:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573539.491860:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573539/real 1788573539]  req@ffff8dc00644fb80 x1875453360901760/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573564 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573539.491907:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644fb80 x1875453360901760/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573564 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573539.491916:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573539.491920:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573539.491924:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360901760:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573539.491931:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360901888:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573539.491963:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573539.491972:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573539/real 1788573539]  req@ffff8dc00644e300 x1875453360901888/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573564 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573539.491981:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453360901888/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573564 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573539.491987:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573539.491989:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573539.491991:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360901888:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573539.874931:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573539.874935:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573539.874936:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573539.874958:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573539.875060:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573539.875090:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573540.514929:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573540.898979:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573540.898979:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573540.898985:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788573540.899019:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573540.899023:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573540.899041:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573541.538970:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573541.922967:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573541.922967:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573541.922968:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573541.922973:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573541.923003:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573541.923049:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573542.563029:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573542.947009:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573542.947009:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573542.947016:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573542.947035:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573542.947059:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788573542.947113:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573543.586990:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573543.971019:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573543.971033:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573543.971040:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573543.971045:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573543.971078:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573543.971157:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573544.610982:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788573544.610982:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573544.610992:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788573544.610996:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573544.611004:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1890
00000100:00080000:2.0:1788573544.611014:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573544.611021:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573544.611062:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453360902016/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573544.611084:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573544.611087:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573544.611089:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573544.611091:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1890
00000100:00080000:2.0:1788573544.611094:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573544.611097:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573544.611104:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573544.611113:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453360902144/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573544.611120:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573544.611123:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573544.611124:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573544.611127:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1890
00000100:00080000:2.0:1788573544.611128:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788573544.611132:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360902016:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788573544.611134:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573544.611141:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573544.611149:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453360902272/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573544.611156:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573544.611158:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573544.611159:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573544.611162:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1890
00000100:00080000:2.0:1788573544.611164:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573544.611167:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573544.611170:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573544.611177:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453360902400/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573544.611184:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573544.611189:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000800:00000100:1.0:1788573544.611192:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788573544.611193:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573544.611200:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1890
00000100:00080000:2.0:1788573544.611206:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573544.611211:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573544.611217:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573544.611230:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573544/real 1788573544]  req@ffff8dc020495880 x1875453360902016/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573569 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573544.611241:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453360902528/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788573544.611248:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453360902016/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573569 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573544.611252:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573544.611259:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573544.611262:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573544.611269:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1890
00000100:00080000:2.0:1788573544.611275:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573544.611296:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573544.611296:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573544.611302:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1788573544.611305:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573544.611313:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360902016:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788573544.611315:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453360902656/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788573544.611328:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360902144:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788573544.611333:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573544.611337:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573544.611338:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573544.611341:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1890
00000100:00080000:2.0:1788573544.611344:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573544.611347:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573544.611352:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1788573544.611358:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573544.611362:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453360902784/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788573544.611374:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573544/real 1788573544]  req@ffff8dc020497480 x1875453360902144/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573569 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573544.611385:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453360902144/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573569 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573544.611393:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573544.611395:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573544.611397:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360902144:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573544.611415:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360902272:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573544.611429:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573544.611436:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573544/real 1788573544]  req@ffff8dc020495180 x1875453360902272/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573569 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573544.611444:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453360902272/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573569 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573544.611449:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573544.611452:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573544.611454:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360902272:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573544.611458:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360902400:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573544.611468:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573544.611474:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573544/real 1788573544]  req@ffff8dc020496d80 x1875453360902400/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573569 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573544.611481:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453360902400/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573569 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573544.611486:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573544.611488:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573544.611490:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360902400:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573544.611493:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360902528:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788573544.611504:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573544.611509:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573544/real 1788573544]  req@ffff8dc020494a80 x1875453360902528/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573569 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573544.611516:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453360902528/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573569 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573544.611522:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573544.611523:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573544.611525:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360902528:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573544.611529:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360902656:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573544.611539:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573544.611545:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573544/real 1788573544]  req@ffff8dc020494380 x1875453360902656/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573569 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573544.611553:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453360902656/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573569 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573544.611558:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573544.611559:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573544.611561:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360902656:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573544.611565:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360902784:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573544.611575:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573544.611580:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573544/real 1788573544]  req@ffff8dc020494000 x1875453360902784/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573569 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573544.611587:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453360902784/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573569 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573544.611593:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573544.611594:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573544.611596:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360902784:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573544.994973:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573544.994973:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573544.994974:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573544.994975:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573544.995010:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788573544.995089:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573545.634946:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573546.019032:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573546.019033:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573546.019033:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573546.019040:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573546.019076:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573546.019129:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573546.658991:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573547.042976:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573547.042976:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573547.042976:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573547.043011:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573547.043143:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788573547.043220:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573547.682940:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573548.067006:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573548.067017:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573548.067043:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573548.067115:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573548.067133:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573548.067175:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573548.706988:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573549.090955:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573549.090955:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573549.090958:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573549.090988:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573549.091007:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788573549.091028:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573549.730970:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788573549.730970:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573549.730979:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788573549.730983:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573549.730992:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1895
00000100:00080000:2.0:1788573549.731001:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573549.731007:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573549.731036:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453360902912/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573549.731063:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573549.731067:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573549.731068:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573549.731072:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1895
00000100:00080000:2.0:1788573549.731075:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573549.731077:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573549.731085:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573549.731096:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453360903040/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573549.731107:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573549.731111:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:1.0:1788573549.731114:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360902912:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788573549.731114:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573549.731121:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1895
00000100:00080000:2.0:1788573549.731132:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573549.731135:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573549.731139:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573549.731149:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453360903168/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573549.731157:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573549.731160:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573549.731161:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573549.731163:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1895
00000100:00080000:2.0:1788573549.731165:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573549.731167:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573549.731171:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573549.731182:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453360903296/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573549.731190:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573549.731193:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573549.731194:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573549.731200:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1895
00000800:00000100:1.0:1788573549.731204:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788573549.731205:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573549.731211:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573549.731214:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573549.731222:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453360903424/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573549.731229:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573549.731232:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573549.731235:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573549.731240:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1895
00000100:00080000:2.0:1788573549.731244:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573549.731250:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573549.731255:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573549/real 1788573549]  req@ffff8dc020497100 x1875453360902912/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573574 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1788573549.731259:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573549.731281:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453360903552/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788573549.731304:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453360902912/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573574 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573549.731321:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573549.731326:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573549.731328:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573549.731335:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360902912:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788573549.731346:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573549.731349:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573549.731355:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1895
00000100:00080000:2.0:1788573549.731360:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573549.731366:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573549.731374:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360903040:192.168.202.140@tcp:38:kworker.0
00000008:00100000:2.0:1788573549.731375:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573549.731398:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453360903680/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788573549.731414:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573549.731441:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573549/real 1788573549]  req@ffff8dc020494e00 x1875453360903040/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573574 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573549.731455:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453360903040/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573574 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573549.731469:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573549.731473:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573549.731485:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360903040:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573549.731495:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360903168:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573549.731522:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573549.731536:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573549/real 1788573549]  req@ffff8dc020496a00 x1875453360903168/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573574 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573549.731556:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453360903168/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573574 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573549.731565:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573549.731569:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573549.731573:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360903168:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573549.731581:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360903296:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573549.731610:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573549.731624:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573549/real 1788573549]  req@ffff8dc020494700 x1875453360903296/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573574 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573549.731639:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453360903296/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573574 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573549.731649:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573549.731653:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573549.731658:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360903296:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573549.731667:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360903424:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788573549.731697:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573549.731720:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573549/real 1788573549]  req@ffff8dc020495500 x1875453360903424/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573574 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573549.731733:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453360903424/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573574 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573549.731749:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573549.731752:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573549.731755:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360903424:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573549.731761:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360903552:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573549.731782:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573549.731794:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573549/real 1788573549]  req@ffff8dc020494000 x1875453360903552/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573574 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573549.731807:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453360903552/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573574 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573549.731826:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573549.731829:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573549.731833:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360903552:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573549.731854:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360903680:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573549.731909:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573549.731924:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573549/real 1788573549]  req@ffff8dc020494380 x1875453360903680/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573574 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573549.731941:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453360903680/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573574 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573549.731950:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573549.731955:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573549.731960:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360903680:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573550.114983:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573550.114983:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573550.114983:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573550.114984:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573550.115018:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573550.115048:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573550.755010:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573551.138984:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573551.139012:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573551.139013:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573551.139052:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573551.139077:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788573551.139078:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573551.778982:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573552.162977:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573552.162977:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573552.162977:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573552.163008:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573552.163010:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573552.163011:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573552.802973:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573553.186963:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573553.186965:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573553.186971:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573553.186975:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573553.186999:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788573553.187047:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573553.826932:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573554.210984:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573554.210984:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573554.211008:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573554.211102:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573554.211115:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573554.211130:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00080000:0.0:1788573554.851024:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788573554.851027:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788573554.851041:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788573554.851046:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573554.851059:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1900
00000100:00080000:0.0:1788573554.851071:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573554.851080:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788573554.851122:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453360903808/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573554.851158:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573554.851163:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573554.851165:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573554.851170:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1900
00000100:00080000:0.0:1788573554.851175:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573554.851182:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573554.851194:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573554.851208:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360903808:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788573554.851215:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453360903936/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573554.851249:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573554.851252:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573554.851254:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573554.851258:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1900
00000100:00080000:0.0:1788573554.851262:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573554.851268:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573554.851274:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573554.851306:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453360904064/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573554.851318:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573554.851321:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573554.851323:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573554.851326:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1900
00000100:00080000:0.0:1788573554.851330:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573554.851334:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573554.851340:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573554.851360:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453360904192/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573554.851372:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573554.851377:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:1.0:1788573554.851382:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360903936:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788573554.851383:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573554.851397:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1900
00000100:00080000:0.0:1788573554.851406:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573554.851412:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573554.851419:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573554.851439:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360904064:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573554.851440:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453360904320/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573554.851450:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573554.851460:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573554.851461:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573554.851470:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1900
00000100:00080000:0.0:1788573554.851476:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573554.851479:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573554.851487:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573554.851495:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360904192:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573554.851502:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453360904448/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573554.851513:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573554.851517:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573554.851520:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573554.851527:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1900
00000100:00080000:0.0:1788573554.851531:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788573554.851533:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360904320:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788573554.851540:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573554.851548:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573554.851560:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453360904576/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788573554.851575:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360904448:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573554.851605:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360904576:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573555.234962:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573555.234962:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573555.234998:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573555.235003:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573555.235926:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573555.235957:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573555.874953:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573556.258950:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573556.258960:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573556.258962:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573556.258965:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573556.258995:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573556.259017:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573556.898984:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573557.282937:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573557.282949:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573557.282952:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573557.282956:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573557.283009:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573557.283010:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573557.922988:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000400:00000100:2.0:1788573557.923140:0:2334:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.140:988
00000400:00000100:2.0:1788573557.923178:0:2334:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.140@tcp at host 192.168.202.140 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:2.0:1788573557.923195:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:2.0:1788573557.923229:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:2.0:1788573557.923238:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:2.0:1788573557.923249:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:2.0:1788573557.923261:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:2.0:1788573557.923274:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:1.0:1788573557.923275:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573554/real 1788573557]  req@ffff8dc006711c00 x1875453360903936/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573579 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:2.0:1788573557.923286:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:1.0:1788573557.923337:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453360903936/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573579 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573557.923352:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573557.923358:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573557.923363:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360903936:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573557.923372:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573554/real 1788573557]  req@ffff8dc006713480 x1875453360904064/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573579 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573557.923386:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453360904064/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573579 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573557.923395:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573557.923399:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573557.923403:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360904064:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573557.923410:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573554/real 1788573557]  req@ffff8dc006712680 x1875453360904192/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573579 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573557.923429:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453360904192/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573579 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573557.923439:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573557.923443:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573557.923447:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360904192:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573557.923454:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573554/real 1788573557]  req@ffff8dc006710380 x1875453360903808/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573579 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573557.923469:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453360903808/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573579 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573557.923477:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573557.923480:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573557.923484:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360903808:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788573557.923512:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573554/real 1788573557]  req@ffff8dc006712a00 x1875453360904576/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573579 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573557.923526:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453360904576/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573579 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573557.923534:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573557.923538:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573557.923546:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360904576:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573557.923553:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573554/real 1788573557]  req@ffff8dc006711500 x1875453360904320/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573579 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573557.923567:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453360904320/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573579 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573557.923593:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573557.923598:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573557.923602:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360904320:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573557.923610:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573554/real 1788573557]  req@ffff8dc006713b80 x1875453360904448/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573579 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573557.923624:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453360904448/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573579 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573557.923634:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573557.923637:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573557.923640:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360904448:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573558.306977:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573558.306977:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573558.306978:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573558.306990:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573558.307016:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573558.307040:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573558.947010:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573559.330987:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573559.331006:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573559.331019:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573559.331036:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573559.331044:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573559.331085:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573559.971025:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788573559.971079:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573559.971087:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788573559.971093:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573559.971106:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1905
00000100:00080000:2.0:1788573559.971119:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573559.971128:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573559.971172:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453360904704/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573559.971204:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573559.971208:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573559.971210:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573559.971215:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1905
00000100:00080000:2.0:1788573559.971218:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573559.971232:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573559.971246:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573559.971257:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360904704:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788573559.971264:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453360904832/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573559.971278:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573559.971281:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573559.971283:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573559.971287:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1905
00000100:00080000:2.0:1788573559.971291:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573559.971296:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573559.971333:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573559.971354:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453360904960/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573559.971371:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573559.971376:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573559.971378:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573559.971384:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1905
00000800:00000100:1.0:1788573559.971386:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788573559.971390:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573559.971396:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573559.971402:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573559.971417:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453360905088/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573559.971428:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573559.971432:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573559.971434:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573559.971440:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1905
00000100:00080000:2.0:1788573559.971444:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788573559.971448:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573559/real 1788573559]  req@ffff8dc020494a80 x1875453360904704/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573584 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573559.971453:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573559.971462:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573559.971479:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453360905216/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788573559.971482:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453360904704/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573584 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573559.971504:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573559.971509:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573559.971511:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573559.971511:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573559.971523:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1905
00000100:00080000:1.0:1788573559.971525:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788573559.971531:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788573559.971537:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360904704:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788573559.971539:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573559.971548:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573559.971562:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453360905344/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573559.971572:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573559.971575:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573559.971578:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573559.971585:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1905
00000100:00100000:1.0:1788573559.971586:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360904832:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788573559.971590:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573559.971598:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573559.971604:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573559.971628:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453360905472/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788573559.971629:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573559.971650:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573559/real 1788573559]  req@ffff8dc020496d80 x1875453360904832/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573584 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573559.971669:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453360904832/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573584 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573559.971682:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573559.971687:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573559.971691:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360904832:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573559.971698:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360904960:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573559.971725:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573559.971740:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573559/real 1788573559]  req@ffff8dc020495180 x1875453360904960/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573584 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573559.971755:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453360904960/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573584 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573559.971765:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573559.971769:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573559.971773:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360904960:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573559.971780:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360905088:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573559.971803:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573559.971815:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573559/real 1788573559]  req@ffff8dc020497480 x1875453360905088/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573584 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573559.971829:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453360905088/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573584 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573559.971848:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573559.971852:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573559.971856:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360905088:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573559.971863:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360905216:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788573559.971914:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573559.971928:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573559/real 1788573559]  req@ffff8dc020495880 x1875453360905216/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573584 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573559.971941:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453360905216/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573584 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573559.971953:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573559.971957:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573559.971961:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360905216:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573559.971968:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360905344:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573559.971990:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573559.972003:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573559/real 1788573559]  req@ffff8dc020494380 x1875453360905344/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573584 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573559.972017:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453360905344/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573584 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573559.972025:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573559.972029:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573559.972033:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360905344:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573559.972057:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360905472:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573559.972081:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573559.972094:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573559/real 1788573559]  req@ffff8dc020494000 x1875453360905472/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573584 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573559.972108:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453360905472/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573584 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573559.972116:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573559.972119:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573559.972124:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360905472:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573560.354972:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573560.354977:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573560.354979:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573560.354979:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573560.355011:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573560.355055:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573560.994996:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573561.378946:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573561.378985:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573561.379017:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573561.379019:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573561.379023:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573561.379046:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573562.019021:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573562.402994:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573562.403008:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573562.403012:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573562.403028:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573562.403050:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573562.403052:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573563.042986:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573563.427024:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573563.427024:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573563.427032:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573563.427032:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573563.427080:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573563.427111:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573564.066969:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573564.450996:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573564.451002:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573564.451057:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573564.451068:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573564.451071:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573564.451092:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573565.090950:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573565.090954:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573565.090963:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788573565.090968:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573565.090979:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1910
00000100:00080000:1.0:1788573565.090992:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573565.091001:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573565.091046:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453360905600/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573565.091074:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573565.091077:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573565.091079:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573565.091082:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1910
00000100:00080000:1.0:1788573565.091085:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573565.091087:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573565.091097:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573565.091109:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360905728/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573565.091116:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573565.091119:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573565.091120:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573565.091123:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1910
00000100:00080000:1.0:1788573565.091125:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573565.091130:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573565.091132:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360905600:192.168.202.140@tcp:250:kworker.0
00000008:00100000:1.0:1788573565.091134:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573565.091153:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360905856/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573565.091160:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573565.091163:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573565.091165:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573565.091167:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1910
00000100:00080000:1.0:1788573565.091169:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573565.091171:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573565.091175:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573565.091186:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360905984/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573565.091196:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573565.091199:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573565.091201:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573565.091206:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1910
00000100:00080000:1.0:1788573565.091211:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573565.091216:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:3.0:1788573565.091223:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:1.0:1788573565.091224:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573565.091242:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360906112/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573565.091249:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573565.091252:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573565.091254:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573565.091258:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1910
00000100:00080000:1.0:1788573565.091262:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573565.091265:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573565.091271:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573565.091271:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573565/real 1788573565]  req@ffff8dc005dc0a80 x1875453360905600/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573590 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573565.091285:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360906240/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573565.091293:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453360905600/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573590 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573565.091295:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573565.091306:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573565.091331:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573565.091333:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573565.091339:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1910
00000100:00080000:3.0:1788573565.091340:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573565.091348:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360905600:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788573565.091349:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573565.091360:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573565.091360:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360905728:192.168.202.140@tcp:38:kworker.0
00000008:00100000:1.0:1788573565.091370:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573565.091385:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360906368/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788573565.091394:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573565.091413:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573565/real 1788573565]  req@ffff8dc005dc3b80 x1875453360905728/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573590 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573565.091429:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360905728/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573590 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573565.091439:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573565.091442:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573565.091444:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360905728:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573565.091480:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360905856:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573565.091497:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573565.091505:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573565/real 1788573565]  req@ffff8dc005dc1c00 x1875453360905856/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573590 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573565.091514:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453360905856/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573590 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573565.091520:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573565.091523:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573565.091525:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360905856:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573565.091529:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360905984:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573565.091540:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573565.091546:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573565/real 1788573565]  req@ffff8dc005dc2d80 x1875453360905984/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573590 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573565.091553:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360905984/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573590 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573565.091559:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573565.091561:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573565.091564:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360905984:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573565.091568:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360906112:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573565.091579:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573565.091585:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573565/real 1788573565]  req@ffff8dc005dc1180 x1875453360906112/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573590 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573565.091592:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360906112/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573590 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573565.091599:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573565.091600:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573565.091602:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360906112:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573565.091605:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360906240:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573565.091615:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573565.091621:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573565/real 1788573565]  req@ffff8dc005dc0700 x1875453360906240/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573590 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573565.091629:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453360906240/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573590 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573565.091634:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573565.091636:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573565.091637:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360906240:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573565.091641:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360906368:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573565.091651:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573565.091657:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573565/real 1788573565]  req@ffff8dc005dc1500 x1875453360906368/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573590 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573565.091665:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360906368/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573590 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573565.091670:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573565.091671:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573565.091673:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360906368:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573565.474986:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573565.474993:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573565.475011:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573565.475029:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573565.475043:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573565.475072:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573566.115019:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573566.499034:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573566.499034:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573566.499041:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573566.499045:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573566.499083:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573566.499132:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573567.139061:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573567.523018:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573567.523018:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788573567.523078:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573567.523150:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573567.523166:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573567.523173:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573568.163023:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573568.546989:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573568.547008:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573568.547010:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573568.547039:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573568.547050:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573568.547063:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573569.186969:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573569.571027:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573569.571027:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573569.571063:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573569.571068:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573569.571180:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573569.571242:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573570.211000:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573570.211008:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788573570.211013:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788573570.211017:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573570.211023:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1915
00000100:00080000:1.0:1788573570.211038:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573570.211051:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573570.211087:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453360906496/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573570.211113:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573570.211116:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573570.211118:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573570.211120:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1915
00000100:00080000:1.0:1788573570.211123:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573570.211125:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573570.211134:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573570.211144:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360906624/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573570.211152:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573570.211155:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573570.211156:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788573570.211160:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360906496:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788573570.211162:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1915
00000100:00080000:1.0:1788573570.211168:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573570.211172:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573570.211176:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573570.211183:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360906752/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573570.211189:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573570.211192:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573570.211193:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573570.211195:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1915
00000100:00080000:1.0:1788573570.211198:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573570.211201:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573570.211206:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573570.211217:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360906880/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573570.211227:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573570.211231:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573570.211235:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1788573570.211236:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788573570.211244:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1915
00000100:00080000:1.0:1788573570.211249:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573570.211255:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573570.211260:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573570.211272:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360907008/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573570.211279:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788573570.211290:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573570/real 1788573570]  req@ffff8dc005dc3800 x1875453360906496/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573595 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573570.211291:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573570.211297:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573570.211306:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1915
00000100:00080000:1.0:1788573570.211312:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573570.211331:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573570.211336:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573570.211340:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453360906496/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573595 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573570.211349:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360907136/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573570.211352:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573570.211360:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573570.211369:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360906496:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788573570.211375:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573570.211378:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573570.211380:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573570.211384:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1915
00000100:00080000:1.0:1788573570.211387:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573570.211390:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573570.211393:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573570.211401:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360906624:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573570.211403:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360907264/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788573570.211440:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573570.211453:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573570/real 1788573570]  req@ffff8dc005dc1500 x1875453360906624/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573595 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573570.211462:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360906624/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573595 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573570.211469:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573570.211471:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573570.211474:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360906624:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573570.211478:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360906752:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573570.211491:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573570.211497:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573570/real 1788573570]  req@ffff8dc005dc0700 x1875453360906752/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573595 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573570.211505:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453360906752/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573595 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573570.211510:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573570.211512:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573570.211514:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360906752:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573570.211518:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360906880:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573570.211528:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573570.211534:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573570/real 1788573570]  req@ffff8dc005dc1180 x1875453360906880/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573595 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573570.211546:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360906880/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573595 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573570.211552:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573570.211553:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573570.211555:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360906880:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573570.211558:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360907008:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573570.211569:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573570.211575:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573570/real 1788573570]  req@ffff8dc005dc2d80 x1875453360907008/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573595 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573570.211583:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360907008/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573595 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573570.211588:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573570.211590:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573570.211592:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360907008:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573570.211595:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360907136:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573570.211605:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573570.211611:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573570/real 1788573570]  req@ffff8dc005dc1c00 x1875453360907136/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573595 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573570.211618:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453360907136/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573595 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573570.211628:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573570.211630:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573570.211632:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360907136:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573570.211644:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360907264:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573570.211655:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573570.211661:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573570/real 1788573570]  req@ffff8dc005dc3b80 x1875453360907264/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573595 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573570.211668:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360907264/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573595 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573570.211673:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573570.211675:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573570.211676:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360907264:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573570.595024:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573570.595024:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573570.595024:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573570.595025:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573570.595079:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788573570.595152:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573571.234955:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573571.618974:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573571.618995:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573571.619031:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573571.619032:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573571.619032:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573571.619068:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573572.258993:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573572.642958:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573572.642969:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573572.642990:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573572.643007:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573572.643019:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573572.643037:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573573.282947:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573573.667011:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573573.667011:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573573.667011:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573573.667028:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573573.667066:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573573.667107:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573574.307001:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573574.690951:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573574.690994:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573574.691003:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573574.691007:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573574.691052:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573574.691123:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1788573575.331008:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788573575.331014:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573575.331022:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788573575.331028:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573575.331040:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1920
00000100:00080000:1.0:1788573575.331054:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573575.331064:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573575.331117:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453360907392/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573575.331147:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573575.331150:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573575.331153:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573575.331156:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1920
00000100:00080000:1.0:1788573575.331159:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573575.331163:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573575.331174:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573575.331187:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360907520/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573575.331195:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573575.331198:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573575.331199:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573575.331202:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1920
00000100:00080000:1.0:1788573575.331205:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573575.331210:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573575.331213:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360907392:192.168.202.140@tcp:250:kworker.0
00000008:00100000:1.0:1788573575.331215:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573575.331229:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360907648/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573575.331237:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573575.331239:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573575.331241:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573575.331244:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1920
00000100:00080000:1.0:1788573575.331246:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573575.331248:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573575.331251:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573575.331261:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360907776/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573575.331272:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573575.331276:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573575.331277:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573575.331283:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1920
00000100:00080000:1.0:1788573575.331288:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573575.331294:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:3.0:1788573575.331300:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:1.0:1788573575.331301:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573575.331320:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360907904/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573575.331354:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573575.331357:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573575.331359:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573575.331363:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1920
00000100:00080000:1.0:1788573575.331367:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573575.331370:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573575.331375:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573575.331392:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360908032/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573575.331393:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573575/real 1788573575]  req@ffff8dc005dc0a80 x1875453360907392/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573600 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573575.331414:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573575.331418:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573575.331419:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573575.331423:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1920
00000100:00080000:1.0:1788573575.331425:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573575.331432:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573575.331432:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453360907392/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573600 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1788573575.331435:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573575.331448:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360908160/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573575.331449:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573575.331454:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573575.331457:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360907392:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788573575.331481:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360907520:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573575.331504:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573575.331515:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573575/real 1788573575]  req@ffff8dc005dc3b80 x1875453360907520/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573600 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573575.331524:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360907520/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573600 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573575.331531:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573575.331534:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573575.331536:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360907520:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573575.331558:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360907648:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573575.331571:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573575.331578:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573575/real 1788573575]  req@ffff8dc005dc1c00 x1875453360907648/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573600 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573575.331591:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453360907648/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573600 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573575.331597:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573575.331599:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573575.331600:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360907648:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573575.331604:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360907776:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573575.331618:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573575.331625:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573575/real 1788573575]  req@ffff8dc005dc2d80 x1875453360907776/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573600 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573575.331632:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360907776/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573600 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573575.331639:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573575.331640:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573575.331642:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360907776:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573575.331646:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360907904:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573575.331658:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573575.331664:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573575/real 1788573575]  req@ffff8dc005dc1180 x1875453360907904/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573600 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573575.331671:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360907904/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573600 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573575.331682:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573575.331684:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573575.331686:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360907904:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573575.331689:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360908032:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573575.331699:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573575.331705:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573575/real 1788573575]  req@ffff8dc005dc0700 x1875453360908032/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573600 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573575.331711:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453360908032/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573600 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573575.331717:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573575.331719:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573575.331721:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360908032:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573575.331724:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360908160:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573575.331734:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573575.331739:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573575/real 1788573575]  req@ffff8dc005dc1500 x1875453360908160/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573600 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573575.331746:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360908160/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573600 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573575.331751:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573575.331753:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573575.331756:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360908160:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573575.715028:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573575.715028:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573575.715028:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573575.715046:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573575.715078:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573575.715130:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573576.354992:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573576.738969:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573576.738990:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573576.739008:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573576.739016:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573576.739045:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573576.739089:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573577.379028:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573577.763019:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573577.763019:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573577.763019:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573577.763028:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573577.763065:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573577.763123:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573578.403025:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573578.786969:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573578.786969:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573578.786971:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573578.786973:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573578.787002:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573578.787033:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573579.426991:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573579.810981:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573579.810982:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573579.810982:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573579.810982:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573579.811015:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573579.811052:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573580.450981:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573580.450996:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573580.451005:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788573580.451010:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573580.451022:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1926
00000100:00080000:1.0:1788573580.451034:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573580.451042:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573580.451094:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453360908288/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573580.451131:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573580.451135:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573580.451138:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573580.451143:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1926
00000100:00080000:1.0:1788573580.451148:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573580.451153:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573580.451165:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573580.451182:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360908416/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573580.451192:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788573580.451193:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360908288:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788573580.451198:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573580.451201:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573580.451205:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1926
00000100:00080000:1.0:1788573580.451208:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573580.451211:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573580.451215:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573580.451232:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360908544/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573580.451240:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573580.451243:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573580.451245:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573580.451248:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1926
00000100:00080000:1.0:1788573580.451252:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573580.451256:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573580.451261:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573580.451276:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360908672/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788573580.451280:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788573580.451293:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573580.451298:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573580.451301:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573580.451307:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1926
00000100:00080000:1.0:1788573580.451311:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573580.451315:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573580.451320:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573580.451352:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360908800/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573580.451356:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573580/real 1788573580]  req@ffff8dc005dc3800 x1875453360908288/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573605 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573580.451380:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573580.451385:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573580.451387:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573580.451394:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1926
00000100:00100000:3.0:1788573580.451396:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453360908288/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573605 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573580.451399:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573580.451409:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:3.0:1788573580.451412:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:1.0:1788573580.451416:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788573580.451419:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573580.451425:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360908288:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788573580.451437:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360908928/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573580.451452:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788573580.451453:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360908416:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788573580.451458:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573580.451462:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573580.451467:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1926
00000100:00080000:1.0:1788573580.451473:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573580.451478:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:3.0:1788573580.451482:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573580.451494:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573580/real 1788573580]  req@ffff8dc005dc1500 x1875453360908416/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573605 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1788573580.451496:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573580.451509:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360908416/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573605 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573580.451518:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360909056/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573580.451532:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573580.451536:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573580.451540:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360908416:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573580.451546:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360908544:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573580.451561:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573580.451569:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573580/real 1788573580]  req@ffff8dc005dc0700 x1875453360908544/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573605 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573580.451577:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453360908544/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573605 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573580.451583:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573580.451585:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573580.451587:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360908544:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573580.451591:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360908672:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573580.451602:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573580.451608:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573580/real 1788573580]  req@ffff8dc005dc1180 x1875453360908672/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573605 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573580.451615:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360908672/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573605 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573580.451622:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573580.451623:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573580.451626:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360908672:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573580.451630:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360908800:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573580.451640:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573580.451646:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573580/real 1788573580]  req@ffff8dc005dc2d80 x1875453360908800/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573605 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573580.451654:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360908800/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573605 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573580.451659:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573580.451661:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573580.451663:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360908800:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573580.451675:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360908928:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573580.451686:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573580.451692:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573580/real 1788573580]  req@ffff8dc005dc1c00 x1875453360908928/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573605 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573580.451700:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453360908928/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573605 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573580.451705:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573580.451708:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573580.451710:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360908928:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573580.451713:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360909056:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573580.451723:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573580.451731:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573580/real 1788573580]  req@ffff8dc005dc3b80 x1875453360909056/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573605 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573580.451744:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360909056/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573605 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573580.451752:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573580.451755:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573580.451759:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360909056:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573580.834961:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573580.834962:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573580.834998:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573580.835107:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573580.835126:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573580.835187:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573581.475025:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573581.858986:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573581.858986:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573581.858986:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573581.858991:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573581.859023:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573581.859061:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573582.498980:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573582.882990:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573582.882991:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573582.882995:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573582.883021:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573582.883026:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573582.883060:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573583.522972:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573583.906976:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573583.907014:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573583.907018:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573583.907018:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573583.907042:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573583.907113:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573584.546930:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573584.931000:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573584.931000:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573584.931001:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573584.931030:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573584.931069:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573584.931108:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573585.570980:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573585.571021:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573585.571033:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788573585.571039:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573585.571052:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1931
00000100:00080000:1.0:1788573585.571066:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573585.571075:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573585.571130:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453360909184/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573585.571165:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573585.571170:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573585.571172:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573585.571184:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1931
00000100:00080000:1.0:1788573585.571189:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573585.571194:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573585.571209:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573585.571235:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360909312/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573585.571235:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360909184:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788573585.571268:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573585.571273:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573585.571277:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573585.571283:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1931
00000100:00080000:1.0:1788573585.571288:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573585.571294:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573585.571301:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573585.571317:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360909440/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788573585.571325:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788573585.571351:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573585.571357:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573585.571359:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573585.571366:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1931
00000100:00080000:1.0:1788573585.571371:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573585.571376:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573585.571383:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573585.571386:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573585/real 1788573585]  req@ffff8dc005dc0a80 x1875453360909184/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573610 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573585.571401:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360909568/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573585.571406:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453360909184/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573610 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573585.571459:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573585.571463:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573585.571466:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573585.571466:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573585.571477:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1931
00000100:00080000:3.0:1788573585.571482:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788573585.571484:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573585.571493:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573585.571499:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360909184:192.168.202.140@tcp:250:kworker.0
00000008:00100000:1.0:1788573585.571500:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573585.571523:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360909696/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573585.571531:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573585.571534:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573585.571537:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573585.571541:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1931
00000100:00100000:3.0:1788573585.571547:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360909312:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788573585.571548:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573585.571561:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573585.571566:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573585.571582:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360909824/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788573585.571592:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788573585.571610:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573585.571616:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:3.0:1788573585.571616:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573585/real 1788573585]  req@ffff8dc005dc3b80 x1875453360909312/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573610 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573585.571622:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573585.571637:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1931
00000100:00080000:1.0:1788573585.571648:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573585.571655:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573585.571656:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360909312/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573610 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1788573585.571668:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788573585.571673:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573585.571678:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573585.571682:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360909312:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573585.571688:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360909952/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573585.571693:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360909440:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573585.571722:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573585.571730:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573585/real 1788573585]  req@ffff8dc005dc1c00 x1875453360909440/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573610 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573585.571739:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453360909440/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573610 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573585.571746:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573585.571750:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573585.571752:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360909440:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573585.571759:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360909568:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573585.571773:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573585.571779:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573585/real 1788573585]  req@ffff8dc005dc2d80 x1875453360909568/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573610 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573585.571787:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360909568/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573610 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573585.571792:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573585.571796:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573585.571799:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360909568:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573585.571803:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360909696:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573585.571817:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573585.571828:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573585/real 1788573585]  req@ffff8dc005dc1180 x1875453360909696/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573610 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573585.571836:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360909696/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573610 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573585.571843:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573585.571845:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573585.571848:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360909696:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573585.571927:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360909824:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573585.571956:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573585.571976:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573585/real 1788573585]  req@ffff8dc005dc0700 x1875453360909824/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573610 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573585.571993:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453360909824/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573610 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573585.572001:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573585.572005:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573585.572012:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360909824:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573585.572024:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360909952:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573585.572055:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573585.572071:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573585/real 1788573585]  req@ffff8dc005dc1500 x1875453360909952/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573610 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573585.572314:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360909952/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573610 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573585.572321:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573585.572326:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573585.572329:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360909952:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573585.954979:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573585.954982:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573585.954983:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573585.955014:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573585.955017:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573585.955048:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573586.594948:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573586.979026:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573586.979035:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573586.979049:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573586.979090:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573586.979091:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573586.979167:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573587.618977:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573588.003006:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573588.003006:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573588.003006:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573588.003010:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573588.003066:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573588.003101:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573588.642943:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573589.027054:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573589.027054:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573589.027055:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573589.027059:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573589.027136:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573589.027174:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573589.666986:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573590.050952:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573590.050954:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573590.050965:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573590.050977:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573590.050998:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573590.050999:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573590.690938:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788573590.690942:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573590.690947:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788573590.690952:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573590.690961:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1936
00000100:00080000:1.0:1788573590.690970:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573590.690976:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573590.691008:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453360910080/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573590.691036:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573590.691039:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573590.691040:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573590.691043:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1936
00000100:00080000:1.0:1788573590.691045:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573590.691047:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573590.691055:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573590.691066:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360910208/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573590.691078:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573590.691083:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573590.691084:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573590.691087:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1936
00000100:00100000:3.0:1788573590.691089:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360910080:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788573590.691090:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573590.691095:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573590.691099:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573590.691110:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360910336/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573590.691116:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573590.691119:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573590.691121:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573590.691123:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1936
00000100:00080000:1.0:1788573590.691125:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573590.691127:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573590.691130:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573590.691139:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360910464/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573590.691145:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573590.691148:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573590.691149:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573590.691151:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1936
00000100:00080000:1.0:1788573590.691154:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573590.691156:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573590.691161:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788573590.691161:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573590.691171:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360910592/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573590.691179:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573590.691181:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573590.691182:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573590.691185:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1936
00000100:00080000:1.0:1788573590.691187:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573590.691190:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573590.691193:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573590.691198:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573590/real 1788573590]  req@ffff8dc005dc3800 x1875453360910080/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573615 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573590.691209:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360910720/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573590.691216:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453360910080/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573615 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573590.691222:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573590.691229:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573590.691231:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573590.691232:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573590.691236:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1936
00000100:00080000:3.0:1788573590.691239:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788573590.691241:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788573590.691244:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360910080:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788573590.691246:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573590.691254:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573590.691262:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360910848/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573590.691284:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360910208:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573590.691306:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573590.691324:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573590/real 1788573590]  req@ffff8dc005dc1500 x1875453360910208/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573615 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573590.691333:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360910208/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573615 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573590.691340:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573590.691342:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573590.691344:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360910208:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573590.691348:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360910336:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573590.691360:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573590.691366:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573590/real 1788573590]  req@ffff8dc005dc0700 x1875453360910336/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573615 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573590.691378:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453360910336/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573615 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573590.691384:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573590.691386:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573590.691387:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360910336:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573590.691391:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360910464:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573590.691401:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573590.691406:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573590/real 1788573590]  req@ffff8dc005dc1180 x1875453360910464/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573615 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573590.691413:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360910464/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573615 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573590.691419:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573590.691421:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573590.691423:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360910464:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573590.691426:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360910592:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573590.691436:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573590.691441:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573590/real 1788573590]  req@ffff8dc005dc2d80 x1875453360910592/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573615 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573590.691448:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360910592/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573615 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573590.691458:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573590.691460:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573590.691462:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360910592:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573590.691465:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360910720:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573590.691474:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573590.691480:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573590/real 1788573590]  req@ffff8dc005dc1c00 x1875453360910720/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573615 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573590.691486:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453360910720/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573615 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573590.691492:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573590.691493:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573590.691495:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360910720:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573590.691507:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360910848:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573590.691516:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573590.691522:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573590/real 1788573590]  req@ffff8dc005dc3b80 x1875453360910848/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573615 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573590.691528:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360910848/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573615 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573590.691533:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573590.691535:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573590.691537:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360910848:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573591.074966:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573591.074971:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573591.074972:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573591.074999:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573591.075003:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573591.075009:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573591.714972:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573592.098953:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573592.098961:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573592.098972:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573592.098982:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573592.099003:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573592.099005:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573592.738952:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573593.122988:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573593.122988:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573593.123020:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573593.123104:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573593.123117:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573593.123157:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573593.762964:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573594.146992:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573594.146994:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573594.146999:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573594.147011:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573594.147033:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573594.147066:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573594.787082:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573595.171006:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573595.171006:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573595.171006:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573595.171021:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573595.171053:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573595.171086:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1788573595.811009:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788573595.811012:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788573595.811021:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788573595.811029:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573595.811043:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1941
00000100:00080000:2.0:1788573595.811058:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573595.811069:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573595.811122:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453360910976/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573595.811157:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573595.811160:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573595.811162:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573595.811166:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1941
00000100:00080000:2.0:1788573595.811169:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573595.811172:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573595.811183:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573595.811208:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453360911104/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573595.811223:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788573595.811229:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360910976:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788573595.811231:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573595.811236:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573595.811245:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1941
00000100:00080000:2.0:1788573595.811249:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573595.811255:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573595.811261:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573595.811273:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453360911232/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573595.811281:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573595.811284:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573595.811286:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573595.811289:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1941
00000100:00080000:2.0:1788573595.811295:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573595.811298:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573595.811302:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573595.811317:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453360911360/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788573595.811318:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788573595.811332:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573595.811336:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573595.811338:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573595.811344:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1941
00000100:00080000:2.0:1788573595.811347:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573595.811351:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573595.811355:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573595.811364:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453360911488/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573595.811372:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573595.811374:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573595.811376:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788573595.811382:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573595/real 1788573595]  req@ffff8dc020495500 x1875453360910976/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573620 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573595.811383:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1941
00000100:00080000:2.0:1788573595.811389:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573595.811400:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573595.811410:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573595.811433:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453360911616/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573595.811435:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453360910976/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573620 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573595.811476:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573595.811484:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573595.811486:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573595.811488:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573595.811492:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1941
00000100:00080000:2.0:1788573595.811500:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573595.811505:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788573595.811510:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573595.811517:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573595.811517:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360910976:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788573595.811535:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453360911744/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573595.811559:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360911104:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573595.811586:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573595.811600:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573595/real 1788573595]  req@ffff8dc020494700 x1875453360911104/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573620 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573595.811612:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453360911104/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573620 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573595.811624:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573595.811628:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573595.811632:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360911104:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573595.811639:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360911232:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573595.811658:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573595.811668:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573595/real 1788573595]  req@ffff8dc020496a00 x1875453360911232/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573620 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573595.811680:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453360911232/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573620 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573595.811690:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573595.811693:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573595.811697:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360911232:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573595.811703:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360911360:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573595.811720:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573595.811729:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573595/real 1788573595]  req@ffff8dc020494e00 x1875453360911360/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573620 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573595.811741:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453360911360/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573620 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573595.811750:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573595.811753:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573595.811757:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360911360:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573595.811763:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360911488:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573595.811791:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573595.811802:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573595/real 1788573595]  req@ffff8dc020497100 x1875453360911488/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573620 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573595.811814:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453360911488/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573620 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573595.811823:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573595.811826:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573595.811830:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360911488:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573595.811836:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360911616:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573595.811853:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573595.811895:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573595/real 1788573595]  req@ffff8dc020494000 x1875453360911616/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573620 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573595.811909:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453360911616/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573620 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573595.811918:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573595.811922:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573595.811926:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360911616:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573595.811932:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360911744:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573595.811959:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573595.811970:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573595/real 1788573595]  req@ffff8dc020494380 x1875453360911744/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573620 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573595.811983:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453360911744/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573620 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573595.811991:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573595.811995:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573595.811998:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360911744:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573596.194971:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573596.195009:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573596.195016:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573596.195047:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573596.195054:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573596.195072:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573596.835016:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573597.219005:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573597.219005:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573597.219005:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573597.219005:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573597.219046:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573597.219090:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573597.859012:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573598.242995:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573598.242996:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573598.242996:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573598.243033:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573598.243054:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573598.243071:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573598.883005:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573599.266991:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573599.266997:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573599.266997:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573599.267042:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573599.267046:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788573599.267068:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573599.906982:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573600.290965:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573600.290987:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573600.290991:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573600.291021:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573600.291022:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573600.291040:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00080000:3.0:1788573600.931009:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573600.931018:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788573600.931021:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573600.931032:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1946
00000100:00080000:3.0:1788573600.931043:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1788573600.931044:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788573600.931055:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573600.931095:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c380 x1875453360911872/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573600.931138:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573600.931143:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573600.931144:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573600.931149:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1946
00000100:00080000:3.0:1788573600.931154:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573600.931158:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573600.931169:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573600.931184:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360911872:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788573600.931187:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c700 x1875453360912000/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573600.931200:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573600.931203:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788573600.931205:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573600.931209:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1946
00000100:00080000:3.0:1788573600.931213:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573600.931217:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573600.931223:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573600.931237:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e680 x1875453360912128/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788573600.931243:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788573600.931252:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573600.931256:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788573600.931258:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573600.931264:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1946
00000100:00080000:3.0:1788573600.931268:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573600.931273:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573600.931279:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573600.931294:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d180 x1875453360912256/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788573600.931298:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573600/real 1788573600]  req@ffff8dc00644c380 x1875453360911872/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573625 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573600.931328:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788573600.931332:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453360911872/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573625 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573600.931333:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573600.931337:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573600.931348:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1946
00000100:00080000:3.0:1788573600.931356:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573600.931359:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573600.931364:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:1.0:1788573600.931368:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573600.931372:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360911872:192.168.202.140@tcp:250:kworker.0
00000008:00100000:3.0:1788573600.931373:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573600.931392:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f480 x1875453360912384/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788573600.931395:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360912000:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788573600.931412:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573600.931417:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000800:00000100:1.0:1788573600.931420:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788573600.931421:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573600.931429:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1946
00000100:00080000:3.0:1788573600.931435:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788573600.931436:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573600/real 1788573600]  req@ffff8dc00644c700 x1875453360912000/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573625 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573600.931442:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573600.931450:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573600.931454:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453360912000/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573625 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573600.931464:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1788573600.931465:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f800 x1875453360912512/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573600.931471:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573600.931478:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360912000:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573600.931488:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360912128:192.168.202.140@tcp:8:kworker.0
00000100:00080000:3.0:1788573600.931489:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573600.931496:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788573600.931499:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573600.931505:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1946
00000800:00000100:1.0:1788573600.931510:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788573600.931513:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788573600.931521:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573600/real 1788573600]  req@ffff8dc00644e680 x1875453360912128/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573625 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573600.931522:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573600.931529:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573600.931537:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453360912128/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573625 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573600.931543:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644dc00 x1875453360912640/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573600.931548:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573600.931557:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573600.931562:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360912128:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573600.931568:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360912256:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573600.931582:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573600.931590:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573600/real 1788573600]  req@ffff8dc00644d180 x1875453360912256/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573625 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573600.931597:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453360912256/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573625 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573600.931603:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573600.931605:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573600.931606:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360912256:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573600.931617:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360912384:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788573600.931638:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573600.931651:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573600/real 1788573600]  req@ffff8dc00644f480 x1875453360912384/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573625 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573600.931663:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453360912384/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573625 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573600.931672:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573600.931676:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573600.931679:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360912384:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573600.931685:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360912512:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573600.931709:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573600.931719:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573600/real 1788573600]  req@ffff8dc00644f800 x1875453360912512/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573625 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573600.931727:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f800 x1875453360912512/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573625 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573600.931733:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573600.931735:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573600.931737:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360912512:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573600.931740:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360912640:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573600.931753:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573600.931770:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573600/real 1788573600]  req@ffff8dc00644dc00 x1875453360912640/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573625 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573600.931783:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644dc00 x1875453360912640/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573625 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573600.931792:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573600.931795:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573600.931798:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360912640:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573601.314994:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573601.314996:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573601.315045:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573601.315055:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573601.315070:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573601.315092:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573601.954960:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573602.338972:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573602.338995:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573602.338995:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573602.338998:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573602.339011:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573602.339134:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573602.979015:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573603.363000:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573603.363002:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573603.363007:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573603.363050:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573603.363067:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788573603.363085:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573604.002950:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573604.386963:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573604.386963:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573604.386964:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573604.386964:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573604.386999:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573604.387039:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573605.027021:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573605.410975:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573605.410985:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573605.411073:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573605.411076:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573605.411081:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573605.411089:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00080000:0.0:1788573606.051016:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788573606.051023:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788573606.051031:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788573606.051037:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573606.051075:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1951
00000100:00080000:0.0:1788573606.051088:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573606.051096:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788573606.051141:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453360912768/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573606.051167:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573606.051170:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573606.051172:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573606.051175:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1951
00000100:00080000:0.0:1788573606.051177:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573606.051180:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573606.051189:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573606.051201:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453360912896/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573606.051209:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573606.051213:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573606.051216:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1788573606.051217:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360912768:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788573606.051221:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1951
00000100:00080000:0.0:1788573606.051227:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573606.051230:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573606.051234:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573606.051241:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453360913024/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573606.051248:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573606.051250:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573606.051252:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573606.051254:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1951
00000100:00080000:0.0:1788573606.051256:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573606.051258:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573606.051261:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573606.051268:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453360913152/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573606.051274:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573606.051276:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573606.051277:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573606.051281:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1951
00000100:00080000:0.0:1788573606.051297:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573606.051300:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573606.051304:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1788573606.051309:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573606.051314:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453360913280/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573606.051321:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573606.051324:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573606.051325:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573606.051328:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1951
00000100:00080000:0.0:1788573606.051334:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573606.051336:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573606.051339:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573606.051347:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453360913408/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573606.051353:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573606.051356:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573606.051358:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573606.051362:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1951
00000100:00080000:0.0:1788573606.051364:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788573606.051364:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573606/real 1788573606]  req@ffff8dc006711880 x1875453360912768/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573631 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573606.051371:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573606.051378:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573606.051394:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453360913536/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788573606.051399:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453360912768/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573631 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573606.051423:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573606.051427:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573606.051431:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360912768:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788573606.051459:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360912896:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788573606.051485:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573606.051499:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573606/real 1788573606]  req@ffff8dc006713800 x1875453360912896/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573631 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573606.051513:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453360912896/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573631 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573606.051525:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573606.051529:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573606.051533:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360912896:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573606.051539:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360913024:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573606.051562:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573606.051574:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573606/real 1788573606]  req@ffff8dc006713100 x1875453360913024/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573631 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573606.051593:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453360913024/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573631 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573606.051603:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573606.051606:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573606.051610:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360913024:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573606.051617:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360913152:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573606.051637:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573606.051647:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573606/real 1788573606]  req@ffff8dc006712300 x1875453360913152/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573631 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573606.051655:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453360913152/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573631 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573606.051663:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573606.051665:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573606.051667:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360913152:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573606.051672:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360913280:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788573606.051685:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573606.051691:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573606/real 1788573606]  req@ffff8dc006710e00 x1875453360913280/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573631 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573606.051699:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453360913280/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573631 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573606.051710:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573606.051712:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573606.051714:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360913280:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573606.051718:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360913408:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573606.051729:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573606.051734:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573606/real 1788573606]  req@ffff8dc006713b80 x1875453360913408/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573631 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573606.051741:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453360913408/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573631 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573606.051747:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573606.051749:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573606.051751:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360913408:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573606.051754:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360913536:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573606.051768:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573606.051779:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573606/real 1788573606]  req@ffff8dc006711500 x1875453360913536/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573631 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573606.051792:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453360913536/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573631 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573606.051801:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573606.051815:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573606.051819:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360913536:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573606.434999:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573606.434999:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573606.434999:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573606.435036:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573606.435039:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573606.435055:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573607.075068:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573607.458993:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573607.458994:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573607.459023:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573607.459045:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573607.459046:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788573607.459094:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573608.099068:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573608.482982:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573608.483031:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573608.483044:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573608.483050:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573608.483058:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573608.483074:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573609.123092:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573609.506972:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573609.506974:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573609.506975:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573609.507023:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573609.507024:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573609.507039:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573610.146997:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573610.531039:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573610.531049:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573610.531056:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573610.531151:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573610.531178:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573610.531182:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00080000:1.0:1788573611.171008:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788573611.171015:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573611.171017:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788573611.171025:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573611.171036:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1956
00000100:00080000:1.0:1788573611.171045:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573611.171052:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573611.171090:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453360913664/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573611.171122:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573611.171125:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573611.171127:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573611.171131:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1956
00000100:00080000:1.0:1788573611.171136:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573611.171140:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573611.171151:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573611.171170:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360913792/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573611.171174:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360913664:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788573611.171188:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573611.171202:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573611.171204:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573611.171210:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1956
00000100:00080000:1.0:1788573611.171214:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573611.171217:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573611.171222:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573611.171233:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360913920/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573611.171240:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573611.171243:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573611.171245:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573611.171247:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1956
00000100:00080000:1.0:1788573611.171250:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573611.171252:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573611.171255:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788573611.171261:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573611.171266:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360914048/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573611.171273:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573611.171275:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573611.171277:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573611.171280:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1956
00000100:00080000:1.0:1788573611.171288:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573611.171291:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573611.171297:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573611.171307:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360914176/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573611.171315:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788573611.171315:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573611/real 1788573611]  req@ffff8dc005dc0a80 x1875453360913664/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573636 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573611.171319:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573611.171322:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573611.171330:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1956
00000100:00080000:1.0:1788573611.171339:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573611.171345:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573611.171351:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573611.171351:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453360913664/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573636 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573611.171368:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360914304/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573611.171368:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573611.171378:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573611.171388:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360913664:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788573611.171389:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573611.171397:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573611.171400:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573611.171404:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1956
00000100:00080000:1.0:1788573611.171407:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573611.171410:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573611.171414:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573611.171424:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360913792:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573611.171426:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360914432/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788573611.171459:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573611.171473:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573611/real 1788573611]  req@ffff8dc005dc3b80 x1875453360913792/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573636 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573611.171482:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360913792/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573636 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573611.171489:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573611.171492:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573611.171494:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360913792:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573611.171499:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360913920:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573611.171511:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573611.171517:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573611/real 1788573611]  req@ffff8dc005dc1c00 x1875453360913920/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573636 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573611.171525:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453360913920/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573636 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573611.171530:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573611.171532:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573611.171534:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360913920:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573611.171537:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360914048:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573611.171547:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573611.171553:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573611/real 1788573611]  req@ffff8dc005dc2d80 x1875453360914048/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573636 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573611.171561:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360914048/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573636 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573611.171566:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573611.171568:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573611.171570:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360914048:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573611.171573:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360914176:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573611.171583:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573611.171589:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573611/real 1788573611]  req@ffff8dc005dc1180 x1875453360914176/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573636 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573611.171596:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360914176/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573636 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573611.171601:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573611.171603:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573611.171605:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360914176:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573611.171608:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360914304:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573611.171619:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573611.171625:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573611/real 1788573611]  req@ffff8dc005dc0700 x1875453360914304/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573636 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573611.171632:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453360914304/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573636 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573611.171637:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573611.171639:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573611.171641:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360914304:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573611.171654:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360914432:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573611.171664:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573611.171670:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573611/real 1788573611]  req@ffff8dc005dc1500 x1875453360914432/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573636 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573611.171677:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360914432/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573636 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573611.171682:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573611.171684:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573611.171685:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360914432:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573611.554997:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573611.555008:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573611.555011:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573611.555033:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573611.555035:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573611.555063:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573612.194981:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573612.579020:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573612.579021:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573612.579021:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573612.579058:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573612.579060:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573612.579064:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573613.218998:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573613.602995:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573613.602999:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573613.603012:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573613.603044:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573613.603046:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573613.603057:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573614.242925:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573614.627002:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573614.627004:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573614.627009:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573614.627041:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573614.627046:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788573614.627090:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573615.266989:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573615.650982:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573615.651004:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573615.651025:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573615.651052:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788573615.651063:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573615.651081:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573616.291005:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788573616.291047:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573616.291056:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788573616.291061:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573616.291071:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1961
00000100:00080000:0.0:1788573616.291084:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573616.291092:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788573616.291142:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453360914560/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573616.291176:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573616.291184:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573616.291185:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573616.291189:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1961
00000100:00080000:0.0:1788573616.291193:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573616.291197:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573616.291209:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573616.291222:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453360914688/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573616.291231:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573616.291235:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573616.291238:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788573616.291239:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360914560:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788573616.291243:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1961
00000100:00080000:0.0:1788573616.291248:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573616.291253:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573616.291256:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573616.291264:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453360914816/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573616.291271:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573616.291274:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573616.291275:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573616.291277:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1961
00000100:00080000:0.0:1788573616.291279:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573616.291281:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573616.291285:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573616.291293:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453360914944/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573616.291304:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573616.291307:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573616.291309:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573616.291312:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1961
00000100:00080000:0.0:1788573616.291314:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573616.291316:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573616.291319:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788573616.291326:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573616.291330:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453360915072/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573616.291338:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573616.291341:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573616.291343:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573616.291347:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1961
00000100:00080000:0.0:1788573616.291351:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573616.291353:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573616.291356:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573616.291365:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453360915200/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573616.291373:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573616.291377:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573616.291379:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573616.291384:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1961
00000100:00080000:0.0:1788573616.291388:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788573616.291391:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573616/real 1788573616]  req@ffff8dc006712a00 x1875453360914560/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573641 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573616.291396:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573616.291406:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573616.291424:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453360915328/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573616.291434:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453360914560/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573641 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573616.291446:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573616.291450:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573616.291455:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360914560:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788573616.291481:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360914688:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573616.291500:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573616.291510:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573616/real 1788573616]  req@ffff8dc006710380 x1875453360914688/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573641 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573616.291518:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453360914688/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573641 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573616.291527:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573616.291529:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573616.291531:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360914688:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573616.291535:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360914816:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573616.291549:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573616.291556:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573616/real 1788573616]  req@ffff8dc006712680 x1875453360914816/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573641 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573616.291564:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453360914816/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573641 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573616.291575:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573616.291577:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573616.291579:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360914816:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573616.291583:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360914944:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573616.291593:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573616.291599:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573616/real 1788573616]  req@ffff8dc006713480 x1875453360914944/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573641 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573616.291606:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453360914944/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573641 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573616.291612:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573616.291614:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573616.291616:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360914944:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573616.291619:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360915072:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573616.291633:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573616.291644:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573616/real 1788573616]  req@ffff8dc006711c00 x1875453360915072/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573641 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573616.291655:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453360915072/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573641 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573616.291664:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573616.291668:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573616.291673:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360915072:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573616.291680:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360915200:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573616.291698:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573616.291706:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573616/real 1788573616]  req@ffff8dc006711500 x1875453360915200/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573641 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573616.291714:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453360915200/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573641 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573616.291719:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573616.291721:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573616.291724:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360915200:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573616.291727:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360915328:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573616.291738:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573616.291743:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573616/real 1788573616]  req@ffff8dc006713b80 x1875453360915328/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573641 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573616.291751:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453360915328/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573641 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573616.291756:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573616.291757:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573616.291759:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360915328:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573616.675026:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573616.675033:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573616.675034:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573616.675037:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573616.675082:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788573616.675128:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573617.314993:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573617.698989:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573617.699003:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573617.699038:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573617.699050:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788573617.699067:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573617.699075:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573618.339086:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573618.722980:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573618.722980:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573618.722980:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573618.722982:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573618.723009:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788573618.723076:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573619.362977:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573619.746938:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573619.746938:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573619.746951:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573619.746968:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788573619.746974:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573619.746987:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573620.386997:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573620.770967:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573620.770967:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573620.770967:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573620.770997:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573620.771000:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788573620.771010:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573621.410958:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788573621.411017:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573621.411023:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788573621.411028:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573621.411038:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1967
00000100:00080000:2.0:1788573621.411048:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573621.411057:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573621.411093:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453360915456/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573621.411123:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573621.411127:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573621.411129:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573621.411134:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1967
00000100:00080000:2.0:1788573621.411139:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573621.411145:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573621.411156:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573621.411166:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360915456:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788573621.411174:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453360915584/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573621.411187:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573621.411191:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573621.411193:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573621.411198:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1967
00000100:00080000:2.0:1788573621.411202:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573621.411207:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573621.411212:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573621.411224:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453360915712/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573621.411234:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573621.411239:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573621.411240:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573621.411244:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1967
00000100:00080000:2.0:1788573621.411248:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573621.411252:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573621.411258:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573621.411277:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453360915840/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788573621.411278:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360915584:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788573621.411295:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573621.411299:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573621.411301:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573621.411307:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1967
00000100:00080000:2.0:1788573621.411312:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573621.411317:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573621.411323:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573621.411334:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360915712:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573621.411340:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453360915968/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573621.411350:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573621.411354:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573621.411356:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573621.411362:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1967
00000100:00080000:2.0:1788573621.411366:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573621.411372:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788573621.411373:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360915840:192.168.202.140@tcp:8:kworker.0
00000008:00100000:2.0:1788573621.411379:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573621.411396:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453360916096/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788573621.411404:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360915968:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788573621.411409:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573621.411414:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573621.411416:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573621.411422:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1967
00000100:00080000:2.0:1788573621.411427:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788573621.411428:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360916096:192.168.202.140@tcp:8:kworker.0
00000100:00080000:2.0:1788573621.411434:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573621.411440:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573621.411454:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453360916224/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573621.411525:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360916224:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573621.794995:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573621.794999:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573621.795023:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573621.795029:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788573621.795031:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573621.795047:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573622.434986:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573622.818948:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573622.818948:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573622.818949:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573622.818950:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573622.818983:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788573622.819041:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573623.458915:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573623.842969:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573623.842988:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573623.843001:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788573623.843015:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573623.843027:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573623.843045:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573624.482982:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000400:00000100:3.0:1788573624.483205:0:2335:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.140:988
00000400:00000100:3.0:1788573624.483264:0:2335:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.140@tcp at host 192.168.202.140 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:3.0:1788573624.483303:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788573624.483363:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788573624.483376:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788573624.483385:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788573624.483395:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788573624.483408:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788573624.483422:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:0.0:1788573624.483444:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573621/real 1788573624]  req@ffff8dc020494380 x1875453360916096/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573646 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573624.483477:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453360916096/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573646 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573624.483492:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573624.483499:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573624.483504:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360916096:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573624.483514:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573621/real 1788573624]  req@ffff8dc020496d80 x1875453360915840/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573646 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573624.483527:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453360915840/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573646 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573624.483536:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573624.483541:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573624.483545:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360915840:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573624.483553:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573621/real 1788573624]  req@ffff8dc020494a80 x1875453360915968/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573646 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573624.483566:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453360915968/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573646 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573624.483576:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573624.483581:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573624.483584:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360915968:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573624.483592:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573621/real 1788573624]  req@ffff8dc020497480 x1875453360915584/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573646 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573624.483605:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453360915584/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573646 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573624.483616:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573624.483620:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573624.483624:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360915584:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573624.483632:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573621/real 1788573624]  req@ffff8dc020495180 x1875453360915712/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573646 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573624.483645:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453360915712/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573646 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573624.483655:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573624.483659:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573624.483663:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360915712:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573624.483671:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573621/real 1788573624]  req@ffff8dc020495880 x1875453360915456/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573646 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573624.483685:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453360915456/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573646 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573624.483693:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573624.483698:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573624.483702:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360915456:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788573624.483742:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573621/real 1788573624]  req@ffff8dc020494000 x1875453360916224/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573646 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573624.483758:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453360916224/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573646 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573624.483767:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573624.483771:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573624.483775:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360916224:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573624.866996:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573624.866996:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573624.866996:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573624.866996:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573624.867064:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788573624.867155:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573625.506919:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573625.890992:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573625.890992:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573625.891042:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573625.891050:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573625.891080:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788573625.891088:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1788573626.530992:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573626.531004:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:0.0:1788573626.531009:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788573626.531009:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573626.531023:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1972
00000100:00080000:2.0:1788573626.531034:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573626.531042:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573626.531078:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453360916352/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573626.531103:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573626.531106:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573626.531108:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573626.531111:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1972
00000100:00080000:2.0:1788573626.531117:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573626.531123:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788573626.531134:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360916352:192.168.202.140@tcp:250:kworker.0
00000008:00100000:2.0:1788573626.531135:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573626.531157:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453360916480/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573626.531169:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573626.531173:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573626.531175:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573626.531179:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1972
00000100:00080000:2.0:1788573626.531184:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573626.531189:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573626.531194:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573626.531208:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453360916608/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573626.531221:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573626.531224:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573626.531226:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1788573626.531229:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788573626.531235:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1972
00000100:00080000:2.0:1788573626.531240:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573626.531245:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573626.531252:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573626.531266:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453360916736/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573626.531276:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788573626.531282:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573626/real 1788573626]  req@ffff8dc020497100 x1875453360916352/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573651 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573626.531283:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:0.0:1788573626.531304:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453360916352/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573651 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573626.531305:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573626.531316:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1972
00000100:00080000:2.0:1788573626.531324:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573626.531326:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573626.531331:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:0.0:1788573626.531336:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000008:00100000:2.0:1788573626.531341:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573626.531344:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360916352:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788573626.531361:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453360916864/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573626.531374:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788573626.531378:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360916480:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788573626.531381:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573626.531387:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573626.531395:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1972
00000100:00080000:2.0:1788573626.531400:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573626.531405:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573626.531412:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788573626.531414:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573626.531431:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453360916992/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788573626.531436:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573626/real 1788573626]  req@ffff8dc020494e00 x1875453360916480/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573651 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573626.531459:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573626.531464:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573626.531466:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573626.531475:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1972
00000100:00080000:2.0:1788573626.531481:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788573626.531483:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453360916480/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573651 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573626.531489:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573626.531500:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1788573626.531506:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573626.531513:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573626.531518:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453360917120/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788573626.531520:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360916480:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573626.531536:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360916608:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573626.531563:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573626.531576:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573626/real 1788573626]  req@ffff8dc020496a00 x1875453360916608/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573651 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573626.531589:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453360916608/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573651 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573626.531597:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573626.531600:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573626.531604:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360916608:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573626.531610:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360916736:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573626.531630:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573626.531641:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573626/real 1788573626]  req@ffff8dc020494700 x1875453360916736/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573651 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573626.531653:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453360916736/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573651 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573626.531661:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573626.531664:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573626.531667:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360916736:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573626.531684:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360916864:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788573626.531702:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573626.531719:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573626/real 1788573626]  req@ffff8dc020495500 x1875453360916864/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573651 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573626.531731:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453360916864/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573651 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573626.531739:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573626.531742:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573626.531745:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360916864:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573626.531751:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360916992:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573626.531787:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573626.531799:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573626/real 1788573626]  req@ffff8dc020497100 x1875453360916992/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573651 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573626.531810:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453360916992/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573651 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573626.531824:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573626.531827:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573626.531831:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360916992:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573626.531838:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360917120:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573626.531859:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573626.531905:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573626/real 1788573626]  req@ffff8dc020494000 x1875453360917120/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573651 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573626.531918:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453360917120/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573651 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573626.531928:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573626.531931:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573626.531934:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360917120:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573626.914950:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573626.914954:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573626.914974:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573626.914997:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573626.915005:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788573626.915022:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573627.554916:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573627.939014:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573627.939017:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573627.939029:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573627.939061:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573627.939064:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573627.939089:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573628.578999:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573628.962962:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573628.962989:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573628.963032:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573628.963036:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788573628.963037:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573628.963057:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573629.602949:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573629.986995:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573629.987005:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573629.987006:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573629.987058:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573629.987087:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573629.987095:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573630.626982:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573631.011012:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573631.011012:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573631.011012:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573631.011058:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788573631.011060:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573631.011060:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00080000:2.0:1788573631.650990:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788573631.650991:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788573631.651005:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788573631.651011:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573631.651022:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1977
00000100:00080000:2.0:1788573631.651035:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573631.651044:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573631.651088:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453360917248/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573631.651119:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573631.651122:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573631.651123:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573631.651127:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1977
00000100:00080000:2.0:1788573631.651129:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573631.651131:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573631.651141:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573631.651152:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453360917376/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573631.651159:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573631.651163:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573631.651164:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573631.651167:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1977
00000100:00080000:2.0:1788573631.651169:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573631.651172:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573631.651176:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573631.651183:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360917248:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788573631.651187:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453360917504/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573631.651204:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573631.651207:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573631.651208:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573631.651211:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1977
00000100:00080000:2.0:1788573631.651213:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573631.651215:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573631.651218:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573631.651226:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453360917632/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573631.651233:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573631.651236:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573631.651238:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573631.651241:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1977
00000100:00080000:2.0:1788573631.651245:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573631.651249:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573631.651252:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573631.651260:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453360917760/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573631.651266:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573631.651269:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573631.651271:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1788573631.651279:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788573631.651283:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1977
00000100:00080000:2.0:1788573631.651288:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573631.651292:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573631.651296:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573631.651307:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453360917888/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573631.651314:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573631.651317:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573631.651318:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573631.651324:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1977
00000100:00100000:0.0:1788573631.651326:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573631/real 1788573631]  req@ffff8dc020495880 x1875453360917248/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573656 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573631.651328:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573631.651341:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573631.651354:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573631.651361:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453360917248/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573656 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573631.651372:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1788573631.651374:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453360918016/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573631.651379:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573631.651387:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360917248:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788573631.651408:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360917376:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788573631.651448:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573631.651462:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573631/real 1788573631]  req@ffff8dc020495180 x1875453360917376/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573656 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573631.651475:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453360917376/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573656 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573631.651485:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573631.651488:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573631.651492:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360917376:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573631.651518:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360917504:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573631.651539:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573631.651550:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573631/real 1788573631]  req@ffff8dc020497480 x1875453360917504/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573656 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573631.651562:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453360917504/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573656 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573631.651570:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573631.651573:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573631.651576:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360917504:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573631.651582:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360917632:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573631.651603:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573631.651615:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573631/real 1788573631]  req@ffff8dc020494a80 x1875453360917632/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573656 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573631.651627:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453360917632/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573656 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573631.651636:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573631.651639:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573631.651641:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360917632:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573631.651645:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360917760:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788573631.651660:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573631.651668:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573631/real 1788573631]  req@ffff8dc020496d80 x1875453360917760/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573656 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573631.651677:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453360917760/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573656 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573631.651716:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573631.651720:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573631.651724:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360917760:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573631.651731:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360917888:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573631.651751:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573631.651759:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573631/real 1788573631]  req@ffff8dc020494380 x1875453360917888/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573656 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573631.651767:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453360917888/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573656 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573631.651773:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573631.651775:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573631.651777:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360917888:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573631.651781:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360918016:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573631.651792:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573631.651798:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573631/real 1788573631]  req@ffff8dc020494000 x1875453360918016/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573656 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573631.651804:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453360918016/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573656 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573631.651809:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573631.651811:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573631.651814:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360918016:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573632.035046:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573632.035046:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573632.035047:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573632.035086:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573632.035129:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573632.035154:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573632.675012:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573633.059003:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573633.059003:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573633.059003:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788573633.059034:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573633.059039:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573633.059040:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573633.698967:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573634.082995:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573634.082995:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573634.082996:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573634.083032:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573634.083075:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573634.083089:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573634.722986:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573635.106955:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573635.106958:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573635.106992:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573635.107021:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573635.107025:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788573635.107032:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573635.747011:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573636.130995:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573636.130995:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573636.131005:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573636.131019:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573636.131042:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573636.131081:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573636.770981:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788573636.771017:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573636.771026:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788573636.771030:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573636.771038:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1982
00000100:00080000:0.0:1788573636.771047:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573636.771054:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788573636.771098:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453360918144/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573636.771131:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573636.771135:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573636.771137:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573636.771142:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1982
00000100:00080000:0.0:1788573636.771145:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573636.771150:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573636.771161:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573636.771177:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453360918272/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573636.771200:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360918144:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788573636.771205:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573636.771212:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573636.771215:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573636.771221:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1982
00000100:00080000:0.0:1788573636.771225:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573636.771234:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573636.771240:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573636.771254:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453360918400/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573636.771262:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573636.771265:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573636.771267:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573636.771269:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1982
00000100:00080000:0.0:1788573636.771272:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573636.771275:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573636.771278:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573636.771285:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453360918528/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573636.771293:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573636.771295:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573636.771297:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573636.771300:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1982
00000100:00080000:0.0:1788573636.771303:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573636.771305:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573636.771309:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788573636.771317:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573636.771318:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453360918656/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573636.771331:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573636.771333:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573636.771335:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573636.771338:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1982
00000100:00080000:0.0:1788573636.771340:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573636.771342:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573636.771346:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573636.771357:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453360918784/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573636.771362:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573636.771364:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573636.771366:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573636.771368:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1982
00000100:00080000:0.0:1788573636.771372:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573636.771376:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573636.771381:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573636.771405:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453360918912/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573636.771405:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573636/real 1788573636]  req@ffff8dc006710e00 x1875453360918144/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573661 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573636.771472:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453360918144/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573661 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573636.771487:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573636.771492:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573636.771497:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360918144:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788573636.771527:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360918272:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573636.771550:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573636.771560:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573636/real 1788573636]  req@ffff8dc006712300 x1875453360918272/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573661 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573636.771569:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453360918272/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573661 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573636.771578:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573636.771581:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573636.771583:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360918272:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573636.771588:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360918400:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573636.771601:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573636.771635:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573636/real 1788573636]  req@ffff8dc006713100 x1875453360918400/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573661 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573636.771650:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453360918400/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573661 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573636.771657:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573636.771659:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573636.771661:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360918400:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573636.771666:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360918528:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573636.771682:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573636.771689:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573636/real 1788573636]  req@ffff8dc006713800 x1875453360918528/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573661 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573636.771697:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453360918528/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573661 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573636.771703:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573636.771706:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573636.771708:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360918528:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573636.771711:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360918656:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573636.771722:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573636.771728:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573636/real 1788573636]  req@ffff8dc006711880 x1875453360918656/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573661 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573636.771735:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453360918656/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573661 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573636.771746:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573636.771748:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573636.771750:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360918656:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573636.771754:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360918784:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573636.771765:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573636.771771:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573636/real 1788573636]  req@ffff8dc006713b80 x1875453360918784/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573661 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573636.771779:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453360918784/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573661 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573636.771784:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573636.771786:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573636.771788:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360918784:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573636.771792:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360918912:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573636.771802:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573636.771807:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573636/real 1788573636]  req@ffff8dc006711500 x1875453360918912/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573661 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573636.771815:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453360918912/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573661 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573636.771820:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573636.771822:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573636.771825:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360918912:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573637.154976:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573637.154976:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573637.154977:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573637.155018:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573637.155020:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788573637.155043:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573637.795037:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573638.179000:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573638.179000:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573638.179135:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573638.179146:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573638.179164:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788573638.179217:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573638.819002:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573639.202961:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573639.202983:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573639.203005:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788573639.203011:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573639.203025:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573639.203027:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573639.843026:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573640.226974:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573640.227009:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573640.227028:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573640.227033:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573640.227055:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573640.227062:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573640.866965:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573641.250946:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573641.250971:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573641.250971:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573641.251018:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573641.251019:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788573641.251022:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1788573641.890980:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573641.890989:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788573641.890993:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573641.891003:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1987
00000100:00100000:2.0:1788573641.891008:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788573641.891013:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573641.891025:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788573641.891060:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453360919040/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573641.891084:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573641.891087:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573641.891089:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573641.891091:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1987
00000100:00080000:0.0:1788573641.891094:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573641.891096:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573641.891105:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573641.891114:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453360919168/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573641.891122:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573641.891124:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573641.891126:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573641.891129:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1987
00000100:00080000:0.0:1788573641.891131:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573641.891133:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573641.891136:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573641.891143:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453360919296/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573641.891150:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573641.891153:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:3.0:1788573641.891153:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360919040:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788573641.891157:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573641.891164:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1987
00000100:00080000:0.0:1788573641.891167:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573641.891169:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573641.891172:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573641.891189:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453360919424/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573641.891196:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573641.891198:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573641.891200:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573641.891202:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1987
00000100:00080000:0.0:1788573641.891214:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573641.891219:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:3.0:1788573641.891225:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:0.0:1788573641.891227:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573641.891241:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453360919552/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573641.891260:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573641.891264:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573641.891266:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573641.891271:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1987
00000100:00080000:0.0:1788573641.891275:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788573641.891280:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573641/real 1788573641]  req@ffff8dc006711c00 x1875453360919040/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573666 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573641.891281:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573641.891291:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573641.891302:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453360919040/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573666 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573641.891311:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453360919680/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573641.891314:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573641.891322:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573641.891329:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360919040:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788573641.891333:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788573641.891338:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360919168:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788573641.891339:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573641.891344:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573641.891348:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1987
00000100:00080000:0.0:1788573641.891351:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573641.891355:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573641.891360:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788573641.891364:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573641.891374:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573641/real 1788573641]  req@ffff8dc006713480 x1875453360919168/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573666 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573641.891382:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453360919808/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573641.891396:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453360919168/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573666 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573641.891411:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573641.891415:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573641.891420:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360919168:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573641.891446:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360919296:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573641.891463:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573641.891471:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573641/real 1788573641]  req@ffff8dc006712680 x1875453360919296/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573666 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573641.891480:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453360919296/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573666 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573641.891494:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573641.891496:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573641.891499:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360919296:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573641.891503:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360919424:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573641.891515:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573641.891521:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573641/real 1788573641]  req@ffff8dc006710380 x1875453360919424/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573666 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573641.891532:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453360919424/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573666 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573641.891576:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573641.891580:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573641.891584:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360919424:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573641.891591:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360919552:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573641.891613:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573641.891626:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573641/real 1788573641]  req@ffff8dc006712a00 x1875453360919552/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573666 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573641.891636:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453360919552/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573666 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573641.891642:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573641.891644:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573641.891647:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360919552:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573641.891651:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360919680:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573641.891665:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573641.891680:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573641/real 1788573641]  req@ffff8dc006711500 x1875453360919680/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573666 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573641.891689:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453360919680/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573666 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573641.891698:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573641.891702:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573641.891706:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360919680:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573641.891712:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360919808:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573641.891733:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573641.891746:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573641/real 1788573641]  req@ffff8dc006713b80 x1875453360919808/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573666 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573641.891759:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453360919808/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573666 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573641.891775:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573641.891779:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573641.891782:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360919808:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573642.274993:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573642.274993:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573642.275019:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573642.275051:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573642.275075:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573642.275087:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573642.914969:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573643.299044:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573643.299044:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573643.299046:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573643.299047:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573643.299102:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788573643.299178:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573643.939034:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573644.322995:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573644.322995:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573644.322995:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573644.322999:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573644.323035:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573644.323074:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573644.962994:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573645.347008:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573645.347008:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573645.347008:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573645.347008:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573645.347045:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788573645.347111:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573645.986977:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573646.370928:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573646.370967:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573646.370996:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573646.371001:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573646.371066:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573646.371120:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1788573647.011004:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573647.011019:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788573647.011027:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788573647.011041:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788573647.011043:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1992
00000100:00080000:0.0:1788573647.011081:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573647.011094:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788573647.011177:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453360919936/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573647.011228:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573647.011233:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573647.011235:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573647.011240:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1992
00000100:00080000:0.0:1788573647.011244:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573647.011249:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573647.011262:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573647.011299:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453360920064/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573647.011310:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573647.011313:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573647.011315:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573647.011319:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1992
00000100:00080000:0.0:1788573647.011324:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788573647.011327:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360919936:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788573647.011332:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573647.011343:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573647.011357:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453360920192/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573647.011367:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573647.011371:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573647.011373:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573647.011376:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1992
00000100:00080000:0.0:1788573647.011380:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573647.011383:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573647.011388:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573647.011399:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453360920320/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573647.011413:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573647.011418:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573647.011420:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1788573647.011427:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788573647.011430:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1992
00000100:00080000:0.0:1788573647.011439:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573647.011447:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573647.011456:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573647.011499:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453360920448/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573647.011510:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573647/real 1788573647]  req@ffff8dc006711880 x1875453360919936/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573672 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573647.011512:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573647.011524:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573647.011529:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573647.011542:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1992
00000100:00080000:0.0:1788573647.011549:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788573647.011550:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453360919936/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573672 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573647.011564:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:3.0:1788573647.011573:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1788573647.011577:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788573647.011581:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573647.011588:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360919936:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788573647.011598:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360920064:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573647.011605:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453360920576/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573647.011618:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573647.011622:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573647.011625:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573647.011632:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1992
00000800:00000100:3.0:1788573647.011632:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788573647.011642:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573647.011647:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573647.011654:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573647.011657:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573647/real 1788573647]  req@ffff8dc006713800 x1875453360920064/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573672 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573647.011670:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453360920704/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573647.011690:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453360920064/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573672 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573647.011711:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573647.011717:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573647.011722:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360920064:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573647.011759:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360920192:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573647.011788:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573647.011801:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573647/real 1788573647]  req@ffff8dc006713100 x1875453360920192/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573672 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573647.011814:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453360920192/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573672 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573647.011823:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573647.011829:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573647.011832:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360920192:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573647.011838:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360920320:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573647.011860:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573647.011910:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573647/real 1788573647]  req@ffff8dc006712300 x1875453360920320/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573672 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573647.011924:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453360920320/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573672 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573647.011946:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573647.011951:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573647.011956:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360920320:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573647.011964:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360920448:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573647.011996:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573647.012013:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573647/real 1788573647]  req@ffff8dc006710e00 x1875453360920448/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573672 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573647.012024:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453360920448/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573672 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573647.012034:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573647.012036:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573647.012039:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360920448:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573647.012045:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360920576:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573647.012065:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573647.012073:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573647/real 1788573647]  req@ffff8dc006713b80 x1875453360920576/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573672 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573647.012084:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453360920576/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573672 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573647.012090:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573647.012093:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573647.012096:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360920576:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573647.012102:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360920704:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573647.012116:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573647.012124:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573647/real 1788573647]  req@ffff8dc006711500 x1875453360920704/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573672 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573647.012134:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453360920704/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573672 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573647.012142:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573647.012144:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573647.012146:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360920704:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573647.395017:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573647.395017:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573647.395027:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573647.395060:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573647.395079:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788573647.395081:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573648.035005:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573648.418963:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573648.419011:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573648.419015:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573648.419165:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573648.419165:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573648.419183:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573649.058952:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573649.443013:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573649.443013:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573649.443019:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573649.443036:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573649.443058:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573649.443068:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573650.082993:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573650.466975:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573650.466975:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573650.466981:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573650.467058:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573650.467146:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573650.467171:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573651.106975:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573651.491007:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573651.491008:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573651.491017:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573651.491037:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573651.491055:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573651.491082:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573652.131017:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573652.131052:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573652.131060:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788573652.131064:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573652.131073:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 1997
00000100:00080000:1.0:1788573652.131082:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573652.131088:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573652.131129:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453360920832/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573652.131161:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573652.131165:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573652.131166:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573652.131170:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1997
00000100:00080000:1.0:1788573652.131172:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573652.131175:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573652.131184:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573652.131196:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360920960/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573652.131204:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573652.131207:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573652.131209:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573652.131212:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1997
00000100:00080000:1.0:1788573652.131214:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573652.131216:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573652.131220:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573652.131226:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360921088/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573652.131233:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360920832:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788573652.131235:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573652.131241:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573652.131244:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573652.131248:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 1997
00000100:00080000:1.0:1788573652.131251:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573652.131253:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573652.131255:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573652.131270:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360921216/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573652.131277:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573652.131279:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573652.131280:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573652.131284:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1997
00000100:00080000:1.0:1788573652.131292:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573652.131297:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:3.0:1788573652.131302:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:1.0:1788573652.131306:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573652.131323:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360921344/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573652.131334:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573652.131337:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573652.131339:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788573652.131343:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573652/real 1788573652]  req@ffff8dc005dc3800 x1875453360920832/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573677 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573652.131344:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1997
00000100:00080000:1.0:1788573652.131350:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573652.131357:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573652.131363:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573652.131385:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453360920832/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573677 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573652.131390:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360921472/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573652.131404:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573652.131406:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573652.131411:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573652.131414:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573652.131415:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788573652.131419:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 1997
00000100:00080000:1.0:1788573652.131423:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788573652.131426:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360920832:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788573652.131429:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573652.131435:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573652.131443:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360920960:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573652.131445:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360921600/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788573652.131477:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573652.131491:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573652/real 1788573652]  req@ffff8dc005dc1500 x1875453360920960/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573677 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573652.131500:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360920960/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573677 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573652.131508:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573652.131510:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573652.131513:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360920960:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573652.131532:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360921088:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573652.131545:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573652.131553:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573652/real 1788573652]  req@ffff8dc005dc0700 x1875453360921088/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573677 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573652.131560:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453360921088/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573677 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573652.131567:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573652.131569:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573652.131571:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360921088:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573652.131574:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360921216:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573652.131585:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573652.131591:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573652/real 1788573652]  req@ffff8dc005dc1180 x1875453360921216/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573677 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573652.131599:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360921216/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573677 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573652.131604:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573652.131606:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573652.131608:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360921216:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573652.131612:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360921344:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573652.131622:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573652.131628:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573652/real 1788573652]  req@ffff8dc005dc2d80 x1875453360921344/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573677 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573652.131635:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360921344/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573677 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573652.131640:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573652.131642:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573652.131644:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360921344:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573652.131648:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360921472:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573652.131658:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573652.131664:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573652/real 1788573652]  req@ffff8dc005dc1c00 x1875453360921472/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573677 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573652.131676:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453360921472/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573677 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573652.131681:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573652.131683:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573652.131686:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360921472:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573652.131692:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360921600:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573652.131710:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573652.131721:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573652/real 1788573652]  req@ffff8dc005dc3b80 x1875453360921600/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573677 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573652.131735:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360921600/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573677 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573652.131744:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573652.131747:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573652.131751:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360921600:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573652.514991:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573652.514993:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573652.515000:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573652.515015:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573652.515042:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573652.515112:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573653.155029:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573653.539025:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573653.539025:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573653.539031:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573653.539032:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573653.539077:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573653.539122:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573654.178992:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573654.563000:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573654.563008:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573654.563008:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573654.563015:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573654.563045:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573654.563108:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573655.202954:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573655.587008:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573655.587008:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573655.587017:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573655.587025:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573655.587069:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573655.587119:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573656.226993:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573656.611001:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573656.611001:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573656.611001:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573656.611095:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573656.611122:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573656.611149:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573657.251012:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788573657.251020:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573657.251028:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788573657.251033:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573657.251044:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2002
00000100:00080000:2.0:1788573657.251056:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573657.251064:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573657.251111:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453360921728/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573657.251140:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573657.251143:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573657.251144:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573657.251148:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2002
00000100:00080000:2.0:1788573657.251151:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573657.251155:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573657.251166:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573657.251178:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360921728:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788573657.251182:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453360921856/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573657.251191:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573657.251193:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573657.251195:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573657.251198:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2002
00000100:00080000:2.0:1788573657.251202:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573657.251205:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573657.251210:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573657.251221:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453360921984/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573657.251228:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573657.251231:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573657.251233:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573657.251248:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2002
00000100:00080000:2.0:1788573657.251252:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573657.251255:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573657.251260:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573657.251270:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453360922112/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788573657.251276:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788573657.251281:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573657.251285:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573657.251286:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573657.251290:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2002
00000100:00080000:2.0:1788573657.251293:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573657.251297:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573657.251301:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573657.251310:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453360922240/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573657.251317:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573657.251319:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573657.251321:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573657.251325:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2002
00000100:00080000:2.0:1788573657.251328:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788573657.251334:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573657/real 1788573657]  req@ffff8dc020497100 x1875453360921728/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573682 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573657.251335:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573657.251344:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573657.251359:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453360921728/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573682 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573657.251364:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453360922368/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573657.251378:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573657.251382:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573657.251386:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573657.251387:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788573657.251389:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573657.251398:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2002
00000100:00100000:1.0:1788573657.251399:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360921728:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788573657.251402:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573657.251409:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573657.251415:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573657.251425:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453360922496/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788573657.251435:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360921856:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788573657.251460:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573657.251484:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573657/real 1788573657]  req@ffff8dc020495500 x1875453360921856/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573682 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573657.251494:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453360921856/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573682 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573657.251502:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573657.251505:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573657.251507:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360921856:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573657.251512:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360921984:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573657.251528:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573657.251536:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573657/real 1788573657]  req@ffff8dc020494700 x1875453360921984/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573682 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573657.251545:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453360921984/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573682 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573657.251551:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573657.251554:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573657.251557:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360921984:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573657.251561:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360922112:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573657.251574:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573657.251581:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573657/real 1788573657]  req@ffff8dc020496a00 x1875453360922112/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573682 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573657.251589:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453360922112/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573682 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573657.251596:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573657.251599:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573657.251601:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360922112:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573657.251607:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360922240:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788573657.251621:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573657.251630:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573657/real 1788573657]  req@ffff8dc020494e00 x1875453360922240/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573682 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573657.251641:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453360922240/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573682 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573657.251649:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573657.251652:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573657.251656:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360922240:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573657.251663:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360922368:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573657.251676:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573657.251683:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573657/real 1788573657]  req@ffff8dc020494000 x1875453360922368/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573682 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573657.251691:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453360922368/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573682 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573657.251696:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573657.251698:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573657.251700:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360922368:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573657.251713:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360922496:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573657.251724:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573657.251730:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573657/real 1788573657]  req@ffff8dc020494380 x1875453360922496/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573682 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573657.251738:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453360922496/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573682 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573657.251748:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573657.251750:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573657.251752:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360922496:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573657.635009:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573657.635009:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573657.635009:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573657.635009:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573657.635049:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573657.635092:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573658.274980:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573658.659014:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573658.659014:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573658.659014:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573658.659032:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573658.659065:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573658.659138:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573659.298973:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573659.682997:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573659.683031:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573659.683033:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573659.683033:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573659.683080:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573659.683127:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573660.322977:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573660.706992:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573660.706993:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573660.706994:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573660.707023:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573660.707078:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573660.707082:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573661.346987:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573661.730965:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573661.730965:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573661.730965:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573661.730965:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573661.730997:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573661.731029:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1788573662.370973:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573662.370988:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788573662.370994:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788573662.370999:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573662.371007:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2008
00000100:00080000:1.0:1788573662.371020:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573662.371029:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573662.371072:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453360922624/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573662.371103:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573662.371106:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573662.371119:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573662.371125:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2008
00000100:00080000:1.0:1788573662.371129:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573662.371134:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573662.371149:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573662.371157:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360922624:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788573662.371170:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360922752/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573662.371186:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573662.371189:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573662.371191:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573662.371196:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2008
00000100:00080000:1.0:1788573662.371201:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573662.371207:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573662.371214:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573662.371229:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360922880/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788573662.371238:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788573662.371242:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573662.371246:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573662.371248:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573662.371252:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2008
00000100:00080000:1.0:1788573662.371257:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573662.371260:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573662.371265:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573662.371276:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360923008/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573662.371286:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788573662.371289:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573662/real 1788573662]  req@ffff8dc005dc0a80 x1875453360922624/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573687 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573662.371292:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573662.371298:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573662.371308:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2008
00000100:00100000:3.0:1788573662.371313:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453360922624/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573687 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573662.371314:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573662.371327:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:3.0:1788573662.371327:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573662.371336:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000008:00100000:1.0:1788573662.371338:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573662.371340:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360922624:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788573662.371359:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360923136/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573662.371368:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360922752:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788573662.371370:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573662.371375:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573662.371377:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573662.371384:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2008
00000100:00080000:1.0:1788573662.371388:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1788573662.371391:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788573662.371396:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573662.371402:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573662.371406:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573662/real 1788573662]  req@ffff8dc005dc3b80 x1875453360922752/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573687 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573662.371416:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360923264/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573662.371419:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360922752/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573687 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573662.371440:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573662.371449:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573662.371453:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573662.371458:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573662.371459:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2008
00000100:00080000:1.0:1788573662.371465:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573662.371465:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788573662.371472:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573662.371473:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360922752:192.168.202.140@tcp:38:kworker.0
00000008:00100000:1.0:1788573662.371480:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573662.371483:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360922880:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573662.371492:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360923392/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788573662.371502:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573662.371510:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573662/real 1788573662]  req@ffff8dc005dc1c00 x1875453360922880/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573687 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573662.371519:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453360922880/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573687 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573662.371526:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573662.371529:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573662.371534:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360922880:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573662.371538:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360923008:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573662.371549:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573662.371554:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573662/real 1788573662]  req@ffff8dc005dc2d80 x1875453360923008/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573687 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573662.371562:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360923008/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573687 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573662.371568:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573662.371570:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573662.371573:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360923008:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573662.371584:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360923136:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573662.371595:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573662.371602:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573662/real 1788573662]  req@ffff8dc005dc1180 x1875453360923136/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573687 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573662.371612:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360923136/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573687 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573662.371622:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573662.371625:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573662.371629:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360923136:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573662.371636:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360923264:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573662.371657:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573662.371667:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573662/real 1788573662]  req@ffff8dc005dc0700 x1875453360923264/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573687 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573662.371679:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453360923264/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573687 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573662.371687:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573662.371690:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573662.371693:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360923264:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573662.371700:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360923392:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573662.371720:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573662.371732:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573662/real 1788573662]  req@ffff8dc005dc1500 x1875453360923392/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573687 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573662.371745:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360923392/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573687 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573662.371754:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573662.371758:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573662.371762:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360923392:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573662.754939:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573662.754962:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573662.754988:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573662.755009:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573662.755010:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573662.755069:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573663.394990:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573663.778940:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573663.778942:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573663.778961:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573663.778986:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573663.778990:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573663.778997:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573664.419000:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573664.802954:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573664.802960:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573664.802975:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573664.803000:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573664.803002:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573664.803014:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573665.442967:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573665.826982:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573665.826984:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573665.827008:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573665.827108:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573665.827118:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573665.827176:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573666.466966:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573666.851027:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573666.851028:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573666.851032:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573666.851064:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573666.851096:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573666.851102:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573667.490977:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573667.490997:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573667.491006:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788573667.491011:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573667.491023:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2013
00000100:00080000:1.0:1788573667.491036:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573667.491044:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573667.491096:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453360923520/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573667.491132:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573667.491135:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573667.491137:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573667.491140:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2013
00000100:00080000:1.0:1788573667.491143:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573667.491147:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573667.491158:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573667.491171:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360923648/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573667.491180:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573667.491183:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573667.491185:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573667.491188:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2013
00000100:00080000:1.0:1788573667.491190:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573667.491195:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573667.491197:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360923520:192.168.202.140@tcp:250:kworker.0
00000008:00100000:1.0:1788573667.491199:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573667.491213:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360923776/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573667.491220:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573667.491223:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573667.491224:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573667.491226:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2013
00000100:00080000:1.0:1788573667.491229:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573667.491231:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573667.491234:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573667.491242:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360923904/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573667.491249:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573667.491252:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573667.491253:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573667.491256:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2013
00000100:00080000:1.0:1788573667.491259:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573667.491262:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573667.491266:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573667.491275:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360924032/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788573667.491284:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788573667.491285:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573667.491291:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573667.491293:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573667.491297:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2013
00000100:00080000:1.0:1788573667.491299:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573667.491301:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573667.491304:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573667.491311:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360924160/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573667.491318:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573667.491320:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573667.491321:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573667.491323:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2013
00000100:00080000:1.0:1788573667.491325:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573667.491327:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573667.491330:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573667.491337:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360924288/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573667.491351:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573667/real 1788573667]  req@ffff8dc005dc3800 x1875453360923520/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573692 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573667.491386:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453360923520/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573692 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573667.491395:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573667.491399:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573667.491402:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360923520:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788573667.491410:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360923648:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573667.491430:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573667.491440:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573667/real 1788573667]  req@ffff8dc005dc1500 x1875453360923648/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573692 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573667.491449:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360923648/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573692 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573667.491457:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573667.491459:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573667.491462:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360923648:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573667.491485:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360923776:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573667.491497:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573667.491504:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573667/real 1788573667]  req@ffff8dc005dc0700 x1875453360923776/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573692 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573667.491511:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453360923776/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573692 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573667.491518:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573667.491520:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573667.491522:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360923776:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573667.491526:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360923904:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573667.491535:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573667.491541:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573667/real 1788573667]  req@ffff8dc005dc1180 x1875453360923904/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573692 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573667.491549:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360923904/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573692 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573667.491555:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573667.491556:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573667.491558:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360923904:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573667.491562:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360924032:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573667.491572:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573667.491578:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573667/real 1788573667]  req@ffff8dc005dc2d80 x1875453360924032/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573692 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573667.491595:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360924032/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573692 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573667.491601:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573667.491603:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573667.491605:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360924032:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573667.491609:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360924160:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573667.491620:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573667.491627:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573667/real 1788573667]  req@ffff8dc005dc1c00 x1875453360924160/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573692 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573667.491634:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453360924160/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573692 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573667.491645:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573667.491647:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573667.491649:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360924160:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573667.491652:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360924288:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573667.491662:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573667.491668:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573667/real 1788573667]  req@ffff8dc005dc3b80 x1875453360924288/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573692 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573667.491675:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360924288/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573692 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573667.491680:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573667.491682:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573667.491684:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360924288:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573667.874963:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573667.874992:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573667.875007:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573667.875011:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573667.875024:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573667.875037:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573668.515001:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573668.899007:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573668.899029:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573668.899048:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573668.899056:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573668.899077:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573668.899096:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573669.539016:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573669.922998:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573669.923019:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573669.923019:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573669.923019:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573669.923044:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573669.923121:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573670.563033:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573670.947036:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573670.947036:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573670.947087:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573670.947126:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573670.947145:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573670.947147:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573671.587002:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573671.970987:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573671.971015:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573671.971021:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573671.971021:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573671.971058:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573671.971061:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573672.610977:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573672.610995:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573672.611006:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788573672.611021:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573672.611034:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2018
00000100:00080000:1.0:1788573672.611054:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573672.611069:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573672.611125:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453360924416/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573672.611162:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573672.611167:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573672.611169:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573672.611174:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2018
00000100:00080000:1.0:1788573672.611179:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573672.611184:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573672.611198:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573672.611218:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360924416:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788573672.611219:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360924544/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573672.611238:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573672.611242:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573672.611244:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573672.611249:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2018
00000100:00080000:1.0:1788573672.611253:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573672.611257:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573672.611264:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573672.611280:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360924672/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573672.611303:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573672.611307:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573672.611310:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1788573672.611314:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788573672.611319:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2018
00000100:00080000:1.0:1788573672.611326:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573672.611333:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573672.611339:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573672.611354:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360924800/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573672.611366:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788573672.611371:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573672/real 1788573672]  req@ffff8dc005dc0a80 x1875453360924416/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573697 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573672.611373:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573672.611377:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573672.611388:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2018
00000100:00080000:1.0:1788573672.611395:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573672.611402:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573672.611408:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573672.611408:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453360924416/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573697 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573672.611426:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1788573672.611428:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360924928/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573672.611435:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573672.611445:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360924416:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788573672.611450:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573672.611455:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573672.611457:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573672.611463:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2018
00000100:00080000:1.0:1788573672.611467:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573672.611471:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573672.611477:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360924544:192.168.202.140@tcp:38:kworker.0
00000008:00100000:1.0:1788573672.611478:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573672.611497:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360925056/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788573672.611507:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788573672.611510:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573672.611516:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573672.611519:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788573672.611520:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573672/real 1788573672]  req@ffff8dc005dc3b80 x1875453360924544/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573697 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573672.611529:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2018
00000100:00080000:1.0:1788573672.611537:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788573672.611538:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360924544/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573697 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573672.611547:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:3.0:1788573672.611553:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:1.0:1788573672.611556:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788573672.611559:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573672.611564:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360924544:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573672.611576:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360924672:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573672.611577:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360925184/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788573672.611605:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573672.611620:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573672/real 1788573672]  req@ffff8dc005dc1c00 x1875453360924672/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573697 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573672.611632:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453360924672/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573697 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573672.611644:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573672.611646:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573672.611649:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360924672:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573672.611654:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360924800:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573672.611669:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573672.611676:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573672/real 1788573672]  req@ffff8dc005dc2d80 x1875453360924800/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573697 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573672.611683:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360924800/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573697 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573672.611690:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573672.611692:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573672.611694:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360924800:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573672.611698:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360924928:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573672.611708:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573672.611715:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573672/real 1788573672]  req@ffff8dc005dc1180 x1875453360924928/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573697 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573672.611721:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360924928/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573697 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573672.611728:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573672.611730:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573672.611733:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360924928:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573672.611747:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360925056:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573672.611758:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573672.611765:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573672/real 1788573672]  req@ffff8dc005dc0700 x1875453360925056/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573697 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573672.611773:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453360925056/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573697 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573672.611778:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573672.611780:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573672.611781:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360925056:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573672.611785:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360925184:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573672.611795:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573672.611801:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573672/real 1788573672]  req@ffff8dc005dc1500 x1875453360925184/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573697 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573672.611808:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360925184/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573697 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573672.611813:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573672.611815:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573672.611817:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360925184:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573672.995029:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573672.995049:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573672.995049:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573672.995050:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573672.995093:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788573672.995143:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573673.635032:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573674.018953:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573674.018953:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573674.018957:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573674.019003:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573674.019005:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573674.019024:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573674.658960:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573675.043029:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573675.043030:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573675.043030:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573675.043060:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573675.043095:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788573675.043096:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573675.682995:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573676.066958:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573676.066961:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573676.066972:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573676.066995:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573676.067011:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573676.067046:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573676.706960:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573677.090952:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573677.090959:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573677.090966:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573677.090990:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573677.090995:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573677.091010:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00080000:1.0:1788573677.730933:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788573677.730937:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573677.730941:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788573677.730946:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573677.730955:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2023
00000100:00080000:1.0:1788573677.730964:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573677.730970:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573677.731001:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453360925312/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573677.731025:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573677.731028:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573677.731029:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573677.731032:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2023
00000100:00080000:1.0:1788573677.731034:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573677.731037:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573677.731045:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573677.731054:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360925440/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573677.731061:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573677.731064:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573677.731065:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573677.731068:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2023
00000100:00080000:1.0:1788573677.731070:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573677.731079:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573677.731082:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573677.731094:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360925568/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573677.731106:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788573677.731107:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360925312:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788573677.731115:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573677.731118:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573677.731122:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2023
00000100:00080000:1.0:1788573677.731127:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573677.731131:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573677.731137:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573677.731150:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360925696/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573677.731157:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573677.731160:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573677.731161:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573677.731165:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2023
00000100:00080000:1.0:1788573677.731168:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573677.731172:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:3.0:1788573677.731173:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:1.0:1788573677.731179:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573677.731188:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360925824/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573677.731195:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573677.731197:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573677.731199:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573677.731201:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2023
00000100:00080000:1.0:1788573677.731203:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573677.731206:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573677.731210:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573677.731215:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573677/real 1788573677]  req@ffff8dc005dc3800 x1875453360925312/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573702 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573677.731219:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360925952/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573677.731240:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573677.731244:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:3.0:1788573677.731245:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453360925312/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573702 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573677.731246:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573677.731254:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2023
00000100:00080000:1.0:1788573677.731259:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573677.731265:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:3.0:1788573677.731267:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:1.0:1788573677.731268:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788573677.731274:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573677.731280:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360926080/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573677.731281:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360925312:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788573677.731293:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360925440:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573677.731313:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573677.731322:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573677/real 1788573677]  req@ffff8dc005dc1500 x1875453360925440/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573702 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573677.731329:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360925440/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573702 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573677.731336:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573677.731339:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573677.731341:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360925440:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573677.731358:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360925568:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573677.731370:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573677.731376:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573677/real 1788573677]  req@ffff8dc005dc0700 x1875453360925568/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573702 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573677.731384:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453360925568/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573702 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573677.731389:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573677.731391:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573677.731393:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360925568:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573677.731396:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360925696:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573677.731405:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573677.731411:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573677/real 1788573677]  req@ffff8dc005dc1180 x1875453360925696/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573702 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573677.731418:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360925696/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573702 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573677.731423:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573677.731425:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573677.731427:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360925696:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573677.731430:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360925824:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573677.731440:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573677.731446:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573677/real 1788573677]  req@ffff8dc005dc2d80 x1875453360925824/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573702 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573677.731458:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360925824/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573702 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573677.731463:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573677.731465:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573677.731467:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360925824:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573677.731470:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360925952:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573677.731479:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573677.731485:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573677/real 1788573677]  req@ffff8dc005dc1c00 x1875453360925952/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573702 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573677.731492:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453360925952/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573702 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573677.731497:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573677.731499:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573677.731501:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360925952:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573677.731504:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360926080:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573677.731512:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573677.731518:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573677/real 1788573677]  req@ffff8dc005dc3b80 x1875453360926080/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573702 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573677.731524:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360926080/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573702 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573677.731533:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573677.731535:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573677.731538:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360926080:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573678.114996:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573678.115019:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573678.115019:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573678.115020:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573678.115062:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573678.115122:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573678.755064:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573679.139019:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573679.139019:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573679.139041:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573679.139072:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573679.139076:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573679.139090:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573679.778971:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573680.162980:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573680.162980:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573680.162981:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573680.162981:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573680.163017:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573680.163062:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573680.802967:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573681.186963:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573681.186963:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573681.186964:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573681.187000:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573681.187010:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788573681.187022:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573681.826952:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573682.210972:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573682.210972:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573682.210972:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573682.210972:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573682.211009:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573682.211044:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1788573682.851008:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788573682.851014:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573682.851024:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788573682.851029:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573682.851043:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2028
00000100:00080000:1.0:1788573682.851055:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573682.851063:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573682.851107:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453360926208/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573682.851133:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573682.851137:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573682.851138:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573682.851141:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2028
00000100:00080000:1.0:1788573682.851144:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573682.851146:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573682.851156:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573682.851168:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360926336/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573682.851181:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573682.851185:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573682.851186:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573682.851190:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2028
00000100:00080000:1.0:1788573682.851192:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573682.851195:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573682.851201:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360926208:192.168.202.140@tcp:250:kworker.0
00000008:00100000:1.0:1788573682.851202:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573682.851212:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360926464/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573682.851220:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573682.851223:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573682.851224:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573682.851227:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2028
00000100:00080000:1.0:1788573682.851229:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573682.851231:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573682.851234:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573682.851242:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360926592/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573682.851248:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573682.851251:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573682.851252:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573682.851255:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2028
00000100:00080000:1.0:1788573682.851257:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573682.851259:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573682.851263:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573682.851271:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360926720/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573682.851278:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573682.851281:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573682.851282:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573682.851284:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2028
00000100:00080000:1.0:1788573682.851287:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573682.851289:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573682.851292:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788573682.851296:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573682.851303:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360926848/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573682.851310:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573682.851313:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573682.851315:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573682.851319:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2028
00000100:00080000:1.0:1788573682.851322:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573682.851326:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573682.851332:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573682.851347:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360926976/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573682.851351:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573682/real 1788573682]  req@ffff8dc005dc0a80 x1875453360926208/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573707 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573682.851381:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453360926208/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573707 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573682.851391:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573682.851395:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573682.851399:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360926208:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788573682.851404:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360926336:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573682.851422:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573682.851431:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573682/real 1788573682]  req@ffff8dc005dc3b80 x1875453360926336/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573707 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573682.851440:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360926336/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573707 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573682.851448:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573682.851450:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573682.851453:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360926336:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573682.851477:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360926464:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573682.851491:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573682.851497:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573682/real 1788573682]  req@ffff8dc005dc1c00 x1875453360926464/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573707 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573682.851505:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453360926464/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573707 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573682.851511:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573682.851514:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573682.851516:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360926464:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573682.851519:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360926592:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573682.851539:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573682.851547:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573682/real 1788573682]  req@ffff8dc005dc2d80 x1875453360926592/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573707 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573682.851555:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360926592/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573707 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573682.851566:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573682.851569:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573682.851571:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360926592:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573682.851574:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360926720:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573682.851586:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573682.851613:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573682/real 1788573682]  req@ffff8dc005dc1180 x1875453360926720/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573707 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573682.851623:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360926720/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573707 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573682.851630:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573682.851633:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573682.851635:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360926720:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573682.851639:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360926848:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573682.851653:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573682.851661:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573682/real 1788573682]  req@ffff8dc005dc0700 x1875453360926848/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573707 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573682.851668:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453360926848/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573707 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573682.851673:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573682.851675:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573682.851678:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360926848:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573682.851682:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360926976:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573682.851692:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573682.851697:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573682/real 1788573682]  req@ffff8dc005dc1500 x1875453360926976/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573707 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573682.851704:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360926976/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573707 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573682.851710:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573682.851712:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573682.851714:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360926976:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573683.234997:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573683.235028:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573683.235028:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573683.235065:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788573683.235085:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573683.235086:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573683.874948:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573684.258971:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573684.258971:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573684.258971:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573684.258977:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573684.259005:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573684.259042:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573684.898976:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573685.282934:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573685.282950:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573685.282953:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573685.282979:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573685.282996:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788573685.282999:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573685.922947:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573686.307018:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573686.307018:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573686.307024:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573686.307026:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573686.307072:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573686.307118:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573686.946976:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573687.330982:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573687.330993:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573687.331026:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573687.331033:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573687.331043:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573687.331074:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573687.970936:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788573687.971004:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573687.971016:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788573687.971021:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573687.971035:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2033
00000100:00080000:3.0:1788573687.971049:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573687.971058:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573687.971125:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c000 x1875453360927104/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573687.971164:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573687.971169:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573687.971171:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573687.971177:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2033
00000100:00080000:3.0:1788573687.971182:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573687.971189:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573687.971203:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573687.971204:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360927104:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788573687.971218:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d500 x1875453360927232/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573687.971230:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573687.971235:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788573687.971237:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573687.971242:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2033
00000100:00080000:3.0:1788573687.971247:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573687.971252:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573687.971258:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573687.971271:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ea00 x1875453360927360/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573687.971279:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573687.971282:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788573687.971283:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573687.971286:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2033
00000100:00080000:3.0:1788573687.971290:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573687.971293:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573687.971297:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573687.971305:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ce00 x1875453360927488/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573687.971311:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573687.971314:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573687.971316:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573687.971319:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2033
00000100:00080000:3.0:1788573687.971321:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573687.971324:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573687.971328:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573687.971336:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ca80 x1875453360927616/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573687.971344:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788573687.971349:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360927232:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788573687.971349:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788573687.971352:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573687.971360:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2033
00000100:00080000:3.0:1788573687.971363:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573687.971366:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573687.971369:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573687.971380:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644dc00 x1875453360927744/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573687.971392:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788573687.971396:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360927360:192.168.202.140@tcp:8:kworker.0
00000100:00080000:3.0:1788573687.971408:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788573687.971414:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1788573687.971416:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360927488:192.168.202.140@tcp:8:kworker.0
00000100:00080000:3.0:1788573687.971424:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2033
00000100:00080000:3.0:1788573687.971430:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573687.971435:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573687.971440:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360927616:192.168.202.140@tcp:38:kworker.0
00000008:00100000:3.0:1788573687.971442:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573687.971460:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f800 x1875453360927872/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788573687.971486:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360927744:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573687.971529:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360927872:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573688.355006:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573688.355006:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573688.355014:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573688.355050:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573688.355052:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573688.355072:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573688.994982:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573689.379023:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573689.379023:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573689.379033:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573689.379078:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573689.379097:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573689.379110:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573690.018948:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573690.403015:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573690.403017:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573690.403021:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573690.403070:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573690.403085:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573690.403100:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573691.042972:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000400:00000100:1.0:1788573691.043242:0:2337:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.140:988
00000400:00000100:1.0:1788573691.043322:0:2337:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.140@tcp at host 192.168.202.140 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:1.0:1788573691.043339:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788573691.043382:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788573691.043410:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788573691.043420:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788573691.043430:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788573691.043441:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:3.0:1788573691.043445:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573687/real 1788573691]  req@ffff8dc00644d500 x1875453360927232/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573712 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:1.0:1788573691.043449:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:3.0:1788573691.043491:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d500 x1875453360927232/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573712 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573691.043507:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573691.043514:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573691.043520:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360927232:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573691.043531:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573687/real 1788573691]  req@ffff8dc00644ea00 x1875453360927360/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573712 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573691.043545:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ea00 x1875453360927360/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573712 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573691.043557:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573691.043561:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573691.043565:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360927360:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573691.043573:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573687/real 1788573691]  req@ffff8dc00644ce00 x1875453360927488/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573712 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573691.043587:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ce00 x1875453360927488/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573712 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573691.043597:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573691.043600:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573691.043604:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360927488:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573691.043611:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573687/real 1788573691]  req@ffff8dc00644c000 x1875453360927104/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573712 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573691.043623:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c000 x1875453360927104/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573712 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573691.043631:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573691.043634:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573691.043637:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360927104:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788573691.043673:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573687/real 1788573691]  req@ffff8dc00644f800 x1875453360927872/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573712 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573691.043685:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f800 x1875453360927872/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573712 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573691.043695:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573691.043699:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573691.043702:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360927872:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573691.043711:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573687/real 1788573691]  req@ffff8dc00644ca80 x1875453360927616/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573712 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573691.043724:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ca80 x1875453360927616/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573712 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573691.043733:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573691.043737:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573691.043740:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360927616:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573691.043748:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573687/real 1788573691]  req@ffff8dc00644dc00 x1875453360927744/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573712 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573691.043759:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644dc00 x1875453360927744/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573712 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573691.043767:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573691.043771:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573691.043774:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360927744:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573691.426952:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573691.427019:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573691.427043:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573691.427047:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573691.427081:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788573691.427116:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573692.066967:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573692.450972:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573692.450972:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573692.450973:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573692.451000:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573692.451001:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573692.451006:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573693.091000:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788573693.091004:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573693.091015:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788573693.091020:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573693.091029:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2038
00000100:00080000:2.0:1788573693.091040:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573693.091046:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573693.091084:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453360928000/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573693.091107:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573693.091110:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573693.091111:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573693.091114:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2038
00000100:00080000:2.0:1788573693.091120:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573693.091124:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573693.091136:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573693.091154:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360928000:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788573693.091158:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453360928128/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573693.091190:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573693.091196:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573693.091199:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573693.091205:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2038
00000100:00080000:2.0:1788573693.091210:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573693.091216:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573693.091223:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573693.091242:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453360928256/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573693.091256:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573693.091261:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573693.091264:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1788573693.091267:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788573693.091279:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2038
00000100:00080000:2.0:1788573693.091306:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573693.091313:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573693.091323:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573693.091334:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573693/real 1788573693]  req@ffff8dc020496d80 x1875453360928000/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573718 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573693.091361:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453360928384/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573693.091375:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453360928000/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573718 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573693.091381:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573693.091390:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573693.091390:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573693.091407:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573693.091408:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788573693.091424:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2038
00000100:00100000:3.0:1788573693.091426:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360928000:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788573693.091433:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573693.091442:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573693.091451:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573693.091471:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453360928512/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573693.091476:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360928128:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788573693.091513:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573693.091520:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573693.091524:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1788573693.091535:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788573693.091540:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2038
00000100:00080000:2.0:1788573693.091552:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573693.091561:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573693.091568:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573693/real 1788573693]  req@ffff8dc020494a80 x1875453360928128/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573718 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1788573693.091571:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573693.091607:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453360928128/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573718 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573693.091610:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453360928640/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573693.091647:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573693.091655:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573693.091658:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573693.091664:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573693.091667:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2038
00000100:00080000:3.0:1788573693.091676:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788573693.091682:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788573693.091689:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360928128:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788573693.091700:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573693.091709:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360928256:192.168.202.140@tcp:8:kworker.0
00000008:00100000:2.0:1788573693.091712:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573693.091747:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453360928768/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788573693.091765:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573693.091792:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573693/real 1788573693]  req@ffff8dc020497480 x1875453360928256/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573718 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573693.091817:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453360928256/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573718 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573693.091831:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573693.091836:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573693.091840:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360928256:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573693.091849:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360928384:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573693.091910:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573693.092056:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573693/real 1788573693]  req@ffff8dc020495180 x1875453360928384/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573718 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573693.092071:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453360928384/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573718 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573693.092082:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573693.092085:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573693.092089:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360928384:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573693.092117:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360928512:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573693.092145:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573693.092162:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573693/real 1788573693]  req@ffff8dc020495880 x1875453360928512/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573718 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573693.092175:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453360928512/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573718 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573693.092192:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573693.092195:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573693.092199:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360928512:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573693.092207:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360928640:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573693.092231:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573693.092260:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573693/real 1788573693]  req@ffff8dc020496d80 x1875453360928640/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573718 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573693.092274:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453360928640/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573718 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573693.092282:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573693.092285:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573693.092288:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360928640:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573693.092296:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360928768:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573693.092525:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573693.092540:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573693/real 1788573693]  req@ffff8dc020494380 x1875453360928768/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573718 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573693.092553:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453360928768/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573718 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573693.092568:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573693.092572:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573693.092576:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360928768:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573693.474981:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573693.474981:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573693.474993:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573693.475017:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788573693.475025:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573693.475038:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573694.115038:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573694.499016:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573694.499016:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573694.499017:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573694.499017:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573694.499050:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573694.499089:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573695.139019:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573695.523014:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573695.523014:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573695.523016:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573695.523084:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573695.523085:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573695.523089:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573696.162979:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573696.547006:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573696.547009:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573696.547023:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573696.547024:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573696.547044:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573696.547055:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573697.186955:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573697.571024:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573697.571024:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573697.571028:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573697.571073:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573697.571119:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573697.571136:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573698.210964:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788573698.211016:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573698.211021:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788573698.211024:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573698.211032:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2043
00000100:00080000:0.0:1788573698.211040:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573698.211054:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788573698.211086:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453360928896/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573698.211111:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573698.211114:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573698.211115:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573698.211118:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2043
00000100:00080000:0.0:1788573698.211121:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573698.211124:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573698.211133:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573698.211141:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360928896:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788573698.211149:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453360929024/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573698.211170:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573698.211174:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573698.211177:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573698.211182:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2043
00000100:00080000:0.0:1788573698.211186:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573698.211190:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573698.211195:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788573698.211201:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573698.211228:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453360929152/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573698.211236:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573698.211239:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573698.211241:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573698.211244:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2043
00000100:00080000:0.0:1788573698.211248:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573698.211250:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573698.211255:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573698/real 1788573698]  req@ffff8dc006712a00 x1875453360928896/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573723 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1788573698.211256:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573698.211271:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453360929280/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573698.211277:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453360928896/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573723 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573698.211282:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573698.211289:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573698.211293:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573698.211297:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573698.211302:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2043
00000100:00080000:3.0:1788573698.211302:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573698.211310:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360928896:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788573698.211311:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573698.211319:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573698.211325:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573698.211332:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360929024:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573698.211341:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453360929408/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788573698.211353:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788573698.211355:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573698.211359:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573698.211361:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573698.211365:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2043
00000100:00100000:3.0:1788573698.211365:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573698/real 1788573698]  req@ffff8dc006710380 x1875453360929024/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573723 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573698.211372:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573698.211379:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573698.211385:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573698.211385:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453360929024/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573723 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573698.211401:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573698.211404:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573698.211408:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453360929536/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573698.211411:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360929024:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573698.211424:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360929152:192.168.202.140@tcp:8:kworker.0
00000100:00080000:0.0:1788573698.211425:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573698.211431:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573698.211432:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573698.211436:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2043
00000100:00080000:0.0:1788573698.211439:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573698.211442:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573698.211446:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788573698.211447:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573698.211458:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453360929664/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573698.211461:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573698/real 1788573698]  req@ffff8dc006712680 x1875453360929152/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573723 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573698.211485:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453360929152/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573723 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573698.211493:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573698.211496:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573698.211498:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360929152:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573698.211502:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360929280:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573698.211513:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573698.211518:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573698/real 1788573698]  req@ffff8dc006713480 x1875453360929280/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573723 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573698.211525:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453360929280/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573723 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573698.211535:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573698.211537:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573698.211539:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360929280:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573698.211548:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360929408:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573698.211558:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573698.211564:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573698/real 1788573698]  req@ffff8dc006711c00 x1875453360929408/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573723 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573698.211571:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453360929408/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573723 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573698.211576:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573698.211578:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573698.211580:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360929408:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573698.211583:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360929536:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573698.211593:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573698.211599:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573698/real 1788573698]  req@ffff8dc006712a00 x1875453360929536/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573723 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573698.211606:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453360929536/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573723 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573698.211610:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573698.211612:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573698.211614:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360929536:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573698.211618:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360929664:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573698.211627:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573698.211633:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573698/real 1788573698]  req@ffff8dc006711500 x1875453360929664/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573723 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573698.211639:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453360929664/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573723 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573698.211644:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573698.211646:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573698.211648:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360929664:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573698.595002:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573698.595031:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573698.595045:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573698.595054:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573698.595079:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573698.595080:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573699.235014:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573699.619021:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573699.619021:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573699.619021:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573699.619021:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573699.619057:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573699.619101:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573700.259015:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573700.642952:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573700.642953:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573700.642954:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573700.643012:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573700.643027:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573700.643067:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573701.282944:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573701.667009:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573701.667029:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573701.667030:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573701.667034:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573701.667060:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573701.667067:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573702.306940:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573702.690983:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573702.690983:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573702.691019:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573702.691023:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573702.691035:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573702.691045:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573703.330979:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573703.330987:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573703.330993:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788573703.330997:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573703.331015:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2048
00000100:00080000:1.0:1788573703.331026:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573703.331034:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573703.331068:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453360929792/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573703.331111:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573703.331116:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573703.331118:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573703.331123:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2048
00000100:00080000:1.0:1788573703.331126:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573703.331131:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573703.331141:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573703.331149:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360929792:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788573703.331164:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360929920/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573703.331174:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573703.331178:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573703.331179:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573703.331183:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2048
00000100:00080000:1.0:1788573703.331186:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573703.331190:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573703.331194:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573703.331204:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360930048/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573703.331213:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1788573703.331213:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788573703.331217:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573703.331218:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573703.331222:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2048
00000100:00080000:1.0:1788573703.331225:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573703.331229:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573703.331234:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573703.331243:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360930176/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573703.331252:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573703.331256:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:3.0:1788573703.331256:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573703/real 1788573703]  req@ffff8dc005dc3800 x1875453360929792/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573728 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573703.331257:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573703.331261:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2048
00000100:00080000:1.0:1788573703.331265:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573703.331268:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573703.331273:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573703.331273:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453360929792/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573728 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573703.331282:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360930304/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573703.331290:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573703.331292:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573703.331294:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573703.331295:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573703.331300:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2048
00000100:00080000:3.0:1788573703.331300:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788573703.331304:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788573703.331304:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360929792:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788573703.331307:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573703.331311:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573703.331321:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360930432/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573703.331326:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360929920:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788573703.331337:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573703.331340:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573703.331342:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573703.331346:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2048
00000100:00080000:1.0:1788573703.331349:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1788573703.331349:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788573703.331353:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573703.331357:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573703.331361:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573703/real 1788573703]  req@ffff8dc005dc1500 x1875453360929920/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573728 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573703.331367:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360930560/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573703.331374:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360929920/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573728 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573703.331385:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573703.331388:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573703.331392:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360929920:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573703.331398:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360930048:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573703.331421:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573703.331432:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573703/real 1788573703]  req@ffff8dc005dc0700 x1875453360930048/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573728 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573703.331440:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453360930048/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573728 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573703.331451:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573703.331453:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573703.331455:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360930048:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573703.331459:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360930176:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573703.331472:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573703.331479:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573703/real 1788573703]  req@ffff8dc005dc1180 x1875453360930176/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573728 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573703.331490:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360930176/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573728 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573703.331499:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573703.331503:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573703.331506:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360930176:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573703.331513:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360930304:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573703.331534:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573703.331546:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573703/real 1788573703]  req@ffff8dc005dc2d80 x1875453360930304/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573728 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573703.331554:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360930304/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573728 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573703.331560:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573703.331562:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573703.331565:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360930304:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573703.331577:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360930432:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573703.331591:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573703.331598:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573703/real 1788573703]  req@ffff8dc005dc1c00 x1875453360930432/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573728 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573703.331605:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453360930432/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573728 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573703.331610:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573703.331612:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573703.331614:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360930432:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573703.331618:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360930560:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573703.331627:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573703.331632:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573703/real 1788573703]  req@ffff8dc005dc3b80 x1875453360930560/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573728 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573703.331641:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360930560/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573728 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573703.331649:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573703.331652:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573703.331655:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360930560:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573703.714977:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573703.714990:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573703.715009:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788573703.715044:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573703.715064:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573703.715082:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573704.354960:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573704.739000:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573704.739006:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573704.739007:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573704.739009:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573704.739067:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573704.739094:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573705.378992:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573705.762952:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573705.762995:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573705.762995:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573705.763040:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788573705.763049:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573705.763059:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573706.402980:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573706.787031:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573706.787036:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573706.787038:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573706.787050:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573706.787083:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573706.787089:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573707.427050:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573707.811003:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573707.811003:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573707.811019:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573707.811019:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573707.811061:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788573707.811120:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573708.450961:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573708.450963:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573708.450972:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788573708.450977:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573708.450986:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2054
00000100:00080000:1.0:1788573708.450996:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573708.451003:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573708.451047:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453360930688/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573708.451080:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573708.451084:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573708.451086:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573708.451091:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2054
00000100:00080000:1.0:1788573708.451095:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573708.451100:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573708.451109:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360930688:192.168.202.140@tcp:250:kworker.0
00000008:00100000:1.0:1788573708.451111:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573708.451130:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360930816/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573708.451149:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573708.451153:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573708.451155:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573708.451159:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2054
00000100:00080000:1.0:1788573708.451163:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573708.451167:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573708.451172:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788573708.451180:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573708.451185:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360930944/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573708.451195:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573708.451199:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573708.451202:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573708.451206:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2054
00000100:00080000:1.0:1788573708.451211:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573708.451215:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573708.451219:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573708.451232:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573708/real 1788573708]  req@ffff8dc005dc0a80 x1875453360930688/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573733 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573708.451236:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360931072/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573708.451260:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788573708.451265:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453360930688/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573733 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573708.451266:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573708.451270:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573708.451279:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2054
00000100:00080000:1.0:1788573708.451285:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573708.451287:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573708.451292:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:3.0:1788573708.451297:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000008:00100000:1.0:1788573708.451300:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573708.451304:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360930688:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788573708.451315:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360931200/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573708.451325:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573708.451329:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573708.451331:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788573708.451333:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360930816:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788573708.451339:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2054
00000100:00080000:1.0:1788573708.451343:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573708.451347:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573708.451352:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788573708.451362:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573708.451367:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360931328/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573708.451381:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573708/real 1788573708]  req@ffff8dc005dc3b80 x1875453360930816/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573733 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573708.451389:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573708.451398:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573708.451401:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573708.451407:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2054
00000100:00100000:3.0:1788573708.451408:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360930816/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573733 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573708.451411:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573708.451418:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573708.451426:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788573708.451430:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573708.451437:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573708.451441:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360931456/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573708.451444:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360930816:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573708.451456:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360930944:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573708.451480:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573708.451489:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573708/real 1788573708]  req@ffff8dc005dc1c00 x1875453360930944/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573733 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573708.451497:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453360930944/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573733 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573708.451503:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573708.451505:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573708.451508:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360930944:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573708.451511:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360931072:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573708.451522:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573708.451529:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573708/real 1788573708]  req@ffff8dc005dc2d80 x1875453360931072/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573733 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573708.451536:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360931072/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573733 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573708.451542:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573708.451543:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573708.451545:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360931072:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573708.451549:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360931200:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573708.451559:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573708.451565:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573708/real 1788573708]  req@ffff8dc005dc1180 x1875453360931200/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573733 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573708.451572:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360931200/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573733 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573708.451578:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573708.451580:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573708.451581:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360931200:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573708.451593:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360931328:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573708.451604:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573708.451610:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573708/real 1788573708]  req@ffff8dc005dc0700 x1875453360931328/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573733 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573708.451618:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453360931328/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573733 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573708.451626:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573708.451629:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573708.451632:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360931328:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573708.451638:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360931456:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573708.451658:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573708.451670:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573708/real 1788573708]  req@ffff8dc005dc1500 x1875453360931456/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573733 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573708.451680:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360931456/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573733 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573708.451686:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573708.451688:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573708.451690:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360931456:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573708.835020:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573708.835022:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573708.835024:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573708.835085:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573708.835095:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573708.835107:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573709.474991:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573709.859007:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573709.859007:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573709.859033:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573709.859033:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573709.859054:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788573709.859145:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573710.499043:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573710.883007:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573710.883018:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573710.883054:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573710.883079:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573710.883088:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788573710.883108:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573711.523007:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573711.906999:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573711.907026:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573711.907026:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788573711.907044:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573711.907056:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573711.907081:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573712.546950:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573712.930970:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573712.930974:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573712.930978:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573712.931008:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573712.931016:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788573712.931048:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1788573713.570994:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788573713.570994:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788573713.571005:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788573713.571011:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573713.571021:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2059
00000100:00080000:0.0:1788573713.571032:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573713.571040:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788573713.571078:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453360931584/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573713.571105:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573713.571109:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573713.571111:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573713.571116:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2059
00000100:00080000:0.0:1788573713.571121:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573713.571126:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573713.571134:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360931584:192.168.202.140@tcp:250:kworker.0
00000008:00100000:0.0:1788573713.571136:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573713.571154:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453360931712/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573713.571172:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573713.571176:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573713.571177:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573713.571182:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2059
00000100:00080000:0.0:1788573713.571187:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573713.571191:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573713.571197:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788573713.571203:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573713.571211:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453360931840/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573713.571232:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573713.571236:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573713.571240:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788573713.571241:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573713/real 1788573713]  req@ffff8dc006713b80 x1875453360931584/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573738 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573713.571250:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2059
00000100:00080000:0.0:1788573713.571259:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788573713.571264:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453360931584/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573738 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573713.571266:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573713.571276:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788573713.571278:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573713.571285:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573713.571288:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360931584:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788573713.571294:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453360931968/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573713.571302:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573713.571305:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573713.571306:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788573713.571309:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360931712:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788573713.571313:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2059
00000100:00080000:0.0:1788573713.571318:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573713.571321:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573713.571326:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788573713.571333:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573713.571338:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453360932096/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573713.571346:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573713/real 1788573713]  req@ffff8dc006710e00 x1875453360931712/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573738 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573713.571348:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573713.571356:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573713.571359:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573713.571367:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2059
00000100:00100000:3.0:1788573713.571371:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453360931712/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573738 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573713.571372:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573713.571379:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573713.571386:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788573713.571390:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1788573713.571396:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453360932224/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573713.571396:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573713.571404:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360931712:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788573713.571416:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788573713.571417:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360931840:192.168.202.140@tcp:8:kworker.0
00000100:00080000:0.0:1788573713.571423:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573713.571426:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573713.571437:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2059
00000800:00000100:3.0:1788573713.571439:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788573713.571442:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573713.571447:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573713.571451:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573713.571451:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573713/real 1788573713]  req@ffff8dc006712300 x1875453360931840/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573738 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573713.571465:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453360932352/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573713.571467:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453360931840/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573738 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573713.571491:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573713.571496:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573713.571503:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360931840:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573713.571513:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360931968:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573713.571527:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573713.571536:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573713/real 1788573713]  req@ffff8dc006713100 x1875453360931968/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573738 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573713.571544:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453360931968/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573738 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573713.571550:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573713.571552:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573713.571554:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360931968:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573713.571563:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360932096:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573713.571573:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573713.571579:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573713/real 1788573713]  req@ffff8dc006713800 x1875453360932096/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573738 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573713.571586:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453360932096/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573738 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573713.571592:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573713.571594:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573713.571596:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360932096:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573713.571599:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360932224:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573713.571609:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573713.571614:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573713/real 1788573713]  req@ffff8dc006711880 x1875453360932224/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573738 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573713.571621:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453360932224/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573738 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573713.571626:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573713.571627:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573713.571630:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360932224:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573713.571634:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360932352:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573713.571643:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573713.571648:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573713/real 1788573713]  req@ffff8dc006713b80 x1875453360932352/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573738 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573713.571655:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453360932352/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573738 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573713.571661:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573713.571662:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573713.571664:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360932352:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573713.954975:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573713.954986:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573713.955016:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573713.955018:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573713.955058:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788573713.955059:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573714.594974:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573714.978942:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573714.978949:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573714.978966:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573714.978981:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573714.979000:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788573714.979021:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573715.618955:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573716.002961:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573716.002961:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573716.002966:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573716.002992:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573716.002995:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788573716.003006:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573716.642947:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573717.027017:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573717.027017:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573717.027029:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788573717.027056:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573717.027066:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573717.027083:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573717.666969:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573718.050982:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573718.051008:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573718.051036:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573718.051036:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788573718.051063:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573718.051063:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573718.690941:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573718.690997:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573718.691003:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788573718.691007:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573718.691015:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2064
00000100:00080000:1.0:1788573718.691023:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573718.691029:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573718.691061:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453360932480/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573718.691080:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573718.691083:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573718.691085:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573718.691090:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2064
00000100:00080000:1.0:1788573718.691094:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573718.691098:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573718.691107:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573718.691111:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360932480:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788573718.691121:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360932608/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573718.691135:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573718.691138:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573718.691140:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573718.691147:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2064
00000100:00080000:1.0:1788573718.691153:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573718.691158:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573718.691166:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788573718.691178:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573718.691187:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360932736/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573718.691206:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573718.691212:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573718.691216:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573718.691223:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2064
00000100:00080000:1.0:1788573718.691233:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573718.691241:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573718.691244:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573718/real 1788573718]  req@ffff8dc005dc3800 x1875453360932480/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573743 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1788573718.691262:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573718.691271:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453360932480/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573743 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573718.691285:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360932864/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573718.691294:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573718.691300:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573718.691304:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788573718.691307:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573718.691312:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788573718.691315:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360932480:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788573718.691321:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2064
00000100:00080000:1.0:1788573718.691327:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573718.691334:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573718.691340:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573718.691349:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360932608:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573718.691355:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360932992/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573718.691369:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573718.691372:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573718.691375:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1788573718.691381:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788573718.691383:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2064
00000100:00080000:1.0:1788573718.691389:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573718.691394:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573718.691399:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573718.691400:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573718/real 1788573718]  req@ffff8dc005dc1500 x1875453360932608/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573743 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573718.691414:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360933120/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573718.691418:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360932608/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573743 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573718.691428:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573718.691434:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573718.691436:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573718.691439:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573718.691440:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2064
00000100:00080000:1.0:1788573718.691446:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573718.691447:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788573718.691452:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573718.691455:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360932608:192.168.202.140@tcp:38:kworker.0
00000008:00100000:1.0:1788573718.691457:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573718.691465:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360933248/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573718.691478:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360932736:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573718.691502:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573718.691513:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573718/real 1788573718]  req@ffff8dc005dc0700 x1875453360932736/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573743 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573718.691523:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453360932736/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573743 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573718.691531:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573718.691534:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573718.691537:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360932736:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573718.691543:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360932864:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573718.691559:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573718.691576:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573718/real 1788573718]  req@ffff8dc005dc1180 x1875453360932864/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573743 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573718.691587:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360932864/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573743 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573718.691595:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573718.691598:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573718.691602:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360932864:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573718.691616:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360932992:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573718.691634:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573718.691644:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573718/real 1788573718]  req@ffff8dc005dc2d80 x1875453360932992/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573743 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573718.691662:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360932992/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573743 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573718.691670:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573718.691673:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573718.691676:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360932992:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573718.691681:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360933120:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573718.691698:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573718.691707:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573718/real 1788573718]  req@ffff8dc005dc1c00 x1875453360933120/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573743 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573718.691749:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453360933120/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573743 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573718.691757:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573718.691760:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573718.691763:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360933120:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573718.691768:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360933248:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573718.691793:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573718.691803:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573718/real 1788573718]  req@ffff8dc005dc3b80 x1875453360933248/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573743 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573718.691813:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360933248/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573743 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573718.691821:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573718.691824:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573718.691827:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360933248:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573719.074965:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573719.074966:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573719.074966:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573719.074966:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573719.075016:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788573719.075055:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573719.714973:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573720.098971:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573720.098973:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573720.098978:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573720.099003:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788573720.099004:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573720.099017:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573720.738984:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573721.122992:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573721.122992:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573721.123025:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573721.123026:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573721.123040:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788573721.123150:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573721.763005:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573722.146978:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573722.146983:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573722.147002:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788573722.147019:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573722.147034:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573722.147050:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573722.787031:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573723.171077:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573723.171078:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573723.171078:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573723.171143:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573723.171147:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573723.171148:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573723.810951:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573723.810982:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573723.810992:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788573723.810997:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573723.811008:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2069
00000100:00080000:1.0:1788573723.811021:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573723.811029:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573723.811073:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453360933376/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573723.811101:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573723.811104:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573723.811106:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573723.811109:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2069
00000100:00080000:1.0:1788573723.811111:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573723.811114:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573723.811124:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573723.811137:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360933504/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573723.811147:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788573723.811148:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360933376:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788573723.811155:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573723.811158:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573723.811163:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2069
00000100:00080000:1.0:1788573723.811165:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573723.811169:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573723.811172:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573723.811182:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360933632/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573723.811188:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573723.811191:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573723.811192:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573723.811196:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2069
00000100:00080000:1.0:1788573723.811200:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573723.811203:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573723.811206:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573723.811213:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360933760/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573723.811218:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573723.811221:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573723.811222:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573723.811225:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2069
00000100:00080000:1.0:1788573723.811228:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573723.811231:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573723.811234:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788573723.811243:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573723.811249:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360933888/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573723.811274:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573723.811277:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573723.811279:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573723.811284:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2069
00000100:00080000:1.0:1788573723.811288:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573723.811290:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573723.811295:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573723.811306:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573723/real 1788573723]  req@ffff8dc005dc0a80 x1875453360933376/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573748 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573723.811307:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360934016/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573723.811349:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788573723.811354:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453360933376/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573748 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573723.811356:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573723.811361:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573723.811376:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2069
00000100:00080000:1.0:1788573723.811390:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573723.811394:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573723.811399:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:3.0:1788573723.811406:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000008:00100000:1.0:1788573723.811407:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573723.811414:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360933376:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788573723.811424:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360934144/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573723.811446:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360933504:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573723.811480:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573723.811490:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573723/real 1788573723]  req@ffff8dc005dc3b80 x1875453360933504/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573748 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573723.811498:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360933504/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573748 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573723.811505:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573723.811508:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573723.811510:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360933504:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573723.811515:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360933632:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573723.811527:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573723.811533:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573723/real 1788573723]  req@ffff8dc005dc1c00 x1875453360933632/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573748 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573723.811562:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453360933632/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573748 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573723.811568:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573723.811581:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573723.811583:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360933632:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573723.811587:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360933760:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573723.811599:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573723.811606:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573723/real 1788573723]  req@ffff8dc005dc2d80 x1875453360933760/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573748 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573723.811613:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360933760/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573748 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573723.811637:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573723.811639:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573723.811642:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360933760:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573723.811646:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360933888:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573723.811662:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573723.811670:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573723/real 1788573723]  req@ffff8dc005dc1180 x1875453360933888/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573748 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573723.811678:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360933888/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573748 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573723.811689:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573723.811691:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573723.811701:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360933888:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573723.811708:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360934016:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573723.811721:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573723.811728:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573723/real 1788573723]  req@ffff8dc005dc0700 x1875453360934016/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573748 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573723.811754:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453360934016/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573748 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573723.811761:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573723.811763:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573723.811766:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360934016:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573723.811770:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360934144:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573723.811783:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573723.811790:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573723/real 1788573723]  req@ffff8dc005dc1500 x1875453360934144/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573748 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573723.811798:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360934144/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573748 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573723.811804:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573723.811806:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573723.811809:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360934144:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573724.194962:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573724.194977:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573724.195003:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788573724.195012:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573724.195029:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573724.195045:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573724.834942:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573725.219045:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573725.219045:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573725.219052:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573725.219083:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573725.219097:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573725.219112:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573725.858991:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573726.242957:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573726.242958:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573726.242967:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788573726.242989:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573726.242991:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573726.242994:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573726.882941:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573727.267033:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573727.267033:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573727.267040:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573727.267076:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788573727.267076:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573727.267087:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573727.907005:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573728.290959:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573728.290959:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573728.290960:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573728.290961:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573728.290989:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788573728.291036:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1788573728.930988:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573728.931004:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:0.0:1788573728.931006:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788573728.931008:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573728.931020:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2074
00000100:00080000:2.0:1788573728.931030:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573728.931036:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573728.931080:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453360934272/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573728.931109:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573728.931116:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573728.931128:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573728.931137:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2074
00000100:00100000:3.0:1788573728.931141:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360934272:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788573728.931145:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573728.931158:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573728.931169:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573728.931190:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453360934400/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573728.931203:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573728.931208:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573728.931210:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573728.931215:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2074
00000100:00080000:2.0:1788573728.931226:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573728.931228:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573728.931232:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573728.931248:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453360934528/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788573728.931257:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788573728.931258:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573728.931269:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573728.931272:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573728.931278:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2074
00000100:00080000:2.0:1788573728.931285:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573728.931288:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573728.931292:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573728.931302:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453360934656/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573728.931308:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573728.931310:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573728.931311:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573728.931314:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2074
00000100:00080000:2.0:1788573728.931316:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573728.931318:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573728.931321:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573728.931326:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453360934784/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573728.931331:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573728.931334:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573728.931335:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573728.931338:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2074
00000100:00080000:2.0:1788573728.931340:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573728.931343:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573728.931346:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573728.931352:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453360934912/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573728.931358:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573728.931360:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573728.931362:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573728.931366:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2074
00000100:00080000:2.0:1788573728.931368:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573728.931370:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573728.931374:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573728.931385:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453360935040/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573728.931396:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573728/real 1788573728]  req@ffff8dc020494000 x1875453360934272/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573753 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573728.931420:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453360934272/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573753 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573728.931430:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573728.931434:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573728.931439:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360934272:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788573728.931608:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360934400:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573728.931679:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573728.931710:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573728/real 1788573728]  req@ffff8dc020494e00 x1875453360934400/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573753 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573728.931723:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453360934400/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573753 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573728.931735:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573728.931741:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573728.931744:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360934400:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573728.931753:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360934528:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573728.931778:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573728.931790:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573728/real 1788573728]  req@ffff8dc020496a00 x1875453360934528/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573753 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573728.931800:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453360934528/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573753 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573728.931806:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573728.931809:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573728.931812:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360934528:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573728.931817:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360934656:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573728.931835:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573728.931847:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573728/real 1788573728]  req@ffff8dc020494700 x1875453360934656/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573753 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573728.931861:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453360934656/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573753 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573728.931912:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573728.931916:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573728.931918:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360934656:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573728.931924:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360934784:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573728.931946:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573728.931963:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573728/real 1788573728]  req@ffff8dc020495500 x1875453360934784/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573753 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573728.931975:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453360934784/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573753 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573728.931982:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573728.931986:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573728.931988:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360934784:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573728.931993:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360934912:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573728.932006:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573728.932012:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573728/real 1788573728]  req@ffff8dc020497100 x1875453360934912/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573753 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573728.932020:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453360934912/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573753 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573728.932025:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573728.932027:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573728.932029:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360934912:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573728.932033:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360935040:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573728.932044:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573728.932050:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573728/real 1788573728]  req@ffff8dc020494380 x1875453360935040/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573753 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573728.932063:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453360935040/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573753 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573728.932068:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573728.932070:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573728.932072:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360935040:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573729.314954:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573729.314954:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573729.314976:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573729.314992:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788573729.315004:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573729.315008:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573729.954979:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573730.339014:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573730.339015:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573730.339020:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573730.339055:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573730.339087:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788573730.339158:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573730.978990:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573731.362979:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573731.362979:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573731.362979:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573731.362979:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573731.363019:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788573731.363086:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573732.002968:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573732.386984:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573732.386989:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573732.386989:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573732.387016:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573732.387056:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788573732.387094:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573733.026973:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573733.410970:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573733.410971:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573733.410998:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573733.411031:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573733.411035:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788573733.411105:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573734.050970:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573734.051006:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573734.051017:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788573734.051023:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573734.051036:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2079
00000100:00080000:1.0:1788573734.051049:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573734.051059:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573734.051106:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453360935168/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573734.051144:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573734.051148:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573734.051150:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573734.051154:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2079
00000100:00080000:1.0:1788573734.051158:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573734.051171:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573734.051183:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573734.051202:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360935168:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788573734.051204:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360935296/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573734.051221:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573734.051225:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573734.051226:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573734.051231:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2079
00000100:00080000:1.0:1788573734.051235:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573734.051240:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573734.051253:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573734.051267:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360935424/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573734.051278:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573734.051283:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000800:00000100:3.0:1788573734.051285:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788573734.051286:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573734.051294:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2079
00000100:00080000:1.0:1788573734.051299:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573734.051304:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573734.051310:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573734.051324:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360935552/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573734.051334:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788573734.051339:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573734/real 1788573734]  req@ffff8dc005dc3800 x1875453360935168/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573759 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573734.051340:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573734.051344:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573734.051360:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2079
00000100:00080000:1.0:1788573734.051366:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788573734.051370:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453360935168/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573759 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573734.051375:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573734.051387:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788573734.051388:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573734.051396:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573734.051400:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360935168:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788573734.051407:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360935680/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573734.051432:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573734.051436:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573734.051439:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788573734.051441:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360935296:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788573734.051449:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2079
00000100:00080000:1.0:1788573734.051454:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573734.051459:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573734.051465:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788573734.051468:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573734.051482:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573734/real 1788573734]  req@ffff8dc005dc1500 x1875453360935296/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573759 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573734.051487:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360935808/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573734.051504:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360935296/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573759 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573734.051508:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573734.051516:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788573734.051518:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573734.051519:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573734.051525:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788573734.051530:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2079
00000100:00100000:3.0:1788573734.051532:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360935296:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788573734.051536:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788573734.051540:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360935424:192.168.202.140@tcp:8:kworker.0
00000100:00080000:1.0:1788573734.051546:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573734.051552:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573734.051566:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360935936/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788573734.051577:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573734.051596:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573734/real 1788573734]  req@ffff8dc005dc0700 x1875453360935424/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573759 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573734.051617:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453360935424/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573759 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573734.051624:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573734.051627:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573734.051629:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360935424:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573734.051634:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360935552:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573734.051649:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573734.051656:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573734/real 1788573734]  req@ffff8dc005dc1180 x1875453360935552/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573759 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573734.051664:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360935552/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573759 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573734.051675:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573734.051677:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573734.051680:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360935552:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573734.051683:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360935680:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573734.051694:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573734.051699:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573734/real 1788573734]  req@ffff8dc005dc2d80 x1875453360935680/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573759 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573734.051707:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360935680/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573759 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573734.051713:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573734.051715:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573734.051718:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360935680:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573734.051737:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360935808:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573734.051749:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573734.051756:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573734/real 1788573734]  req@ffff8dc005dc1c00 x1875453360935808/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573759 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573734.051764:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453360935808/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573759 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573734.051769:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573734.051772:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573734.051774:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360935808:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573734.051778:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360935936:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573734.051788:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573734.051794:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573734/real 1788573734]  req@ffff8dc005dc3b80 x1875453360935936/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573759 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573734.051801:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360935936/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573759 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573734.051807:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573734.051808:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573734.051810:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360935936:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573734.434939:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573734.434956:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573734.434990:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573734.434990:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573734.435010:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573734.435088:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573735.074969:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573735.458959:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573735.458959:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573735.458967:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573735.458992:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573735.458998:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573735.459001:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573736.099006:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573736.482970:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573736.482971:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573736.482972:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573736.482994:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573736.483001:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573736.483003:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573737.123006:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573737.506955:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573737.506955:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573737.506955:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573737.506956:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573737.506991:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573737.507027:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573738.147014:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573738.530970:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573738.530991:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573738.531054:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573738.531112:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573738.531113:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573738.531115:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573739.170976:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788573739.171049:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573739.171075:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788573739.171079:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573739.171091:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2084
00000100:00080000:0.0:1788573739.171103:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573739.171111:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788573739.171162:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453360936064/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573739.171198:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573739.171201:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573739.171203:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573739.171207:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2084
00000100:00080000:0.0:1788573739.171213:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573739.171218:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573739.171229:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573739.171239:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360936064:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788573739.171244:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453360936192/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573739.171259:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573739.171262:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573739.171264:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573739.171268:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2084
00000100:00080000:0.0:1788573739.171271:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573739.171274:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573739.171279:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573739.171289:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453360936320/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573739.171297:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573739.171300:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573739.171301:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573739.171304:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2084
00000100:00080000:0.0:1788573739.171307:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573739.171344:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:3.0:1788573739.171346:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:0.0:1788573739.171351:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573739.171370:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453360936448/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573739.171397:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788573739.171401:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573739/real 1788573739]  req@ffff8dc006711500 x1875453360936064/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573764 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573739.171405:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573739.171415:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573739.171432:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2084
00000100:00080000:0.0:1788573739.171442:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573739.171448:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573739.171456:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453360936064/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573764 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1788573739.171459:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788573739.171469:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573739.171477:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573739.171483:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360936064:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788573739.171485:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453360936576/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573739.171508:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573739.171511:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573739.171513:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573739.171517:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2084
00000100:00080000:0.0:1788573739.171519:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573739.171522:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573739.171525:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573739.171530:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360936192:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573739.171536:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453360936704/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573739.171546:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573739.171549:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573739.171551:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573739.171556:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2084
00000100:00080000:0.0:1788573739.171562:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573739.171568:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:3.0:1788573739.171573:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:0.0:1788573739.171581:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573739.171602:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453360936832/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573739.171603:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573739/real 1788573739]  req@ffff8dc006712a00 x1875453360936192/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573764 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573739.171664:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453360936192/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573764 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573739.171681:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573739.171685:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573739.171687:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360936192:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573739.171693:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360936320:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573739.171713:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573739.171721:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573739/real 1788573739]  req@ffff8dc006711c00 x1875453360936320/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573764 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573739.171729:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453360936320/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573764 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573739.171739:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573739.171741:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573739.171743:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360936320:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573739.171747:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360936448:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573739.171758:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573739.171764:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573739/real 1788573739]  req@ffff8dc006713480 x1875453360936448/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573764 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573739.171770:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453360936448/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573764 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573739.171776:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573739.171778:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573739.171780:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360936448:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573739.171784:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360936576:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573739.171794:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573739.171800:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573739/real 1788573739]  req@ffff8dc006712680 x1875453360936576/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573764 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573739.171807:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453360936576/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573764 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573739.171813:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573739.171815:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573739.171817:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360936576:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573739.171831:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360936704:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573739.171842:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573739.171848:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573739/real 1788573739]  req@ffff8dc006710380 x1875453360936704/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573764 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573739.171856:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453360936704/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573764 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573739.171861:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573739.171863:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573739.171884:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360936704:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573739.171888:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360936832:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573739.171900:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573739.171907:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573739/real 1788573739]  req@ffff8dc006711500 x1875453360936832/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573764 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573739.171915:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453360936832/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573764 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573739.171920:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573739.171922:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573739.171924:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360936832:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573739.554965:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573739.554965:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573739.554980:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573739.554985:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573739.555015:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573739.555022:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573740.194944:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573740.578979:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573740.578982:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573740.578986:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573740.579012:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573740.579021:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573740.579024:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573741.219014:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573741.602985:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573741.602985:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573741.603023:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573741.603025:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573741.603030:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573741.603065:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573742.242930:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573742.627049:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573742.627049:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573742.627049:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573742.627096:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573742.627116:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573742.627133:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573743.266989:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573743.650972:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573743.650974:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573743.651000:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573743.651017:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573743.651024:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573743.651030:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573744.290927:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788573744.290946:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573744.290953:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788573744.290958:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573744.290968:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2089
00000100:00080000:0.0:1788573744.290978:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573744.290986:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788573744.291021:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453360936960/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573744.291044:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573744.291048:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573744.291050:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573744.291055:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2089
00000100:00080000:0.0:1788573744.291059:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573744.291063:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573744.291074:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573744.291084:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360936960:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788573744.291086:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453360937088/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573744.291096:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573744.291099:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573744.291101:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573744.291105:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2089
00000100:00080000:0.0:1788573744.291107:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573744.291111:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573744.291115:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573744.291125:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453360937216/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573744.291133:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573744.291136:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573744.291138:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573744.291141:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2089
00000100:00080000:0.0:1788573744.291144:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1788573744.291146:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788573744.291148:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573744.291161:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573744.291171:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453360937344/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573744.291179:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573744.291183:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573744.291185:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788573744.291185:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573744/real 1788573744]  req@ffff8dc006713b80 x1875453360936960/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573769 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573744.291189:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2089
00000100:00080000:0.0:1788573744.291193:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573744.291197:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573744.291201:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573744.291203:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453360936960/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573769 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573744.291223:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453360937472/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573744.291227:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573744.291231:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788573744.291233:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788573744.291235:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360936960:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788573744.291236:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573744.291238:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573744.291242:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2089
00000100:00080000:0.0:1788573744.291245:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573744.291249:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573744.291253:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573744.291255:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360937088:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573744.291263:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453360937600/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573744.291272:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1788573744.291277:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788573744.291283:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573744.291285:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573744.291289:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2089
00000100:00100000:3.0:1788573744.291291:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573744/real 1788573744]  req@ffff8dc006711880 x1875453360937088/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573769 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573744.291293:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573744.291297:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573744.291301:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573744.291312:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453360937728/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573744.291327:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453360937088/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573769 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573744.291355:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573744.291360:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573744.291363:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360937088:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573744.291368:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360937216:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573744.291387:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573744.291395:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573744/real 1788573744]  req@ffff8dc006713800 x1875453360937216/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573769 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573744.291403:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453360937216/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573769 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573744.291409:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573744.291411:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573744.291413:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360937216:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573744.291417:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360937344:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573744.291427:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573744.291433:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573744/real 1788573744]  req@ffff8dc006713100 x1875453360937344/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573769 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573744.291440:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453360937344/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573769 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573744.291445:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573744.291447:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573744.291450:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360937344:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573744.291453:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360937472:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573744.291463:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573744.291469:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573744/real 1788573744]  req@ffff8dc006712300 x1875453360937472/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573769 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573744.291476:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453360937472/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573769 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573744.291481:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573744.291483:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573744.291485:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360937472:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573744.291496:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360937600:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573744.291506:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573744.291512:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573744/real 1788573744]  req@ffff8dc006710e00 x1875453360937600/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573769 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573744.291520:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453360937600/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573769 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573744.291525:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573744.291527:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573744.291529:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360937600:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573744.291533:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360937728:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573744.291541:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573744.291548:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573744/real 1788573744]  req@ffff8dc006713b80 x1875453360937728/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573769 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573744.291555:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453360937728/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573769 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573744.291560:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573744.291561:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573744.291563:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360937728:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573744.674987:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573744.674997:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573744.674999:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573744.675000:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573744.675068:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573744.675098:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573745.314961:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573745.698957:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573745.698957:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573745.698958:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573745.698993:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573745.698994:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788573745.699009:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573746.338948:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573746.722983:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573746.723023:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573746.723023:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573746.723026:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573746.723068:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573746.723147:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573747.363030:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573747.746973:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573747.746985:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573747.747013:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573747.747038:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573747.747052:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788573747.747120:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573748.386978:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573748.770980:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573748.770980:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573748.770982:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573748.771012:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573748.771015:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573748.771018:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1788573749.410978:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788573749.410983:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788573749.410988:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788573749.410993:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573749.411001:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2095
00000100:00080000:2.0:1788573749.411010:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573749.411017:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573749.411061:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453360937856/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573749.411082:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573749.411085:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573749.411086:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573749.411089:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2095
00000100:00080000:2.0:1788573749.411092:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573749.411094:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573749.411102:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573749.411126:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453360937984/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573749.411131:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360937856:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788573749.411142:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573749.411150:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573749.411152:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573749.411155:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2095
00000100:00080000:2.0:1788573749.411158:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573749.411161:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573749.411166:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573749.411176:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453360938112/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573749.411182:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573749.411185:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573749.411187:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573749.411189:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2095
00000100:00080000:2.0:1788573749.411191:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573749.411193:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573749.411196:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788573749.411201:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573749.411204:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453360938240/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573749.411212:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573749.411214:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573749.411216:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573749.411219:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2095
00000100:00080000:2.0:1788573749.411222:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573749.411225:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573749.411228:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573749.411235:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453360938368/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573749.411242:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573749.411246:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:3.0:1788573749.411246:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573749/real 1788573749]  req@ffff8dc020496d80 x1875453360937856/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573774 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573749.411249:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573749.411258:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2095
00000100:00080000:2.0:1788573749.411269:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788573749.411270:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453360937856/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573774 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573749.411274:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573749.411282:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573749.411292:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453360938496/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573749.411296:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573749.411299:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573749.411305:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788573749.411308:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788573749.411309:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573749.411316:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2095
00000100:00100000:3.0:1788573749.411319:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360937856:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788573749.411320:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573749.411326:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573749.411330:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573749.411337:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453360938624/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573749.411347:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360937984:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573749.411367:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573749.411376:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573749/real 1788573749]  req@ffff8dc020495880 x1875453360937984/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573774 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573749.411384:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453360937984/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573774 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573749.411391:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573749.411393:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573749.411395:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360937984:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573749.411400:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360938112:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573749.411411:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573749.411417:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573749/real 1788573749]  req@ffff8dc020495180 x1875453360938112/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573774 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573749.411425:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453360938112/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573774 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573749.411430:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573749.411432:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573749.411434:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360938112:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573749.411437:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360938240:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573749.411448:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573749.411454:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573749/real 1788573749]  req@ffff8dc020497480 x1875453360938240/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573774 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573749.411461:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453360938240/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573774 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573749.411466:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573749.411468:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573749.411470:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360938240:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573749.411474:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360938368:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573749.411483:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573749.411489:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573749/real 1788573749]  req@ffff8dc020494a80 x1875453360938368/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573774 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573749.411496:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453360938368/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573774 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573749.411502:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573749.411503:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573749.411505:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360938368:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573749.411509:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360938496:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573749.411519:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573749.411524:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573749/real 1788573749]  req@ffff8dc020494380 x1875453360938496/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573774 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573749.411537:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453360938496/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573774 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573749.411542:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573749.411543:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573749.411545:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360938496:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573749.411556:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360938624:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573749.411565:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573749.411571:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573749/real 1788573749]  req@ffff8dc020497100 x1875453360938624/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573774 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573749.411577:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453360938624/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573774 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573749.411582:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573749.411584:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573749.411586:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360938624:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573749.794959:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573749.794961:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573749.794969:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788573749.794989:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573749.794996:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573749.795005:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573750.434973:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573750.818973:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573750.818973:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573750.818974:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573750.819112:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573750.819178:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788573750.819180:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573751.458995:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573751.842972:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573751.843001:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573751.843007:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573751.843035:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573751.843055:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788573751.843145:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573752.483026:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573752.867029:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573752.867034:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573752.867035:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573752.867095:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573752.867103:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788573752.867155:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573753.506944:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573753.890966:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573753.890966:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573753.890968:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573753.890968:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573753.891003:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788573753.891078:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573754.531000:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788573754.531002:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573754.531027:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788573754.531032:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573754.531041:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2100
00000100:00080000:2.0:1788573754.531055:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573754.531061:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573754.531092:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453360938752/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573754.531115:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573754.531118:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573754.531119:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573754.531122:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2100
00000100:00080000:2.0:1788573754.531125:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573754.531128:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573754.531137:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573754.531145:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453360938880/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573754.531161:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788573754.531161:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360938752:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788573754.531180:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573754.531183:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573754.531187:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2100
00000100:00080000:2.0:1788573754.531190:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573754.531192:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573754.531195:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573754.531208:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453360939008/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573754.531214:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573754.531217:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573754.531218:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573754.531222:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2100
00000100:00080000:2.0:1788573754.531224:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573754.531227:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573754.531230:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573754.531238:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453360939136/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573754.531243:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573754.531245:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573754.531246:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573754.531249:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2100
00000100:00080000:2.0:1788573754.531252:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573754.531255:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573754.531259:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573754.531268:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453360939264/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573754.531274:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573754.531277:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573754.531278:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573754.531283:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2100
00000100:00080000:2.0:1788573754.531285:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573754.531287:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573754.531291:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573754.531300:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453360939392/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573754.531308:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573754.531311:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573754.531312:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573754.531321:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2100
00000100:00080000:2.0:1788573754.531326:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573754.531329:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573754.531334:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360938880:192.168.202.140@tcp:38:kworker.0
00000008:00100000:2.0:1788573754.531337:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573754.531353:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453360939520/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573754.531375:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360939008:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573754.531400:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360939136:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573754.531415:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360939264:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573754.531429:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360939392:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573754.531447:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360939520:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573754.914985:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573754.914987:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573754.915020:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573754.915045:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788573754.915074:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573754.915088:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573755.555013:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573755.938931:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573755.938997:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573755.939031:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573755.939055:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573755.939057:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573755.939063:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573756.579000:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573756.963007:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573756.963013:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573756.963027:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573756.963055:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573756.963079:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788573756.963113:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573757.603004:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000400:00000100:3.0:1788573757.603244:0:2336:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.140:988
00000400:00000100:3.0:1788573757.603306:0:2336:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.140@tcp at host 192.168.202.140 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:3.0:1788573757.603330:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788573757.603379:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788573757.603398:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:0.0:1788573757.603407:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573754/real 1788573757]  req@ffff8dc020495500 x1875453360938752/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573779 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:3.0:1788573757.603414:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788573757.603430:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788573757.603442:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:0.0:1788573757.603450:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453360938752/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573779 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:3.0:1788573757.603457:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00080000:0.0:1788573757.603476:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573757.603484:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573757.603490:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360938752:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788573757.603518:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573754/real 1788573757]  req@ffff8dc020494380 x1875453360939520/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573779 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573757.603533:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453360939520/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573779 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573757.603541:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573757.603546:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573757.603549:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360939520:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573757.603557:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573754/real 1788573757]  req@ffff8dc020494700 x1875453360938880/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573779 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573757.603569:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453360938880/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573779 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573757.603581:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573757.603585:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573757.603588:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360938880:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573757.603596:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573754/real 1788573757]  req@ffff8dc020496a00 x1875453360939008/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573779 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573757.603608:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453360939008/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573779 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573757.603617:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573757.603621:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573757.603624:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360939008:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573757.603632:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573754/real 1788573757]  req@ffff8dc020494e00 x1875453360939136/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573779 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573757.603644:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453360939136/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573779 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573757.603653:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573757.603657:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573757.603661:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360939136:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573757.603669:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573754/real 1788573757]  req@ffff8dc020494000 x1875453360939264/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573779 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573757.603681:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453360939264/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573779 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573757.603690:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573757.603694:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573757.603698:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360939264:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573757.603706:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573754/real 1788573757]  req@ffff8dc020497100 x1875453360939392/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573779 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573757.603718:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453360939392/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573779 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573757.603727:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573757.603731:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573757.603734:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360939392:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573757.987045:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573757.987062:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573757.987062:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573757.987066:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573757.987106:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788573757.987170:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573758.626995:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573759.011017:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573759.011028:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573759.011069:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788573759.011070:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573759.011087:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573759.011115:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573759.650969:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788573759.651014:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573759.651019:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788573759.651023:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573759.651031:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2105
00000100:00080000:0.0:1788573759.651039:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573759.651044:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788573759.651075:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453360939648/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573759.651102:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573759.651105:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573759.651107:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573759.651109:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2105
00000100:00080000:0.0:1788573759.651112:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573759.651114:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573759.651122:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573759.651132:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453360939776/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573759.651140:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573759.651143:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573759.651144:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573759.651147:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2105
00000100:00080000:0.0:1788573759.651149:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573759.651152:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573759.651156:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573759.651161:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360939648:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788573759.651166:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453360939904/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573759.651177:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573759.651179:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573759.651180:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573759.651182:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2105
00000100:00080000:0.0:1788573759.651184:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573759.651186:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573759.651188:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573759.651194:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453360940032/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573759.651202:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573759.651205:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573759.651207:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573759.651212:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2105
00000100:00080000:0.0:1788573759.651216:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573759.651221:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573759.651226:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573759.651240:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453360940160/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788573759.651247:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788573759.651258:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573759.651263:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573759.651265:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573759.651271:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2105
00000100:00080000:0.0:1788573759.651276:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573759.651281:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573759.651287:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573759.651298:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573759/real 1788573759]  req@ffff8dc006711500 x1875453360939648/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573784 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573759.651304:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453360940288/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573759.651329:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573759.651332:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573759.651334:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788573759.651339:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453360939648/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573784 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573759.651343:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2105
00000100:00080000:0.0:1788573759.651352:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573759.651360:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:3.0:1788573759.651361:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1788573759.651368:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788573759.651370:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573759.651378:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360939648:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788573759.651388:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453360940416/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573759.651390:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360939776:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573759.651426:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573759.651444:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573759/real 1788573759]  req@ffff8dc006710380 x1875453360939776/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573784 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573759.651459:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453360939776/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573784 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573759.651472:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573759.651476:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573759.651479:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360939776:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573759.651510:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360939904:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573759.651534:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573759.651546:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573759/real 1788573759]  req@ffff8dc006712680 x1875453360939904/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573784 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573759.651559:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453360939904/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573784 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573759.651569:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573759.651572:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573759.651576:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360939904:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573759.651582:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360940032:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573759.651599:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573759.651609:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573759/real 1788573759]  req@ffff8dc006713480 x1875453360940032/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573784 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573759.651621:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453360940032/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573784 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573759.651630:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573759.651633:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573759.651637:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360940032:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573759.651643:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360940160:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573759.651660:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573759.651670:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573759/real 1788573759]  req@ffff8dc006711c00 x1875453360940160/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573784 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573759.651682:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453360940160/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573784 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573759.651699:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573759.651784:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573759.651789:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360940160:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573759.651796:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360940288:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573759.651819:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573759.651837:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573759/real 1788573759]  req@ffff8dc006712a00 x1875453360940288/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573784 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573759.651850:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453360940288/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573784 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573759.651859:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573759.651863:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573759.651891:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360940288:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573759.651899:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360940416:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573759.651939:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573759.651951:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573759/real 1788573759]  req@ffff8dc006713b80 x1875453360940416/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573784 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573759.651964:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453360940416/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573784 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573759.651973:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573759.651976:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573759.651980:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360940416:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573760.034994:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573760.034994:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573760.035013:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573760.035028:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573760.035030:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788573760.035038:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573760.674992:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573761.058948:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573761.058964:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573761.058983:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573761.058988:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573761.059014:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788573761.059018:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573761.698947:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573762.082973:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573762.082979:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788573762.083001:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573762.083008:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573762.083021:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573762.083023:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573762.722960:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573763.106936:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573763.106941:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573763.106945:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573763.106947:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573763.106972:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788573763.107029:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573763.746957:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573764.131019:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573764.131019:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573764.131025:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573764.131072:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573764.131081:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788573764.131115:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573764.770968:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788573764.771019:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573764.771024:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788573764.771027:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573764.771036:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2110
00000100:00080000:3.0:1788573764.771045:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573764.771063:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573764.771095:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644dc00 x1875453360940544/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573764.771120:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573764.771123:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573764.771125:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573764.771127:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2110
00000100:00080000:3.0:1788573764.771130:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573764.771133:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573764.771141:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573764.771151:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ca80 x1875453360940672/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573764.771164:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573764.771167:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788573764.771169:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573764.771175:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2110
00000100:00100000:2.0:1788573764.771177:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360940544:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788573764.771179:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573764.771185:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573764.771190:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573764.771199:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f800 x1875453360940800/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573764.771208:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573764.771212:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788573764.771214:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573764.771218:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2110
00000100:00080000:3.0:1788573764.771233:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573764.771238:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573764.771243:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573764.771258:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c000 x1875453360940928/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788573764.771268:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788573764.771272:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788573764.771306:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573764/real 1788573764]  req@ffff8dc00644dc00 x1875453360940544/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573789 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573764.771319:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644dc00 x1875453360940544/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573789 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573764.771329:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573764.771332:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573764.771335:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360940544:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788573764.771341:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360940672:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788573764.771345:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573764.771348:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573764.771353:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2110
00000100:00080000:3.0:1788573764.771358:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1788573764.771361:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788573764.771365:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573764.771371:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573764.771375:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573764/real 1788573764]  req@ffff8dc00644ca80 x1875453360940672/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573789 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573764.771384:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ce00 x1875453360941056/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788573764.771389:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ca80 x1875453360940672/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573789 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573764.771397:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573764.771399:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573764.771402:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360940672:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788573764.771419:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360940800:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573764.771433:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573764.771440:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573764/real 1788573764]  req@ffff8dc00644f800 x1875453360940800/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573789 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573764.771448:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f800 x1875453360940800/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573789 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573764.771454:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573764.771456:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573764.771458:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360940800:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573764.771463:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360940928:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573764.771475:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573764.771483:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573764/real 1788573764]  req@ffff8dc00644c000 x1875453360940928/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573789 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573764.771511:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c000 x1875453360940928/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573789 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573764.771511:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573764.771519:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788573764.771523:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573764.771527:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573764.771531:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2110
00000100:00080000:2.0:1788573764.771534:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573764.771537:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360940928:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573764.771546:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360941056:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788573764.771565:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788573764.771568:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573764.771574:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573764.771579:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573764.771581:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573764/real 1788573764]  req@ffff8dc00644ce00 x1875453360941056/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573789 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573764.771593:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ea00 x1875453360941184/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788573764.771594:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ce00 x1875453360941056/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573789 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573764.771616:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573764.771618:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573764.771623:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573764.771626:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788573764.771627:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573764.771637:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2110
00000100:00100000:2.0:1788573764.771638:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360941056:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788573764.771640:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573764.771645:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573764.771648:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573764.771652:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360941184:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573764.771658:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d500 x1875453360941312/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788573764.771672:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573764.771684:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573764/real 1788573764]  req@ffff8dc00644ea00 x1875453360941184/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573789 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573764.771693:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ea00 x1875453360941184/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573789 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573764.771698:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573764.771700:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573764.771702:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360941184:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573764.771708:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360941312:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788573764.771718:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573764.771724:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573764/real 1788573764]  req@ffff8dc00644d500 x1875453360941312/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573789 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573764.771731:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d500 x1875453360941312/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573789 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573764.771736:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573764.771737:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788573764.771739:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360941312:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573765.154960:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573765.154965:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573765.154995:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573765.155077:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573765.155087:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573765.155110:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573765.794934:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573766.178954:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573766.178954:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573766.178959:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788573766.178985:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573766.178993:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573766.179004:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573766.819014:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573767.203034:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573767.203035:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573767.203037:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573767.203080:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573767.203092:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573767.203096:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573767.842951:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573768.226955:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573768.226955:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573768.226962:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573768.226963:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573768.226991:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788573768.227068:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573768.866970:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573769.250953:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573769.250978:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573769.250980:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573769.250987:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573769.251013:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573769.251051:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573769.891005:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788573769.891011:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573769.891016:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788573769.891020:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573769.891029:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2115
00000100:00080000:2.0:1788573769.891037:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573769.891044:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573769.891092:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453360941440/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573769.891141:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573769.891145:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573769.891147:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573769.891151:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2115
00000100:00080000:2.0:1788573769.891156:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573769.891160:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573769.891169:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360941440:192.168.202.140@tcp:250:kworker.0
00000008:00100000:2.0:1788573769.891179:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573769.891197:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453360941568/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573769.891209:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573769.891213:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573769.891216:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573769.891220:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2115
00000100:00080000:2.0:1788573769.891236:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573769.891241:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573769.891246:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788573769.891252:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573769.891263:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453360941696/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573769.891274:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573769.891278:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573769.891279:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573769.891283:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2115
00000100:00080000:2.0:1788573769.891287:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573769.891290:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573769.891306:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573769.891317:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573769/real 1788573769]  req@ffff8dc020494a80 x1875453360941440/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573794 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573769.891329:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453360941824/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573769.891336:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453360941440/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573794 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573769.891346:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573769.891350:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573769.891352:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573769.891356:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788573769.891358:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788573769.891362:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360941440:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788573769.891368:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2115
00000100:00080000:2.0:1788573769.891374:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573769.891379:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573769.891384:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573769.891388:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360941568:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788573769.891401:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453360941952/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788573769.891410:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788573769.891415:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573769.891421:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573769.891423:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788573769.891424:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573769/real 1788573769]  req@ffff8dc020497480 x1875453360941568/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573794 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573769.891435:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2115
00000100:00080000:2.0:1788573769.891443:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573769.891458:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573769.891464:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573769.891467:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453360941568/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573794 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573769.891479:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453360942080/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573769.891483:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573769.891494:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788573769.891500:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788573769.891502:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360941568:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788573769.891506:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573769.891510:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788573769.891515:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360941696:192.168.202.140@tcp:8:kworker.0
00000100:00080000:2.0:1788573769.891518:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2115
00000100:00080000:2.0:1788573769.891526:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573769.891531:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573769.891535:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573769.891549:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453360942208/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788573769.891561:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573769.891578:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573769/real 1788573769]  req@ffff8dc020495180 x1875453360941696/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573794 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573769.891592:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453360941696/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573794 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573769.891601:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573769.891605:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573769.891607:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360941696:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573769.891612:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360941824:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573769.891630:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573769.891647:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573769/real 1788573769]  req@ffff8dc020495880 x1875453360941824/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573794 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573769.891660:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453360941824/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573794 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573769.891685:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573769.891689:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573769.891692:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360941824:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573769.891723:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360941952:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573769.891740:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573769.891758:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573769/real 1788573769]  req@ffff8dc020496d80 x1875453360941952/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573794 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573769.891766:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453360941952/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573794 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573769.891773:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573769.891775:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573769.891777:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360941952:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573769.891781:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360942080:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573769.891792:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573769.891797:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573769/real 1788573769]  req@ffff8dc020494a80 x1875453360942080/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573794 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573769.891805:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453360942080/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573794 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573769.891810:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573769.891811:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573769.891814:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360942080:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573769.891817:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360942208:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573769.891826:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573769.891839:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573769/real 1788573769]  req@ffff8dc020497100 x1875453360942208/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573794 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573769.891846:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453360942208/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573794 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573769.891850:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573769.891852:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573769.891854:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360942208:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573770.274970:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573770.274970:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573770.274970:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573770.274970:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573770.275001:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788573770.275071:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573770.914952:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573771.298943:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573771.298956:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573771.299023:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573771.299024:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573771.299024:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573771.299095:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573771.939041:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573772.322992:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573772.322999:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573772.323000:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573772.323013:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573772.323048:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788573772.323092:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573772.962961:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573773.346941:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573773.346987:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573773.347002:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573773.347024:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573773.347047:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788573773.347105:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573773.987011:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573774.371019:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573774.371020:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573774.371043:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573774.371067:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573774.371077:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573774.371107:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00080000:2.0:1788573775.010951:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573775.010959:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788573775.010963:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788573775.010971:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788573775.010972:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2120
00000100:00080000:2.0:1788573775.010985:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573775.010992:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573775.011023:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453360942336/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573775.011043:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573775.011046:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573775.011047:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573775.011050:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2120
00000100:00080000:2.0:1788573775.011052:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573775.011054:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573775.011062:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573775.011071:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453360942464/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573775.011079:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573775.011082:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573775.011084:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573775.011087:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2120
00000100:00080000:2.0:1788573775.011089:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573775.011093:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573775.011096:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573775.011096:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360942336:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788573775.011108:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453360942592/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573775.011114:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573775.011117:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573775.011118:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573775.011121:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2120
00000100:00080000:2.0:1788573775.011123:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573775.011125:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573775.011128:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573775.011136:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453360942720/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573775.011141:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573775.011143:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573775.011144:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573775.011147:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2120
00000100:00080000:2.0:1788573775.011150:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573775.011152:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573775.011155:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788573775.011161:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573775.011164:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453360942848/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573775.011171:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573775.011174:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573775.011176:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573775.011179:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2120
00000100:00080000:2.0:1788573775.011182:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573775.011184:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573775.011187:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573775.011194:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453360942976/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573775.011199:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788573775.011201:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573775/real 1788573775]  req@ffff8dc020494000 x1875453360942336/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573800 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573775.011202:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573775.011206:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573775.011212:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2120
00000100:00080000:2.0:1788573775.011218:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573775.011223:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573775.011227:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573775.011235:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453360942336/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573800 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573775.011236:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453360943104/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573775.011268:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573775.011273:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573775.011277:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360942336:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788573775.011296:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360942464:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573775.011316:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573775.011325:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573775/real 1788573775]  req@ffff8dc020494e00 x1875453360942464/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573800 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573775.011334:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453360942464/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573800 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573775.011341:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573775.011343:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573775.011346:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360942464:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573775.011350:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360942592:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573775.011362:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573775.011368:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573775/real 1788573775]  req@ffff8dc020496a00 x1875453360942592/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573800 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573775.011376:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453360942592/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573800 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573775.011382:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573775.011384:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573775.011386:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360942592:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573775.011390:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360942720:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573775.011401:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573775.011407:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573775/real 1788573775]  req@ffff8dc020494700 x1875453360942720/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573800 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573775.011414:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453360942720/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573800 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573775.011420:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573775.011422:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573775.011423:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360942720:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573775.011427:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360942848:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573775.011437:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573775.011443:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573775/real 1788573775]  req@ffff8dc020494380 x1875453360942848/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573800 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573775.011450:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453360942848/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573800 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573775.011456:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573775.011457:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573775.011459:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360942848:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573775.011463:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360942976:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573775.011473:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573775.011479:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573775/real 1788573775]  req@ffff8dc020495500 x1875453360942976/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573800 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573775.011491:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453360942976/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573800 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573775.011496:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573775.011498:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573775.011500:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360942976:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573775.011503:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360943104:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573775.011513:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573775.011518:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573775/real 1788573775]  req@ffff8dc020497100 x1875453360943104/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573800 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573775.011525:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453360943104/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573800 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573775.011531:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573775.011532:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573775.011534:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360943104:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573775.394968:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573775.394968:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573775.394969:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573775.394997:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788573775.395001:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573775.395001:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573776.035029:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573776.418957:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573776.418997:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573776.419001:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573776.419007:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573776.419008:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573776.419102:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573777.058960:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573777.442964:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573777.442964:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573777.442971:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573777.442997:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573777.443000:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788573777.443065:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573778.082959:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573778.466957:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573778.466958:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573778.466993:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573778.467003:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573778.467005:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573778.467019:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573779.106988:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573779.491003:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573779.491005:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573779.491027:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573779.491050:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573779.491067:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788573779.491233:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1788573780.130958:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788573780.130961:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788573780.130968:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788573780.130972:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573780.130981:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2125
00000100:00080000:2.0:1788573780.130992:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573780.130999:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573780.131039:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453360943232/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573780.131063:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573780.131066:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573780.131067:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573780.131070:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2125
00000100:00080000:2.0:1788573780.131073:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573780.131075:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573780.131083:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573780.131094:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453360943360/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573780.131103:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573780.131106:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573780.131107:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788573780.131112:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360943232:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788573780.131113:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2125
00000100:00080000:2.0:1788573780.131119:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573780.131123:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573780.131127:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573780.131135:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453360943488/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573780.131146:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573780.131149:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573780.131150:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573780.131153:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2125
00000100:00080000:2.0:1788573780.131158:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573780.131161:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573780.131164:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573780.131170:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453360943616/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573780.131178:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1788573780.131183:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788573780.131185:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573780.131190:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573780.131195:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2125
00000100:00080000:2.0:1788573780.131200:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573780.131205:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573780.131210:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573780.131224:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453360943744/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573780.131234:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573780/real 1788573780]  req@ffff8dc020494a80 x1875453360943232/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573805 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573780.131237:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573780.131245:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573780.131247:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573780.131251:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2125
00000100:00080000:2.0:1788573780.131257:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573780.131264:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573780.131270:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573780.131270:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453360943232/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573805 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573780.131284:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1788573780.131292:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453360943872/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573780.131293:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573780.131303:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360943232:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788573780.131311:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573780.131315:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573780.131316:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573780.131320:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2125
00000100:00080000:2.0:1788573780.131323:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573780.131326:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573780.131329:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573780.131335:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360943360:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788573780.131340:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453360944000/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788573780.131364:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573780.131376:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573780/real 1788573780]  req@ffff8dc020496d80 x1875453360943360/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573805 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573780.131385:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453360943360/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573805 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573780.131392:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573780.131394:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573780.131397:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360943360:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573780.131401:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360943488:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573780.131414:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573780.131420:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573780/real 1788573780]  req@ffff8dc020495880 x1875453360943488/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573805 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573780.131428:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453360943488/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573805 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573780.131446:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573780.131448:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573780.131451:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360943488:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573780.131455:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360943616:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573780.131466:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573780.131472:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573780/real 1788573780]  req@ffff8dc020495180 x1875453360943616/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573805 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573780.131480:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453360943616/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573805 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573780.131485:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573780.131487:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573780.131489:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360943616:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573780.131493:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360943744:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573780.131526:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573780.131535:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573780/real 1788573780]  req@ffff8dc020497480 x1875453360943744/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573805 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573780.131543:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453360943744/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573805 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573780.131549:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573780.131551:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573780.131554:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360943744:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573780.131558:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360943872:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573780.131571:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573780.131577:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573780/real 1788573780]  req@ffff8dc020497100 x1875453360943872/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573805 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573780.131584:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453360943872/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573805 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573780.131589:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573780.131591:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573780.131593:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360943872:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573780.131606:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360944000:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573780.131617:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573780.131623:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573780/real 1788573780]  req@ffff8dc020495500 x1875453360944000/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573805 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573780.131630:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453360944000/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573805 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573780.131635:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573780.131636:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573780.131638:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360944000:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573780.514970:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573780.515011:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573780.515043:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573780.515055:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573780.515156:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573780.515222:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573781.154942:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573781.538960:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573781.538961:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573781.538966:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573781.538968:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573781.538992:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788573781.539042:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573782.178959:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573782.562936:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573782.562937:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573782.562979:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573782.562987:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573782.562993:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573782.563000:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573783.202986:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573783.587010:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573783.587013:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573783.587060:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573783.587073:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573783.587081:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573783.587109:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573784.226986:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573784.610941:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573784.610946:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573784.610961:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573784.610970:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573784.610991:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788573784.611004:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573785.250934:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788573785.250938:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573785.250945:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788573785.250948:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573785.250956:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2130
00000100:00080000:2.0:1788573785.250964:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573785.250970:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573785.251001:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453360944128/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573785.251024:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573785.251027:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573785.251029:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573785.251031:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2130
00000100:00080000:2.0:1788573785.251033:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573785.251036:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573785.251043:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573785.251051:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453360944256/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573785.251057:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573785.251060:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573785.251061:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573785.251063:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2130
00000100:00080000:2.0:1788573785.251065:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573785.251067:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573785.251069:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573785.251074:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453360944384/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573785.251085:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573785.251087:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573785.251089:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573785.251091:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2130
00000100:00080000:2.0:1788573785.251094:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573785.251096:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573785.251099:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573785.251109:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453360944512/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573785.251109:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360944128:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788573785.251122:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573785.251124:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573785.251125:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573785.251127:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2130
00000100:00080000:2.0:1788573785.251129:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573785.251132:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573785.251135:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573785.251142:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453360944640/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573785.251148:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573785.251151:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573785.251153:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573785.251155:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2130
00000100:00080000:2.0:1788573785.251173:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1788573785.251176:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788573785.251182:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573785.251190:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573785.251206:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453360944768/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573785.251211:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573785/real 1788573785]  req@ffff8dc020494380 x1875453360944128/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573810 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573785.251233:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573785.251236:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:3.0:1788573785.251238:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453360944128/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573810 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573785.251239:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573785.251248:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2130
00000100:00080000:2.0:1788573785.251254:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573785.251254:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573785.251260:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:3.0:1788573785.251261:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000008:00100000:2.0:1788573785.251268:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573785.251268:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360944128:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788573785.251276:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360944256:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788573785.251284:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453360944896/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788573785.251296:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573785.251307:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573785/real 1788573785]  req@ffff8dc020494700 x1875453360944256/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573810 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573785.251315:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453360944256/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573810 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573785.251322:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573785.251324:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573785.251327:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360944256:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573785.251330:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360944384:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573785.251342:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573785.251348:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573785/real 1788573785]  req@ffff8dc020496a00 x1875453360944384/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573810 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573785.251361:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453360944384/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573810 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573785.251376:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573785.251380:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573785.251383:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360944384:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573785.251409:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360944512:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573785.251452:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573785.251461:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573785/real 1788573785]  req@ffff8dc020494e00 x1875453360944512/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573810 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573785.251469:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453360944512/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573810 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573785.251475:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573785.251477:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573785.251479:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360944512:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573785.251483:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360944640:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573785.251494:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573785.251500:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573785/real 1788573785]  req@ffff8dc020494000 x1875453360944640/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573810 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573785.251512:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453360944640/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573810 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573785.251517:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573785.251519:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573785.251521:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360944640:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573785.251525:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360944768:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573785.251534:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573785.251540:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573785/real 1788573785]  req@ffff8dc020495500 x1875453360944768/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573810 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573785.251556:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453360944768/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573810 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573785.251561:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573785.251563:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573785.251565:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360944768:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573785.251569:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360944896:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573785.251579:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573785.251585:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573785/real 1788573785]  req@ffff8dc020497100 x1875453360944896/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573810 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573785.251592:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453360944896/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573810 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573785.251602:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573785.251604:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573785.251606:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360944896:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573785.634959:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573785.634960:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573785.634960:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573785.634987:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573785.635019:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573785.635037:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573786.274959:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573786.658954:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573786.658954:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573786.658954:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573786.658972:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573786.658994:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788573786.659079:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573787.298960:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573787.682974:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573787.682996:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573787.683009:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573787.683023:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573787.683035:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788573787.683083:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573788.323035:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573788.706958:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573788.706986:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573788.707007:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573788.707007:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573788.707021:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788573788.707142:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573789.347032:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573789.730980:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573789.730993:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573789.730996:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573789.731048:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573789.731067:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573789.731110:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573790.371012:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788573790.371014:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573790.371025:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788573790.371030:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573790.371040:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2136
00000100:00080000:0.0:1788573790.371049:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573790.371055:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788573790.371086:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453360945024/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573790.371113:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573790.371118:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573790.371120:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573790.371124:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2136
00000100:00080000:0.0:1788573790.371128:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573790.371133:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573790.371143:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573790.371159:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453360945152/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573790.371168:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360945024:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788573790.371175:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573790.371181:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573790.371183:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573790.371188:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2136
00000100:00080000:0.0:1788573790.371193:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573790.371200:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573790.371207:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573790.371223:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453360945280/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573790.371231:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573790.371235:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573790.371236:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573790.371240:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2136
00000100:00080000:0.0:1788573790.371243:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573790.371247:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573790.371251:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788573790.371253:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573790.371266:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453360945408/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573790.371276:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573790.371279:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573790.371280:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573790.371283:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2136
00000100:00080000:0.0:1788573790.371285:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573790.371288:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573790.371293:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573790.371311:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453360945536/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573790.371319:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573790/real 1788573790]  req@ffff8dc006710e00 x1875453360945024/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573815 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573790.371337:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573790.371358:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573790.371360:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573790.371367:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2136
00000100:00080000:0.0:1788573790.371369:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573790.371377:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573790.371378:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453360945024/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573815 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1788573790.371382:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788573790.371402:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1788573790.371403:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453360945664/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573790.371416:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573790.371427:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360945024:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788573790.371431:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573790.371441:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573790.371443:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573790.371448:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2136
00000100:00080000:0.0:1788573790.371453:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573790.371456:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573790.371460:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573790.371469:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360945152:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573790.371472:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453360945792/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788573790.371515:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573790.371528:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573790/real 1788573790]  req@ffff8dc006712300 x1875453360945152/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573815 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573790.371542:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453360945152/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573815 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573790.371551:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573790.371554:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573790.371556:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360945152:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573790.371572:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360945280:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573790.371587:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573790.371593:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573790/real 1788573790]  req@ffff8dc006713100 x1875453360945280/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573815 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573790.371601:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453360945280/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573815 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573790.371607:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573790.371609:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573790.371611:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360945280:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573790.371615:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360945408:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573790.371626:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573790.371632:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573790/real 1788573790]  req@ffff8dc006713800 x1875453360945408/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573815 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573790.371639:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453360945408/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573815 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573790.371650:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573790.371653:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573790.371655:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360945408:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573790.371659:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360945536:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573790.371669:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573790.371675:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573790/real 1788573790]  req@ffff8dc006711880 x1875453360945536/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573815 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573790.371682:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453360945536/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573815 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573790.371689:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573790.371691:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573790.371692:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360945536:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573790.371696:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360945664:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573790.371708:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573790.371714:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573790/real 1788573790]  req@ffff8dc006713b80 x1875453360945664/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573815 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573790.371721:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453360945664/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573815 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573790.371726:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573790.371728:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573790.371731:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360945664:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573790.371746:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360945792:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573790.371758:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573790.371764:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573790/real 1788573790]  req@ffff8dc006712a00 x1875453360945792/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573815 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573790.371771:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453360945792/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573815 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573790.371777:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573790.371779:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573790.371780:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360945792:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573790.754961:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573790.754991:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573790.754992:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573790.755003:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573790.755031:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788573790.755110:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573791.394986:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573791.778935:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573791.778947:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573791.778957:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573791.778959:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573791.778976:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573791.779032:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573792.418940:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573792.802952:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573792.802957:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573792.802970:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573792.802983:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573792.803004:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788573792.803009:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573793.443002:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573793.826961:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573793.826963:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573793.826967:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573793.826995:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573793.827006:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573793.827007:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573794.466947:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573794.850941:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573794.850942:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573794.850952:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573794.850952:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573794.850974:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788573794.851014:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1788573795.490962:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788573795.490963:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788573795.490974:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788573795.490979:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573795.490990:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2141
00000100:00080000:0.0:1788573795.491000:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573795.491007:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788573795.491041:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453360945920/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573795.491064:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573795.491067:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573795.491068:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573795.491071:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2141
00000100:00080000:0.0:1788573795.491074:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573795.491078:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573795.491088:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573795.491104:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453360946048/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573795.491116:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360945920:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788573795.491119:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573795.491127:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573795.491130:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573795.491134:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2141
00000100:00080000:0.0:1788573795.491138:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573795.491142:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573795.491147:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573795.491158:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453360946176/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573795.491165:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573795.491168:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573795.491169:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573795.491172:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2141
00000100:00080000:0.0:1788573795.491175:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573795.491177:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573795.491181:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788573795.491186:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573795.491193:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453360946304/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573795.491201:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573795.491203:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573795.491204:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573795.491207:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2141
00000100:00080000:0.0:1788573795.491210:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573795.491212:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573795.491216:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573795.491223:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573795/real 1788573795]  req@ffff8dc006711c00 x1875453360945920/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573820 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573795.491226:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453360946432/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573795.491266:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573795.491269:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573795.491271:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788573795.491274:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453360945920/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573820 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573795.491278:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2141
00000100:00080000:0.0:1788573795.491284:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573795.491291:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:3.0:1788573795.491293:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1788573795.491296:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788573795.491299:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573795.491304:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360945920:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788573795.491314:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453360946560/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573795.491327:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360946048:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788573795.491328:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573795.491334:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573795.491337:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573795.491342:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2141
00000100:00080000:0.0:1788573795.491347:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573795.491355:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:3.0:1788573795.491355:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:0.0:1788573795.491363:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573795.491371:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573795/real 1788573795]  req@ffff8dc006713480 x1875453360946048/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573820 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573795.491377:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453360946688/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573795.491387:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453360946048/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573820 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573795.491396:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573795.491399:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573795.491402:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360946048:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573795.491407:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360946176:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573795.491420:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573795.491427:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573795/real 1788573795]  req@ffff8dc006712680 x1875453360946176/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573820 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573795.491435:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453360946176/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573820 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573795.491440:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573795.491442:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573795.491444:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360946176:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573795.491448:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360946304:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573795.491458:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573795.491464:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573795/real 1788573795]  req@ffff8dc006710380 x1875453360946304/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573820 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573795.491472:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453360946304/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573820 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573795.491478:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573795.491480:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573795.491481:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360946304:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573795.491485:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360946432:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573795.491495:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573795.491501:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573795/real 1788573795]  req@ffff8dc006711500 x1875453360946432/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573820 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573795.491508:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453360946432/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573820 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573795.491514:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573795.491516:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573795.491517:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360946432:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573795.491528:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360946560:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573795.491538:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573795.491544:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573795/real 1788573795]  req@ffff8dc006712a00 x1875453360946560/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573820 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573795.491552:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453360946560/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573820 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573795.491561:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573795.491563:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573795.491565:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360946560:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573795.491569:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360946688:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573795.491578:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573795.491583:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573795/real 1788573795]  req@ffff8dc006713b80 x1875453360946688/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573820 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573795.491590:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453360946688/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573820 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573795.491595:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573795.491597:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573795.491599:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360946688:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573795.874937:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573795.874947:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573795.874960:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573795.874972:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573795.874979:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573795.874988:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573796.515000:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573796.898992:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573796.898997:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573796.899015:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573796.899028:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573796.899041:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788573796.899056:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573797.538984:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573797.922968:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573797.922994:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573797.923001:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573797.923003:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573797.923059:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573797.923060:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573798.562961:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573798.946957:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573798.946962:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573798.946971:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573798.946972:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573798.946999:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788573798.947049:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573799.587023:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573799.970952:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573799.970961:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573799.970965:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573799.970991:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573799.970994:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573799.971015:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573800.610952:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573800.611003:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573800.611007:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788573800.611010:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573800.611019:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2146
00000100:00080000:1.0:1788573800.611028:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573800.611035:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573800.611066:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453360946816/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573800.611087:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573800.611090:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573800.611092:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573800.611095:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2146
00000100:00080000:1.0:1788573800.611099:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573800.611102:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573800.611110:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573800.611122:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360946944/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573800.611131:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573800.611135:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:0.0:1788573800.611136:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360946816:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788573800.611137:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573800.611142:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2146
00000100:00080000:1.0:1788573800.611159:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573800.611164:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573800.611169:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573800.611182:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360947072/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573800.611191:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573800.611194:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573800.611195:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573800.611198:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2146
00000100:00080000:1.0:1788573800.611219:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573800.611222:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573800.611224:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788573800.611230:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573800.611234:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360947200/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573800.611242:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573800.611245:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573800.611246:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573800.611249:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2146
00000100:00080000:1.0:1788573800.611253:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573800.611256:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573800.611259:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573800.611266:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360947328/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573800.611272:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573800.611275:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573800.611276:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573800.611278:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2146
00000100:00080000:1.0:1788573800.611281:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573800.611283:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573800.611287:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573800.611293:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360947456/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788573800.611300:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573800/real 1788573800]  req@ffff8dc005dc0a80 x1875453360946816/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573825 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573800.611300:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573800.611306:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573800.611309:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573800.611315:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2146
00000100:00080000:1.0:1788573800.611321:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573800.611326:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573800.611330:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573800.611343:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453360946816/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573825 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573800.611343:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360947584/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573800.611368:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573800.611374:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573800.611380:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360946816:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788573800.611406:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360946944:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788573800.611430:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573800.611440:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573800/real 1788573800]  req@ffff8dc005dc3b80 x1875453360946944/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573825 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573800.611449:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360946944/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573825 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573800.611466:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573800.611468:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573800.611471:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360946944:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573800.611475:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360947072:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573800.611489:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573800.611497:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573800/real 1788573800]  req@ffff8dc005dc1c00 x1875453360947072/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573825 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573800.611505:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453360947072/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573825 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573800.611512:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573800.611514:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573800.611516:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360947072:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573800.611519:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360947200:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573800.611530:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573800.611536:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573800/real 1788573800]  req@ffff8dc005dc2d80 x1875453360947200/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573825 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573800.611543:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360947200/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573825 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573800.611550:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573800.611551:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573800.611553:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360947200:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573800.611557:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360947328:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788573800.611567:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573800.611574:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573800/real 1788573800]  req@ffff8dc005dc1180 x1875453360947328/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573825 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573800.611581:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360947328/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573825 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573800.611587:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573800.611589:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573800.611591:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360947328:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573800.611595:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360947456:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573800.611606:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573800.611614:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573800/real 1788573800]  req@ffff8dc005dc0700 x1875453360947456/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573825 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573800.611621:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453360947456/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573825 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573800.611626:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573800.611628:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573800.611630:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360947456:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573800.611634:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360947584:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573800.611645:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573800.611654:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573800/real 1788573800]  req@ffff8dc005dc1500 x1875453360947584/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573825 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573800.611662:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360947584/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573825 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573800.611668:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573800.611670:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573800.611673:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360947584:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573800.994957:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573800.994961:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573800.994965:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573800.994966:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573800.994989:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788573800.995049:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573801.634959:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573802.018953:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573802.018953:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573802.018959:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573802.018983:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573802.018998:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788573802.019022:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573802.658935:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573803.042978:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573803.042979:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573803.042979:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573803.042979:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573803.043025:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788573803.043073:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573803.682977:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573804.066979:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573804.066980:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573804.066981:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573804.066981:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573804.067019:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788573804.067081:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573804.706943:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573805.090988:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573805.090988:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573805.090988:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573805.091029:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573805.091038:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788573805.091167:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1788573805.730986:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788573805.730991:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788573805.730996:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788573805.731001:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573805.731010:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2151
00000100:00080000:2.0:1788573805.731018:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573805.731025:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573805.731068:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453360947712/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573805.731093:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573805.731097:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573805.731099:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573805.731104:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2151
00000100:00080000:2.0:1788573805.731108:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573805.731114:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573805.731125:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573805.731130:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360947712:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788573805.731143:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453360947840/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573805.731155:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573805.731159:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573805.731161:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573805.731166:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2151
00000100:00080000:2.0:1788573805.731171:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573805.731176:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573805.731182:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788573805.731193:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573805.731197:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453360947968/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573805.731210:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573805.731214:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573805.731216:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573805.731220:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2151
00000100:00080000:2.0:1788573805.731224:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573805.731229:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788573805.731233:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573805/real 1788573805]  req@ffff8dc020497480 x1875453360947712/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573830 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1788573805.731237:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573805.731253:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453360948096/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788573805.731256:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453360947712/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573830 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573805.731274:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573805.731277:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573805.731278:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573805.731279:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573805.731284:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573805.731287:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360947712:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788573805.731295:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2151
00000100:00080000:2.0:1788573805.731305:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788573805.731307:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360947840:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788573805.731313:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573805.731321:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788573805.731337:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573805.731337:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453360948224/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788573805.731352:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573805/real 1788573805]  req@ffff8dc020495180 x1875453360947840/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573830 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573805.731352:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573805.731362:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573805.731364:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573805.731370:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2151
00000100:00080000:2.0:1788573805.731376:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788573805.731377:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453360947840/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573830 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573805.731386:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:0.0:1788573805.731393:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:2.0:1788573805.731395:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1788573805.731399:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573805.731403:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360947840:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788573805.731414:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453360948352/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788573805.731415:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360947968:192.168.202.140@tcp:8:kworker.0
00000100:00080000:2.0:1788573805.731434:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1788573805.731439:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788573805.731440:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573805.731444:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573805.731448:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2151
00000100:00080000:2.0:1788573805.731452:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788573805.731453:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573805/real 1788573805]  req@ffff8dc020495880 x1875453360947968/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573830 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573805.731458:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573805.731466:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573805.731471:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453360947968/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573830 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573805.731478:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453360948480/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573805.731481:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573805.731489:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573805.731493:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360947968:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573805.731499:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360948096:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573805.731516:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573805.731528:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573805/real 1788573805]  req@ffff8dc020496d80 x1875453360948096/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573830 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573805.731540:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453360948096/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573830 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573805.731550:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573805.731554:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573805.731557:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360948096:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573805.731575:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360948224:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788573805.731591:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573805.731599:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573805/real 1788573805]  req@ffff8dc020494a80 x1875453360948224/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573830 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573805.731608:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453360948224/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573830 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573805.731614:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573805.731616:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573805.731618:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360948224:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573805.731622:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360948352:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573805.731633:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573805.731638:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573805/real 1788573805]  req@ffff8dc020497480 x1875453360948352/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573830 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573805.731645:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453360948352/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573830 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573805.731651:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573805.731652:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573805.731654:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360948352:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573805.731658:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360948480:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573805.731667:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573805.731682:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573805/real 1788573805]  req@ffff8dc020497100 x1875453360948480/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573830 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573805.731695:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453360948480/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573830 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573805.731700:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573805.731702:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573805.731704:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360948480:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573806.114966:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573806.114971:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573806.114972:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573806.114978:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573806.115004:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788573806.115087:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573806.754985:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573807.138975:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573807.138975:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573807.138975:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573807.138976:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573807.139003:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788573807.139094:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573807.779017:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573808.162949:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573808.162969:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573808.162975:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573808.162982:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573808.163002:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788573808.163057:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573808.802971:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573809.186987:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573809.186988:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573809.186989:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573809.186989:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573809.187035:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788573809.187085:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573809.826939:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573810.210962:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573810.211012:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573810.211024:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573810.211025:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573810.211034:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788573810.211133:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573810.850996:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573810.851000:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573810.851008:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788573810.851013:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573810.851023:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2156
00000100:00080000:1.0:1788573810.851034:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573810.851042:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573810.851080:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453360948608/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573810.851121:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573810.851125:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573810.851127:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573810.851131:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2156
00000100:00080000:1.0:1788573810.851135:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573810.851140:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573810.851151:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573810.851165:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360948736/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788573810.851175:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360948608:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788573810.851181:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573810.851186:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573810.851188:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573810.851193:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2156
00000100:00080000:1.0:1788573810.851198:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573810.851202:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573810.851208:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573810.851221:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360948864/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573810.851231:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573810.851235:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573810.851237:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1788573810.851241:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788573810.851244:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2156
00000100:00080000:1.0:1788573810.851250:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573810.851254:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573810.851259:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573810.851271:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360948992/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573810.851281:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788573810.851291:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573810/real 1788573810]  req@ffff8dc005dc3800 x1875453360948608/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573835 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573810.851296:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573810.851304:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573810.851313:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2156
00000100:00080000:1.0:1788573810.851318:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788573810.851324:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453360948608/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573835 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573810.851327:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573810.851335:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1788573810.851347:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1788573810.851353:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360949120/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573810.851354:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573810.851361:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360948608:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788573810.851376:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573810.851381:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573810.851383:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573810.851389:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2156
00000100:00100000:0.0:1788573810.851392:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360948736:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788573810.851395:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573810.851401:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573810.851407:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788573810.851419:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573810.851422:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360949248/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788573810.851433:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573810/real 1788573810]  req@ffff8dc005dc1500 x1875453360948736/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573835 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573810.851436:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573810.851446:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573810.851450:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573810.851457:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2156
00000100:00100000:0.0:1788573810.851458:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360948736/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573835 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573810.851461:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573810.851471:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:0.0:1788573810.851473:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573810.851478:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000008:00100000:1.0:1788573810.851478:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573810.851485:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360948736:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573810.851491:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360948864:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573810.851496:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360949376/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1788573810.851511:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573810.851520:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573810/real 1788573810]  req@ffff8dc005dc0700 x1875453360948864/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573835 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573810.851529:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453360948864/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573835 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573810.851535:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573810.851538:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573810.851540:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360948864:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573810.851543:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360948992:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573810.851553:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573810.851558:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573810/real 1788573810]  req@ffff8dc005dc1180 x1875453360948992/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573835 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573810.851565:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360948992/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573835 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573810.851576:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573810.851578:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573810.851580:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360948992:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573810.851584:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360949120:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788573810.851593:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573810.851599:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573810/real 1788573810]  req@ffff8dc005dc2d80 x1875453360949120/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573835 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573810.851606:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360949120/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573835 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573810.851611:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573810.851613:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573810.851615:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360949120:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573810.851626:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360949248:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573810.851636:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573810.851642:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573810/real 1788573810]  req@ffff8dc005dc1c00 x1875453360949248/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573835 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573810.851648:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453360949248/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573835 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573810.851653:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573810.851655:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573810.851657:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360949248:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573810.851661:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360949376:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573810.851671:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573810.851676:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573810/real 1788573810]  req@ffff8dc005dc3b80 x1875453360949376/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573835 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573810.851683:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360949376/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573835 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573810.851688:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573810.851690:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573810.851692:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360949376:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573811.234986:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573811.234986:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573811.234994:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573811.235016:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573811.235027:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788573811.235031:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573811.874964:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573812.258963:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573812.258964:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573812.258965:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573812.258968:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573812.258999:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788573812.259043:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573812.899000:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573813.282952:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573813.282952:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573813.282967:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573813.282999:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573813.283001:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573813.283014:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573813.922968:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573814.306956:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573814.306979:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573814.306980:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573814.306999:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788573814.307008:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573814.307011:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573814.947008:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573815.330997:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573815.330997:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573815.331001:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573815.331029:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573815.331059:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573815.331105:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1788573815.970967:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788573815.970969:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573815.970979:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788573815.970984:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573815.970995:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2161
00000100:00080000:1.0:1788573815.971006:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573815.971014:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573815.971055:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453360949504/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573815.971080:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573815.971084:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573815.971086:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573815.971090:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2161
00000100:00080000:1.0:1788573815.971095:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573815.971101:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573815.971113:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573815.971122:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360949504:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788573815.971131:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360949632/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573815.971146:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573815.971150:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573815.971153:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573815.971158:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2161
00000100:00080000:1.0:1788573815.971172:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1788573815.971176:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788573815.971182:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573815.971190:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573815.971205:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360949760/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573815.971214:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788573815.971219:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573815/real 1788573815]  req@ffff8dc005dc0a80 x1875453360949504/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573840 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573815.971219:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573815.971223:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573815.971230:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2161
00000100:00080000:1.0:1788573815.971238:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788573815.971244:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453360949504/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573840 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573815.971245:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573815.971255:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1788573815.971258:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573815.971264:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573815.971268:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360949504:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788573815.971273:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360949888/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573815.971293:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573815.971297:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573815.971300:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788573815.971302:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360949632:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788573815.971307:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2161
00000100:00080000:1.0:1788573815.971314:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573815.971320:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573815.971331:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788573815.971341:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573815.971345:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360950016/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573815.971355:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573815.971360:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:0.0:1788573815.971361:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573815/real 1788573815]  req@ffff8dc005dc3b80 x1875453360949632/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573840 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573815.971362:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573815.971371:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2161
00000100:00080000:1.0:1788573815.971377:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573815.971382:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788573815.971386:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360949632/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573840 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1788573815.971387:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573815.971399:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360950144/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573815.971400:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573815.971408:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788573815.971414:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788573815.971415:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360949632:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788573815.971421:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573815.971424:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788573815.971427:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360949760:192.168.202.140@tcp:8:kworker.0
00000100:00080000:1.0:1788573815.971430:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2161
00000100:00080000:1.0:1788573815.971434:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573815.971436:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573815.971440:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573815.971448:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360950272/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1788573815.971453:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573815.971467:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573815/real 1788573815]  req@ffff8dc005dc1c00 x1875453360949760/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573840 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573815.971478:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453360949760/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573840 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573815.971484:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573815.971486:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573815.971488:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360949760:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573815.971493:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360949888:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573815.971504:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573815.971510:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573815/real 1788573815]  req@ffff8dc005dc2d80 x1875453360949888/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573840 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573815.971517:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360949888/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573840 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573815.971522:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573815.971524:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573815.971526:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360949888:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573815.971537:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360950016:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788573815.971548:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573815.971554:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573815/real 1788573815]  req@ffff8dc005dc1180 x1875453360950016/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573840 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573815.971561:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360950016/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573840 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573815.971567:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573815.971569:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573815.971571:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360950016:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573815.971574:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360950144:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573815.971584:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573815.971590:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573815/real 1788573815]  req@ffff8dc005dc0700 x1875453360950144/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573840 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573815.971598:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453360950144/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573840 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573815.971602:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573815.971604:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573815.971606:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360950144:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573815.971609:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360950272:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573815.971618:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573815.971624:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573815/real 1788573815]  req@ffff8dc005dc1500 x1875453360950272/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573840 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573815.971631:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360950272/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573840 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573815.971636:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573815.971638:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573815.971640:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360950272:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573816.355012:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573816.355051:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573816.355063:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788573816.355191:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573816.355196:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573816.355257:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573816.994967:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573817.378962:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573817.378962:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573817.378976:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573817.378997:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573817.379006:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788573817.379033:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573818.018947:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573818.402971:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573818.402971:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573818.402971:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573818.402980:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573818.403002:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788573818.403083:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573819.043017:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573819.426940:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573819.426960:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573819.426970:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573819.426973:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573819.426985:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788573819.427051:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573820.066974:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573820.450983:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573820.450984:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573820.450985:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573820.451022:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573820.451023:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788573820.451036:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1788573821.091001:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788573821.091006:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573821.091014:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788573821.091019:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573821.091032:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2166
00000100:00080000:1.0:1788573821.091046:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573821.091055:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573821.091104:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453360950400/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573821.091132:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573821.091134:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573821.091136:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573821.091139:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2166
00000100:00080000:1.0:1788573821.091142:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573821.091145:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573821.091154:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573821.091166:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360950528/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573821.091175:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573821.091178:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573821.091180:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788573821.091185:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360950400:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788573821.091185:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2166
00000100:00080000:1.0:1788573821.091192:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573821.091196:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573821.091200:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573821.091208:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360950656/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573821.091215:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573821.091217:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573821.091219:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573821.091221:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2166
00000100:00080000:1.0:1788573821.091223:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573821.091226:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573821.091229:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573821.091236:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360950784/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573821.091242:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573821.091245:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573821.091246:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573821.091249:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2166
00000100:00080000:1.0:1788573821.091259:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573821.091262:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573821.091266:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573821.091274:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360950912/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573821.091283:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573821.091287:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573821.091289:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573821.091293:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2166
00000100:00080000:1.0:1788573821.091297:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573821.091301:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573821.091308:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573821.091322:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360951040/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788573821.091329:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360950528:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788573821.091335:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573821.091340:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573821.091342:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573821.091347:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2166
00000100:00080000:1.0:1788573821.091351:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573821.091355:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573821.091361:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573821.091376:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360950656:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573821.091377:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360951168/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788573821.091432:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360950784:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573821.091473:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360950912:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573821.091502:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360951040:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573821.091531:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360951168:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573821.474984:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573821.474984:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573821.474994:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573821.475018:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573821.475058:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788573821.475133:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573822.115117:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573822.498990:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573822.499020:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573822.499041:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573822.499051:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573822.499162:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573822.499170:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573823.138988:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573823.522944:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573823.522944:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573823.522944:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573823.522974:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788573823.522978:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573823.522993:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573824.162958:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000400:00000100:2.0:1788573824.163114:0:2334:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.140:988
00000400:00000100:2.0:1788573824.163148:0:2334:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.140@tcp at host 192.168.202.140 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:2.0:1788573824.163162:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:2.0:1788573824.163194:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:2.0:1788573824.163201:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:2.0:1788573824.163207:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:2.0:1788573824.163214:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:2.0:1788573824.163220:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:2.0:1788573824.163226:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:0.0:1788573824.163256:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573821/real 1788573824]  req@ffff8dc005dc1c00 x1875453360951040/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573846 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573824.163281:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453360951040/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573846 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573824.163293:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573824.163298:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573824.163303:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360951040:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573824.163311:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573821/real 1788573824]  req@ffff8dc005dc3b80 x1875453360951168/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573846 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573824.163324:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360951168/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573846 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573824.163332:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573824.163336:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573824.163340:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360951168:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573824.163347:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573821/real 1788573824]  req@ffff8dc005dc1500 x1875453360950528/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573846 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573824.163360:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360950528/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573846 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573824.163370:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573824.163374:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573824.163377:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360950528:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573824.163385:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573821/real 1788573824]  req@ffff8dc005dc0700 x1875453360950656/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573846 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573824.163397:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453360950656/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573846 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573824.163406:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573824.163410:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573824.163414:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360950656:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573824.163421:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573821/real 1788573824]  req@ffff8dc005dc1180 x1875453360950784/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573846 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573824.163435:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360950784/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573846 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573824.163445:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573824.163448:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573824.163452:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360950784:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573824.163459:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573821/real 1788573824]  req@ffff8dc005dc2d80 x1875453360950912/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573846 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573824.163471:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360950912/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573846 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573824.163479:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573824.163483:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573824.163486:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360950912:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573824.163493:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573821/real 1788573824]  req@ffff8dc005dc3800 x1875453360950400/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573846 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573824.163506:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453360950400/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573846 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573824.163513:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573824.163516:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573824.163520:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360950400:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788573824.546961:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573824.546961:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573824.546969:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573824.546973:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573824.547009:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573824.547023:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573825.186929:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573825.570963:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573825.570967:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573825.570968:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573825.571027:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573825.571028:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788573825.571137:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1788573826.211018:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573826.211027:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:1.0:1788573826.211027:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788573826.211034:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573826.211046:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2171
00000100:00080000:0.0:1788573826.211056:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573826.211062:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788573826.211091:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453360951296/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573826.211117:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573826.211121:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573826.211122:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573826.211125:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2171
00000100:00080000:0.0:1788573826.211128:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573826.211132:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573826.211142:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573826.211159:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453360951424/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573826.211171:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573826.211175:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573826.211177:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573826.211181:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2171
00000100:00080000:0.0:1788573826.211186:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788573826.211190:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360951296:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788573826.211195:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573826.211206:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573826.211228:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453360951552/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573826.211239:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573826.211243:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573826.211245:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573826.211251:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2171
00000100:00080000:0.0:1788573826.211256:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573826.211260:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573826.211266:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788573826.211281:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573826.211287:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453360951680/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573826.211304:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573826.211308:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573826.211310:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573826.211316:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2171
00000100:00080000:0.0:1788573826.211322:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573826.211328:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573826.211337:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573826.211354:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573826/real 1788573826]  req@ffff8dc006711880 x1875453360951296/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573851 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573826.211356:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453360951808/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573826.211409:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573826.211414:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573826.211419:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788573826.211425:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453360951296/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573851 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573826.211432:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2171
00000100:00080000:0.0:1788573826.211446:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573826.211456:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573826.211457:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:3.0:1788573826.211475:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000008:00100000:0.0:1788573826.211476:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573826.211485:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360951296:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788573826.211506:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453360951936/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573826.211518:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573826.211522:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573826.211526:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788573826.211533:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360951424:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788573826.211539:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2171
00000100:00080000:0.0:1788573826.211555:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573826.211563:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573826.211572:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788573826.211582:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573826.211595:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453360952064/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573826.211606:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573826/real 1788573826]  req@ffff8dc006713800 x1875453360951424/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573851 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573826.211632:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453360951424/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573851 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573826.211649:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573826.211654:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573826.211659:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360951424:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573826.211667:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360951552:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573826.211727:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573826.211741:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573826/real 1788573826]  req@ffff8dc006713100 x1875453360951552/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573851 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573826.211753:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453360951552/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573851 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573826.211762:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573826.211765:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573826.211769:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360951552:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573826.211775:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360951680:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573826.212302:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573826.212326:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573826/real 1788573826]  req@ffff8dc006712300 x1875453360951680/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573851 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573826.212345:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453360951680/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573851 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573826.212357:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573826.212361:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573826.212373:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360951680:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573826.212384:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360951808:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573826.212417:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573826.212431:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573826/real 1788573826]  req@ffff8dc006710e00 x1875453360951808/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573851 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573826.212445:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453360951808/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573851 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573826.212456:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573826.212471:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573826.212479:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360951808:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573826.212488:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360951936:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573826.212513:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573826.212527:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573826/real 1788573826]  req@ffff8dc006713b80 x1875453360951936/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573851 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573826.212548:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453360951936/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573851 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573826.212554:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573826.212557:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573826.212560:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360951936:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573826.212585:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360952064:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573826.212608:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573826.212620:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573826/real 1788573826]  req@ffff8dc006712a00 x1875453360952064/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573851 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573826.212636:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453360952064/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573851 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573826.212645:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573826.212648:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573826.212652:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360952064:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573826.595009:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573826.595016:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573826.595034:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573826.595055:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573826.595079:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573826.595166:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573827.234962:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573827.618944:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573827.618949:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573827.618954:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573827.618972:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573827.618990:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788573827.619014:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573828.258986:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573828.642961:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573828.642965:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573828.642969:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573828.642970:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573828.643002:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788573828.643043:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573829.282942:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573829.666946:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573829.666947:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573829.666967:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788573829.666984:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573829.666990:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573829.667002:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573830.306997:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573830.690967:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573830.690967:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573830.690968:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573830.690974:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573830.691004:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788573830.691045:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573831.330977:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788573831.331001:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573831.331009:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788573831.331015:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573831.331028:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2176
00000100:00080000:3.0:1788573831.331041:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573831.331051:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573831.331102:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f480 x1875453360952192/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573831.331138:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573831.331142:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573831.331145:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573831.331150:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2176
00000100:00080000:3.0:1788573831.331154:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573831.331160:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573831.331172:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573831.331178:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360952192:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788573831.331191:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d180 x1875453360952320/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573831.331206:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573831.331210:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788573831.331213:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573831.331217:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2176
00000100:00080000:3.0:1788573831.331222:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573831.331227:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573831.331233:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573831.331246:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e680 x1875453360952448/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1788573831.331263:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788573831.331269:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573831.331274:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788573831.331277:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573831.331282:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2176
00000100:00080000:3.0:1788573831.331288:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573831.331292:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573831.331298:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573831.331314:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573831/real 1788573831]  req@ffff8dc00644f480 x1875453360952192/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573856 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573831.331316:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c700 x1875453360952576/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573831.331343:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573831.331349:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:0.0:1788573831.331350:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453360952192/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573856 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573831.331353:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573831.331363:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2176
00000100:00080000:3.0:1788573831.331371:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573831.331372:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573831.331380:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:0.0:1788573831.331381:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573831.331391:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360952192:192.168.202.140@tcp:250:kworker.0
00000008:00100000:3.0:1788573831.331391:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573831.331410:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c380 x1875453360952704/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573831.331424:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788573831.331425:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360952320:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788573831.331433:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788573831.331436:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573831.331443:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2176
00000100:00080000:3.0:1788573831.331449:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1788573831.331455:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788573831.331457:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573831.331466:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573831.331471:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573831/real 1788573831]  req@ffff8dc00644d180 x1875453360952320/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573856 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573831.331488:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453360952320/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573856 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573831.331488:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e300 x1875453360952832/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573831.331511:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573831.331517:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788573831.331517:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788573831.331523:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360952320:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788573831.331525:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788573831.331530:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788573831.331532:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360952448:192.168.202.140@tcp:8:kworker.0
00000100:00080000:3.0:1788573831.331538:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2176
00000100:00080000:3.0:1788573831.331543:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1788573831.331551:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788573831.331559:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788573831.331561:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573831/real 1788573831]  req@ffff8dc00644e680 x1875453360952448/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573856 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1788573831.331570:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573831.331584:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453360952448/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573856 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573831.331593:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1788573831.331593:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644fb80 x1875453360952960/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573831.331600:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573831.331607:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360952448:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573831.331633:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360952576:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573831.331652:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573831.331661:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573831/real 1788573831]  req@ffff8dc00644c700 x1875453360952576/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573856 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573831.331669:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453360952576/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573856 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573831.331676:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573831.331678:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573831.331680:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360952576:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573831.331700:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360952704:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788573831.331717:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573831.331724:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573831/real 1788573831]  req@ffff8dc00644c380 x1875453360952704/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573856 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573831.331732:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453360952704/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573856 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573831.331743:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573831.331745:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573831.331748:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360952704:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573831.331752:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360952832:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573831.331762:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573831.331768:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573831/real 1788573831]  req@ffff8dc00644e300 x1875453360952832/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573856 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573831.331780:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453360952832/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573856 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573831.331789:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573831.331792:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573831.331796:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360952832:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573831.331802:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360952960:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573831.331823:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573831.331833:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573831/real 1788573831]  req@ffff8dc00644fb80 x1875453360952960/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573856 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573831.331841:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644fb80 x1875453360952960/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573856 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573831.331847:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573831.331849:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573831.331852:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360952960:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573831.714997:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573831.715009:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573831.715010:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573831.715010:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573831.715066:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788573831.715093:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573832.354959:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573832.738940:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573832.738946:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573832.738949:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573832.738967:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573832.738988:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788573832.739044:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573833.378941:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573833.762952:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573833.762960:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573833.762992:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788573833.762998:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573833.763003:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573833.763012:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573834.402978:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573834.786954:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573834.786957:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573834.786960:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573834.786987:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788573834.786988:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573834.786996:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573835.426928:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573835.810958:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573835.810978:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573835.810994:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573835.810994:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573835.811037:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788573835.811099:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573836.450996:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788573836.451013:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573836.451023:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788573836.451027:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573836.451036:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2182
00000100:00080000:2.0:1788573836.451046:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573836.451054:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573836.451089:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453360953088/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573836.451116:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573836.451119:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573836.451122:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573836.451127:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2182
00000100:00080000:2.0:1788573836.451131:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573836.451135:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573836.451145:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573836.451155:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360953088:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788573836.451157:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453360953216/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573836.451169:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573836.451172:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573836.451174:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573836.451180:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2182
00000100:00080000:2.0:1788573836.451187:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573836.451195:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573836.451204:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573836.451222:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453360953344/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573836.451232:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573836.451234:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573836.451236:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1788573836.451241:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788573836.451243:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2182
00000100:00080000:2.0:1788573836.451248:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573836.451250:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573836.451254:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573836.451263:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453360953472/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573836.451271:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573836.451275:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573836.451277:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573836.451282:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2182
00000100:00080000:2.0:1788573836.451286:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573836.451293:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788573836.451295:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573836/real 1788573836]  req@ffff8dc020495500 x1875453360953088/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573861 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1788573836.451300:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573836.451324:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453360953088/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573861 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573836.451324:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453360953600/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573836.451357:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573836.451360:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573836.451365:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360953088:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788573836.451366:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573836.451373:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573836.451375:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573836.451379:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2182
00000100:00080000:2.0:1788573836.451382:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573836.451385:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573836.451390:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573836.451391:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360953216:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788573836.451403:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453360953728/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1788573836.451415:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788573836.451417:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573836.451420:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573836.451422:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573836.451426:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2182
00000100:00100000:0.0:1788573836.451429:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573836/real 1788573836]  req@ffff8dc020494000 x1875453360953216/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573861 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573836.451430:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573836.451436:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573836.451443:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573836.451449:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453360953216/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573861 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573836.451454:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453360953856/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573836.451468:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573836.451473:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573836.451476:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360953216:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573836.451481:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360953344:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573836.451496:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573836.451503:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573836/real 1788573836]  req@ffff8dc020494e00 x1875453360953344/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573861 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573836.451511:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453360953344/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573861 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573836.451517:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573836.451534:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573836.451538:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360953344:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573836.451545:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360953472:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573836.451562:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573836.451572:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573836/real 1788573836]  req@ffff8dc020496a00 x1875453360953472/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573861 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573836.451580:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453360953472/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573861 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573836.451586:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573836.451588:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573836.451590:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360953472:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573836.451594:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360953600:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788573836.451607:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573836.451623:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573836/real 1788573836]  req@ffff8dc020494700 x1875453360953600/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573861 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573836.451632:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453360953600/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573861 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573836.451640:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573836.451643:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573836.451645:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360953600:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573836.451660:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360953728:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573836.451675:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573836.451683:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573836/real 1788573836]  req@ffff8dc020494380 x1875453360953728/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573861 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573836.451691:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453360953728/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573861 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573836.451698:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573836.451701:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573836.451704:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360953728:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573836.451710:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360953856:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573836.451722:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573836.451734:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573836/real 1788573836]  req@ffff8dc020495500 x1875453360953856/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573861 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573836.451751:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453360953856/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573861 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573836.451761:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573836.451764:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573836.451767:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360953856:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573836.834985:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573836.834996:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573836.835002:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788573836.835058:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573836.835064:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573836.835066:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573837.474999:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573837.859029:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573837.859029:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573837.859032:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573837.859036:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573837.859073:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788573837.859119:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573838.499031:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573838.883017:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573838.883031:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573838.883034:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573838.883034:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573838.883075:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788573838.883169:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573839.523020:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573839.907050:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573839.907052:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573839.907052:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573839.907054:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573839.907102:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788573839.907199:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573840.547005:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573840.930979:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573840.931022:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573840.931030:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573840.931064:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788573840.931080:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573840.931101:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00080000:3.0:1788573841.571001:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573841.571009:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788573841.571014:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573841.571025:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2187
00000100:00100000:1.0:1788573841.571032:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788573841.571037:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573841.571058:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573841.571100:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d880 x1875453360953984/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573841.571129:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573841.571133:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573841.571136:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573841.571140:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2187
00000100:00080000:3.0:1788573841.571145:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573841.571160:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573841.571172:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573841.571185:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360953984:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788573841.571193:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ed80 x1875453360954112/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573841.571206:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573841.571209:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788573841.571211:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573841.571214:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2187
00000100:00080000:3.0:1788573841.571217:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573841.571222:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573841.571227:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573841.571238:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644df80 x1875453360954240/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573841.571249:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573841.571252:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788573841.571254:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573841.571257:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2187
00000100:00080000:3.0:1788573841.571260:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573841.571262:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573841.571265:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573841.571272:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f100 x1875453360954368/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573841.571280:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1788573841.571285:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788573841.571291:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573841.571295:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573841.571301:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2187
00000100:00080000:3.0:1788573841.571309:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573841.571315:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573841.571322:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573841.571347:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573841/real 1788573841]  req@ffff8dc00644d880 x1875453360953984/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573866 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573841.571348:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644fb80 x1875453360954496/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573841.571428:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788573841.571458:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d880 x1875453360953984/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573866 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573841.571478:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788573841.571481:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573841.571484:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573841.571492:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2187
00000100:00080000:0.0:1788573841.571493:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573841.571511:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360953984:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788573841.571511:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573841.571524:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573841.571539:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573841.571553:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e300 x1875453360954624/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788573841.571561:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360954112:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788573841.571564:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573841.571575:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788573841.571577:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573841.571585:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2187
00000100:00080000:3.0:1788573841.571590:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1788573841.571595:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788573841.571599:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573841.571608:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573841.571611:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573841/real 1788573841]  req@ffff8dc00644ed80 x1875453360954112/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573866 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573841.571626:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ed80 x1875453360954112/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573866 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573841.571635:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c380 x1875453360954752/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573841.571640:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573841.571651:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573841.571659:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360954112:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573841.571669:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360954240:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573841.571697:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573841.571708:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573841/real 1788573841]  req@ffff8dc00644df80 x1875453360954240/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573866 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573841.571717:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644df80 x1875453360954240/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573866 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573841.571724:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573841.571727:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573841.571729:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360954240:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573841.571734:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360954368:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573841.571748:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573841.571755:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573841/real 1788573841]  req@ffff8dc00644f100 x1875453360954368/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573866 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573841.571763:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f100 x1875453360954368/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573866 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573841.571769:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573841.571771:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573841.571773:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360954368:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573841.571777:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360954496:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788573841.571788:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573841.571795:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573841/real 1788573841]  req@ffff8dc00644fb80 x1875453360954496/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573866 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573841.571802:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644fb80 x1875453360954496/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573866 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573841.571808:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573841.571810:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573841.571812:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360954496:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573841.571825:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360954624:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573841.571836:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573841.571842:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573841/real 1788573841]  req@ffff8dc00644e300 x1875453360954624/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573866 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573841.571850:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453360954624/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573866 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573841.571860:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573841.571862:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573841.571893:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360954624:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573841.571898:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360954752:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573841.571911:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573841.571919:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573841/real 1788573841]  req@ffff8dc00644c380 x1875453360954752/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573866 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573841.571926:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453360954752/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573866 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573841.571932:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573841.571935:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573841.571937:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360954752:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573841.954994:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573841.954998:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573841.955013:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573841.955033:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573841.955040:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573841.955176:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573842.594980:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573842.978984:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573842.978984:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788573842.979033:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573842.979040:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573842.979049:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573842.979096:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573843.618981:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573844.002995:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573844.002995:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573844.002997:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573844.003032:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573844.003062:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788573844.003095:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573844.642954:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573845.026952:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573845.026952:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573845.026961:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573845.026962:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573845.026981:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788573845.027056:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573845.666957:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573846.051021:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573846.051022:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573846.051022:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573846.051024:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573846.051073:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788573846.051190:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573846.690964:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788573846.691006:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573846.691011:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788573846.691014:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573846.691022:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2192
00000100:00080000:0.0:1788573846.691033:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573846.691041:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788573846.691079:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453360954880/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573846.691107:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573846.691112:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573846.691114:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573846.691119:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2192
00000100:00080000:0.0:1788573846.691124:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573846.691129:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573846.691140:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573846.691148:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360954880:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788573846.691158:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453360955008/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573846.691173:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573846.691177:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573846.691179:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573846.691184:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2192
00000100:00080000:0.0:1788573846.691188:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573846.691193:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573846.691198:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573846.691212:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453360955136/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573846.691222:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1788573846.691226:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788573846.691228:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573846.691232:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573846.691237:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2192
00000100:00080000:0.0:1788573846.691241:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573846.691245:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573846.691250:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573846.691263:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453360955264/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573846.691267:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573846/real 1788573846]  req@ffff8dc006711500 x1875453360954880/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573871 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573846.691287:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573846.691295:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573846.691299:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573846.691309:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2192
00000100:00080000:0.0:1788573846.691316:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573846.691321:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573846.691327:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453360954880/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573871 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1788573846.691329:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788573846.691357:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573846.691363:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573846.691364:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453360955392/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573846.691368:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360954880:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788573846.691383:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573846.691387:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573846.691389:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788573846.691393:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360955008:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788573846.691397:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2192
00000100:00080000:0.0:1788573846.691404:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573846.691408:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573846.691414:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788573846.691419:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573846.691436:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573846/real 1788573846]  req@ffff8dc006710380 x1875453360955008/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573871 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573846.691437:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453360955520/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573846.691462:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453360955008/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573871 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573846.691464:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573846.691474:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573846.691478:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573846.691482:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573846.691486:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2192
00000100:00080000:3.0:1788573846.691491:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788573846.691493:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788573846.691498:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360955008:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788573846.691503:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573846.691509:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360955136:192.168.202.140@tcp:8:kworker.0
00000008:00100000:0.0:1788573846.691512:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573846.691529:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453360955648/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788573846.691533:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573846.691545:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573846/real 1788573846]  req@ffff8dc006712680 x1875453360955136/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573871 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573846.691555:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453360955136/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573871 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573846.691565:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573846.691568:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573846.691570:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360955136:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573846.691574:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360955264:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573846.691585:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573846.691591:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573846/real 1788573846]  req@ffff8dc006713480 x1875453360955264/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573871 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573846.691598:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453360955264/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573871 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573846.691603:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573846.691605:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573846.691607:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360955264:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573846.691610:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360955392:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573846.691620:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573846.691626:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573846/real 1788573846]  req@ffff8dc006711c00 x1875453360955392/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573871 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573846.691633:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453360955392/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573871 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573846.691638:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573846.691640:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573846.691643:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360955392:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573846.691654:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360955520:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573846.691664:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573846.691670:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573846/real 1788573846]  req@ffff8dc006711500 x1875453360955520/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573871 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573846.691677:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453360955520/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573871 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573846.691682:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573846.691684:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573846.691685:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360955520:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573846.691689:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360955648:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573846.691698:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573846.691703:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573846/real 1788573846]  req@ffff8dc006712a00 x1875453360955648/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573871 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573846.691711:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453360955648/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573871 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573846.691716:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573846.691717:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573846.691719:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360955648:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573847.074940:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573847.074944:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573847.074954:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573847.074958:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573847.074990:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788573847.075040:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573847.714924:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573848.099018:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573848.099018:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573848.099018:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573848.099030:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573848.099073:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788573848.099141:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573848.738970:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573849.122972:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573849.122972:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573849.122974:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573849.122995:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573849.123006:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788573849.123074:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573849.762986:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573850.146976:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573850.146977:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573850.146980:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573850.146980:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573850.147012:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788573850.147054:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573850.786980:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573851.170949:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573851.170966:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573851.170969:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573851.171024:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573851.171048:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788573851.171057:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1788573851.810950:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788573851.810951:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788573851.810962:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788573851.810967:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573851.810978:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2197
00000100:00080000:0.0:1788573851.810990:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573851.811000:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788573851.811051:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453360955776/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573851.811077:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573851.811080:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573851.811082:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573851.811085:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2197
00000100:00080000:0.0:1788573851.811088:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573851.811091:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573851.811103:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573851.811115:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453360955904/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573851.811123:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573851.811128:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573851.811131:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788573851.811131:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360955776:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788573851.811139:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2197
00000100:00080000:0.0:1788573851.811143:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573851.811145:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573851.811149:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573851.811160:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453360956032/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573851.811166:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573851.811169:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573851.811171:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573851.811173:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2197
00000100:00080000:0.0:1788573851.811177:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573851.811180:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573851.811183:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573851.811191:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453360956160/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573851.811197:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573851.811200:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573851.811202:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573851.811205:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2197
00000100:00080000:0.0:1788573851.811207:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1788573851.811212:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788573851.811213:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573851.811219:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573851.811227:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453360956288/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573851.811247:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573851.811250:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573851.811251:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573851.811255:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2197
00000100:00080000:0.0:1788573851.811258:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573851.811261:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573851.811266:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573851.811278:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453360956416/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573851.811285:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573851/real 1788573851]  req@ffff8dc006713b80 x1875453360955776/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573876 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573851.811311:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573851.811315:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573851.811316:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573851.811322:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2197
00000100:00100000:3.0:1788573851.811322:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453360955776/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573876 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573851.811327:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573851.811334:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573851.811341:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788573851.811345:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573851.811351:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573851.811353:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453360956544/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573851.811358:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360955776:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788573851.811389:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360955904:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573851.811408:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573851.811417:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573851/real 1788573851]  req@ffff8dc006710e00 x1875453360955904/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573876 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573851.811426:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453360955904/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573876 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573851.811434:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573851.811436:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573851.811439:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360955904:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573851.811443:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360956032:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573851.811458:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573851.811464:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573851/real 1788573851]  req@ffff8dc006712300 x1875453360956032/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573876 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573851.811473:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453360956032/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573876 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573851.811479:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573851.811481:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573851.811482:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360956032:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573851.811486:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360956160:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573851.811497:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573851.811503:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573851/real 1788573851]  req@ffff8dc006713100 x1875453360956160/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573876 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573851.811510:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453360956160/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573876 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573851.811516:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573851.811518:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573851.811519:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360956160:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573851.811523:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360956288:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573851.811534:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573851.811540:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573851/real 1788573851]  req@ffff8dc006713800 x1875453360956288/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573876 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573851.811553:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453360956288/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573876 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573851.811559:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573851.811561:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573851.811563:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360956288:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573851.811566:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360956416:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573851.811578:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573851.811584:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573851/real 1788573851]  req@ffff8dc006711880 x1875453360956416/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573876 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573851.811592:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453360956416/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573876 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573851.811597:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573851.811598:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573851.811600:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360956416:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573851.811603:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360956544:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573851.811613:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573851.811619:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573851/real 1788573851]  req@ffff8dc006712a00 x1875453360956544/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573876 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573851.811626:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453360956544/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573876 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573851.811647:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573851.811649:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573851.811652:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360956544:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573852.194943:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573852.194944:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573852.194946:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573852.194949:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573852.194975:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573852.195047:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573852.834938:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573853.218939:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573853.218940:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573853.218965:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573853.218967:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573853.218990:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788573853.219054:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573853.858965:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573854.242950:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573854.242955:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573854.242965:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573854.242970:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573854.242996:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788573854.243055:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573854.882964:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573855.266983:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573855.266983:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573855.266983:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573855.266984:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573855.267019:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788573855.267090:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573855.907020:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573856.290978:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573856.290999:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573856.291020:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573856.291020:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573856.291066:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573856.291157:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1788573856.931004:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788573856.931007:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788573856.931016:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788573856.931022:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573856.931039:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2202
00000100:00080000:0.0:1788573856.931051:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573856.931059:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788573856.931109:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453360956672/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573856.931149:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573856.931152:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573856.931153:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573856.931157:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2202
00000100:00080000:0.0:1788573856.931162:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573856.931165:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573856.931175:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573856.931186:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453360956800/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573856.931194:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573856.931203:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573856.931205:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573856.931212:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2202
00000100:00100000:3.0:1788573856.931212:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360956672:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788573856.931217:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573856.931224:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573856.931230:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573856.931248:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453360956928/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573856.931273:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573856.931278:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573856.931280:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573856.931285:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2202
00000800:00000100:3.0:1788573856.931290:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788573856.931294:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573856.931301:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573856.931308:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573856.931321:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453360957056/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573856.931329:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573856.931332:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573856.931333:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788573856.931338:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573856/real 1788573856]  req@ffff8dc006711500 x1875453360956672/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573881 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573856.931339:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2202
00000100:00080000:0.0:1788573856.931344:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573856.931351:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573856.931357:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573856.931367:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453360957184/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573856.931375:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453360956672/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573881 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573856.931376:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573856.931384:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573856.931386:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573856.931395:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2202
00000100:00080000:0.0:1788573856.931399:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573856.931402:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573856.931403:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:3.0:1788573856.931410:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000008:00100000:0.0:1788573856.931411:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573856.931416:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360956672:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788573856.931425:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360956800:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573856.931431:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453360957312/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788573856.931450:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788573856.931451:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573856.931456:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573856.931458:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573856.931462:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2202
00000100:00080000:0.0:1788573856.931466:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573856.931469:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573856.931474:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573856.931474:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573856/real 1788573856]  req@ffff8dc006711c00 x1875453360956800/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573881 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573856.931489:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453360957440/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573856.931493:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453360956800/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573881 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573856.931509:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573856.931512:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573856.931515:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360956800:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573856.931540:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360956928:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573856.931555:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573856.931563:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573856/real 1788573856]  req@ffff8dc006713480 x1875453360956928/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573881 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573856.931571:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453360956928/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573881 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573856.931578:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573856.931580:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573856.931582:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360956928:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573856.931586:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360957056:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573856.931604:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573856.931616:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573856/real 1788573856]  req@ffff8dc006712680 x1875453360957056/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573881 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573856.931629:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453360957056/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573881 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573856.931639:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573856.931643:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573856.931647:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360957056:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573856.931652:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360957184:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573856.931669:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573856.931677:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573856/real 1788573856]  req@ffff8dc006710380 x1875453360957184/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573881 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573856.931685:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453360957184/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573881 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573856.931692:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573856.931694:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573856.931696:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360957184:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573856.931700:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360957312:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573856.931711:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573856.931717:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573856/real 1788573856]  req@ffff8dc006712a00 x1875453360957312/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573881 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573856.931725:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453360957312/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573881 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573856.931730:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573856.931732:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573856.931734:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360957312:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573856.931737:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360957440:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573856.931747:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573856.931753:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573856/real 1788573856]  req@ffff8dc006711880 x1875453360957440/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573881 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573856.931761:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453360957440/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573881 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573856.931766:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573856.931768:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573856.931770:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360957440:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573857.314993:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573857.314993:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573857.315043:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573857.315096:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573857.315113:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788573857.315195:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573857.955028:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573858.338949:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573858.338984:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573858.338990:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573858.338994:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573858.339051:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788573858.339109:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573858.979022:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573859.362974:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573859.363006:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573859.363008:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573859.363030:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788573859.363035:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573859.363046:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573860.002974:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573860.386961:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573860.386962:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573860.387002:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573860.387006:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573860.387040:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573860.387122:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573861.026966:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573861.410967:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573861.410976:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573861.410982:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573861.411001:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788573861.411006:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573861.411012:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00080000:1.0:1788573862.050975:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573862.050984:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788573862.050988:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788573862.050992:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573862.050998:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2207
00000100:00080000:1.0:1788573862.051007:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573862.051014:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573862.051066:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453360957568/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573862.051090:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573862.051093:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573862.051094:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573862.051097:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2207
00000100:00080000:1.0:1788573862.051100:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573862.051102:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573862.051110:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573862.051119:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453360957696/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573862.051127:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573862.051129:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573862.051131:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573862.051134:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2207
00000100:00080000:1.0:1788573862.051137:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573862.051140:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573862.051145:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573862.051149:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360957568:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788573862.051155:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360957824/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573862.051163:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573862.051166:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573862.051167:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573862.051170:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2207
00000100:00080000:1.0:1788573862.051172:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573862.051174:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573862.051177:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573862.051185:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360957952/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573862.051191:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573862.051194:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573862.051195:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573862.051197:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2207
00000100:00080000:1.0:1788573862.051201:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573862.051204:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573862.051206:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788573862.051211:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573862.051215:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360958080/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573862.051229:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573862.051231:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573862.051233:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573862.051236:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2207
00000100:00080000:1.0:1788573862.051238:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573862.051241:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573862.051244:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573862.051250:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573862/real 1788573862]  req@ffff8dc005dc0a80 x1875453360957568/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573887 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573862.051254:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360958208/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573862.051278:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573862.051280:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573862.051283:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573862.051286:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2207
00000100:00080000:1.0:1788573862.051287:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573862.051289:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573862.051292:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573862.051293:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453360957568/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573887 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573862.051300:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360958336/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573862.051317:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573862.051322:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573862.051326:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360957568:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788573862.051335:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360957696:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573862.051361:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573862.051375:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573862/real 1788573862]  req@ffff8dc005dc3800 x1875453360957696/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573887 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573862.051395:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453360957696/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573887 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573862.051406:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573862.051411:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573862.051414:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360957696:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573862.051438:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360957824:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573862.051456:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573862.051464:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573862/real 1788573862]  req@ffff8dc005dc2d80 x1875453360957824/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573887 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573862.051472:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360957824/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573887 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573862.051478:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573862.051480:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573862.051482:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360957824:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573862.051486:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360957952:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573862.051497:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573862.051502:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573862/real 1788573862]  req@ffff8dc005dc1180 x1875453360957952/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573887 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573862.051509:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360957952/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573887 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573862.051520:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573862.051521:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573862.051523:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360957952:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573862.051526:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360958080:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573862.051536:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573862.051542:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573862/real 1788573862]  req@ffff8dc005dc0700 x1875453360958080/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573887 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573862.051549:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453360958080/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573887 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573862.051555:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573862.051557:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573862.051558:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360958080:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573862.051562:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360958208:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573862.051572:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573862.051577:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573862/real 1788573862]  req@ffff8dc005dc1500 x1875453360958208/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573887 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573862.051584:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360958208/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573887 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573862.051589:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573862.051591:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573862.051593:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360958208:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573862.051597:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360958336:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573862.051606:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573862.051612:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573862/real 1788573862]  req@ffff8dc005dc3b80 x1875453360958336/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573887 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573862.051618:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360958336/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573887 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573862.051623:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573862.051625:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573862.051627:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360958336:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573862.434957:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573862.434967:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573862.435002:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573862.435002:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573862.435011:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573862.435149:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573863.074962:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573863.459047:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573863.459051:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573863.459101:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788573863.459116:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573863.459120:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573863.459141:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573864.098960:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573864.483046:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573864.483046:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573864.483047:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573864.483047:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573864.483107:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788573864.483163:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573865.123007:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573865.507005:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573865.507007:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573865.507033:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573865.507048:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788573865.507049:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573865.507056:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573866.147002:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573866.531011:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573866.531012:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573866.531016:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573866.531045:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573866.531078:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573866.531130:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1788573867.171021:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788573867.171024:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573867.171037:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788573867.171043:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573867.171055:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2212
00000100:00080000:1.0:1788573867.171069:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573867.171078:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573867.171129:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360958464/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573867.171167:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573867.171176:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573867.171179:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573867.171183:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2212
00000100:00080000:1.0:1788573867.171186:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573867.171190:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573867.171202:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573867.171217:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360958592/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573867.171228:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360958464:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788573867.171229:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573867.171238:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573867.171240:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573867.171244:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2212
00000100:00080000:1.0:1788573867.171246:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573867.171250:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573867.171253:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573867.171263:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360958720/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573867.171270:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573867.171273:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573867.171274:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573867.171277:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2212
00000100:00080000:1.0:1788573867.171280:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573867.171282:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573867.171285:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573867.171293:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360958848/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573867.171299:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573867.171302:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573867.171303:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573867.171306:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2212
00000100:00080000:1.0:1788573867.171310:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1788573867.171313:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788573867.171317:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573867.171322:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573867.171331:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360958976/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573867.171339:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573867.171342:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573867.171343:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573867.171347:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2212
00000100:00080000:1.0:1788573867.171350:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573867.171352:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573867.171356:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573867.171366:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573867/real 1788573867]  req@ffff8dc005dc1c00 x1875453360958464/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573892 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573867.171367:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360959104/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573867.171399:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573867.171402:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573867.171404:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573867.171408:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2212
00000100:00100000:3.0:1788573867.171411:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453360958464/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573892 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573867.171412:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573867.171422:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:3.0:1788573867.171429:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:1.0:1788573867.171430:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788573867.171436:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573867.171442:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360958464:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788573867.171448:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453360959232/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573867.171482:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360958592:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573867.171511:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573867.171526:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573867/real 1788573867]  req@ffff8dc005dc3b80 x1875453360958592/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573892 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573867.171538:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360958592/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573892 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573867.171546:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573867.171549:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573867.171552:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360958592:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573867.171557:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360958720:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573867.171574:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573867.171581:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573867/real 1788573867]  req@ffff8dc005dc1500 x1875453360958720/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573892 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573867.171589:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360958720/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573892 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573867.171596:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573867.171598:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573867.171601:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360958720:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573867.171604:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360958848:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573867.171615:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573867.171622:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573867/real 1788573867]  req@ffff8dc005dc0700 x1875453360958848/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573892 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573867.171630:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453360958848/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573892 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573867.171636:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573867.171638:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573867.171640:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360958848:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573867.171644:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360958976:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573867.171655:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573867.171661:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573867/real 1788573867]  req@ffff8dc005dc1180 x1875453360958976/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573892 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573867.171669:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360958976/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573892 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573867.171678:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573867.171680:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573867.171684:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360958976:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573867.171690:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360959104:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573867.171712:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573867.171724:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573867/real 1788573867]  req@ffff8dc005dc2d80 x1875453360959104/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573892 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573867.171735:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360959104/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573892 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573867.171741:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573867.171744:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573867.171746:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360959104:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573867.171750:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360959232:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573867.171764:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573867.171771:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573867/real 1788573867]  req@ffff8dc005dc3800 x1875453360959232/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573892 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573867.171778:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453360959232/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573892 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573867.171784:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573867.171786:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573867.171788:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360959232:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573867.554997:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573867.555008:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573867.555011:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573867.555012:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573867.555064:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788573867.555137:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573868.194971:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573868.579013:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573868.579014:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573868.579014:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573868.579020:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573868.579069:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788573868.579134:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573869.218975:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573869.603044:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573869.603045:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573869.603047:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573869.603055:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573869.603104:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788573869.603131:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573870.242959:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573870.626927:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573870.626937:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573870.626950:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573870.626959:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573870.626968:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788573870.627008:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573871.266986:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573871.650961:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573871.650961:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573871.650966:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573871.650968:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573871.651000:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788573871.651052:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573872.290947:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573872.290952:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573872.290961:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788573872.290966:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573872.290977:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2217
00000100:00080000:1.0:1788573872.290987:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573872.290995:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573872.291033:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453360959360/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573872.291063:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573872.291067:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573872.291069:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573872.291074:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2217
00000100:00080000:1.0:1788573872.291078:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573872.291084:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573872.291094:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573872.291108:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360959360:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788573872.291119:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453360959488/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573872.291132:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573872.291136:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573872.291138:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573872.291142:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2217
00000100:00080000:1.0:1788573872.291147:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573872.291152:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573872.291158:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573872.291172:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360959616/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788573872.291185:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788573872.291196:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573872.291201:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573872.291203:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573872.291208:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2217
00000100:00080000:1.0:1788573872.291213:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573872.291217:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573872.291223:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573872.291223:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573872/real 1788573872]  req@ffff8dc005dc0a80 x1875453360959360/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573897 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573872.291241:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453360959360/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573897 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573872.291249:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573872.291255:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573872.291256:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360959744/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573872.291260:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360959360:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788573872.291274:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573872.291277:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573872.291280:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788573872.291283:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360959488:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788573872.291289:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2217
00000100:00080000:1.0:1788573872.291294:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573872.291299:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573872.291305:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788573872.291305:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573872.291317:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573872/real 1788573872]  req@ffff8dc005dc3800 x1875453360959488/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573897 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573872.291325:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360959872/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573872.291343:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788573872.291347:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453360959488/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573897 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573872.291350:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573872.291354:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573872.291362:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573872.291363:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2217
00000100:00080000:1.0:1788573872.291368:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573872.291371:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788573872.291378:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573872.291378:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360959488:192.168.202.140@tcp:38:kworker.0
00000008:00100000:1.0:1788573872.291388:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573872.291389:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360959616:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573872.291407:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360960000/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788573872.291412:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573872.291423:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573872/real 1788573872]  req@ffff8dc005dc2d80 x1875453360959616/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573897 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573872.291424:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573872.291436:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573872.291441:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788573872.291445:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360959616/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573897 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573872.291450:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2217
00000100:00080000:1.0:1788573872.291458:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573872.291460:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573872.291465:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:3.0:1788573872.291466:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573872.291473:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360959616:192.168.202.140@tcp:8:kworker.0
00000008:00100000:1.0:1788573872.291475:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573872.291480:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360959744:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573872.291495:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360960128/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788573872.291499:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573872.291509:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573872/real 1788573872]  req@ffff8dc005dc1180 x1875453360959744/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573897 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573872.291519:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360959744/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573897 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573872.291525:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573872.291527:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573872.291529:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360959744:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573872.291541:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360959872:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573872.291554:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573872.291560:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573872/real 1788573872]  req@ffff8dc005dc0700 x1875453360959872/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573897 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573872.291567:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453360959872/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573897 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573872.291575:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573872.291577:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573872.291579:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360959872:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573872.291583:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360960000:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573872.291596:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573872.291603:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573872/real 1788573872]  req@ffff8dc005dc1500 x1875453360960000/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573897 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573872.291612:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360960000/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573897 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573872.291622:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573872.291625:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573872.291629:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360960000:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573872.291635:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360960128:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573872.291663:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573872.291678:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573872/real 1788573872]  req@ffff8dc005dc3b80 x1875453360960128/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573897 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573872.291688:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360960128/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573897 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573872.291696:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573872.291699:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573872.291702:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360960128:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573872.674987:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573872.674987:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573872.675016:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573872.675033:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573872.675052:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573872.675057:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573873.315021:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573873.698976:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573873.698978:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573873.699007:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573873.699015:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573873.699030:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573873.699057:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573874.338979:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573874.723008:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573874.723008:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573874.723037:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573874.723041:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573874.723069:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573874.723096:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573875.362985:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573875.747013:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573875.747014:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573875.747029:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573875.747053:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573875.747056:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573875.747074:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573876.387011:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573876.770976:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573876.770982:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573876.771009:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573876.771013:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573876.771036:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573876.771056:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00080000:1.0:1788573877.410991:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573877.411000:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788573877.411004:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573877.411013:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2223
00000100:00100000:2.0:1788573877.411017:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573877.411023:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573877.411033:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573877.411070:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360960256/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573877.411094:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573877.411097:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573877.411098:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573877.411101:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2223
00000100:00080000:1.0:1788573877.411103:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573877.411105:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573877.411113:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573877.411129:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360960384/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573877.411143:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573877.411148:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573877.411151:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788573877.411155:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360960256:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788573877.411159:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2223
00000100:00080000:1.0:1788573877.411170:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573877.411175:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573877.411181:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573877.411195:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360960512/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573877.411203:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573877.411206:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573877.411207:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573877.411210:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2223
00000100:00080000:1.0:1788573877.411213:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573877.411216:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573877.411221:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573877.411228:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360960640/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573877.411236:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573877.411238:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573877.411240:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573877.411243:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2223
00000100:00080000:1.0:1788573877.411246:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1788573877.411252:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788573877.411256:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573877.411259:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573877.411269:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360960768/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573877.411276:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573877.411279:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573877.411281:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573877.411284:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2223
00000100:00080000:1.0:1788573877.411286:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573877.411289:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573877.411295:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573877.411307:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573877/real 1788573877]  req@ffff8dc005dc1c00 x1875453360960256/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573902 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573877.411308:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360960896/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573877.411364:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573877.411371:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573877.411373:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573877.411377:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2223
00000100:00080000:1.0:1788573877.411380:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788573877.411384:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453360960256/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573902 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573877.411390:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573877.411403:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788573877.411413:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1788573877.411420:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453360961024/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573877.411424:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573877.411444:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360960256:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788573877.411474:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360960384:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573877.411494:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573877.411504:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573877/real 1788573877]  req@ffff8dc005dc3b80 x1875453360960384/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573902 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573877.411514:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360960384/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573902 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573877.411522:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573877.411524:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573877.411527:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360960384:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573877.411531:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360960512:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573877.411544:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573877.411551:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573877/real 1788573877]  req@ffff8dc005dc1500 x1875453360960512/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573902 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573877.411559:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360960512/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573902 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573877.411570:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573877.411572:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573877.411575:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360960512:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573877.411578:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360960640:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573877.411589:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573877.411595:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573877/real 1788573877]  req@ffff8dc005dc0700 x1875453360960640/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573902 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573877.411603:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453360960640/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573902 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573877.411609:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573877.411611:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573877.411613:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360960640:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573877.411617:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360960768:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573877.411629:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573877.411635:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573877/real 1788573877]  req@ffff8dc005dc1180 x1875453360960768/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573902 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573877.411642:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360960768/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573902 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573877.411649:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573877.411651:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573877.411653:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360960768:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573877.411658:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360960896:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573877.411669:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573877.411675:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573877/real 1788573877]  req@ffff8dc005dc2d80 x1875453360960896/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573902 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573877.411682:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360960896/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573902 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573877.411688:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573877.411690:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573877.411692:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360960896:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573877.411696:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360961024:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573877.411726:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573877.411740:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573877/real 1788573877]  req@ffff8dc005dc3800 x1875453360961024/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573902 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573877.411752:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453360961024/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573902 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573877.411760:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573877.411763:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573877.411766:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360961024:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573877.794959:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573877.794961:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573877.794970:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573877.794971:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573877.794996:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573877.795030:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573878.435042:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573878.818967:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573878.818969:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573878.818969:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573878.818974:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573878.819002:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573878.819062:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573879.459051:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573879.842938:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573879.842967:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573879.842972:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573879.842981:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573879.842982:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573879.843033:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573880.482958:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573880.866977:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573880.866977:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573880.866977:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573880.866980:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573880.867012:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573880.867044:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573881.506963:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573881.890964:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573881.890965:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573881.890966:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573881.890981:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573881.890998:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573881.891041:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1788573882.530933:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573882.530941:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:2.0:1788573882.530944:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573882.530945:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573882.530957:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2228
00000100:00080000:1.0:1788573882.530966:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573882.530973:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573882.531002:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453360961152/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573882.531022:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573882.531025:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573882.531026:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573882.531029:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2228
00000100:00080000:1.0:1788573882.531031:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573882.531034:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573882.531042:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573882.531052:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453360961280/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573882.531061:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788573882.531066:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360961152:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788573882.531067:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573882.531072:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573882.531078:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2228
00000100:00080000:1.0:1788573882.531082:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573882.531087:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573882.531094:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573882.531109:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360961408/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573882.531119:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573882.531122:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573882.531126:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1788573882.531126:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788573882.531130:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2228
00000100:00080000:1.0:1788573882.531135:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573882.531139:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573882.531144:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573882.531152:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360961536/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573882.531158:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573882.531161:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573882.531162:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573882.531165:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2228
00000100:00080000:1.0:1788573882.531168:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788573882.531169:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573882/real 1788573882]  req@ffff8dc005dc0a80 x1875453360961152/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573907 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573882.531182:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573882.531185:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573882.531189:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453360961152/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573907 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573882.531197:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360961664/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573882.531218:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573882.531221:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573882.531225:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788573882.531228:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573882.531233:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788573882.531234:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360961152:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788573882.531241:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2228
00000100:00080000:1.0:1788573882.531247:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573882.531252:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573882.531257:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573882.531265:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360961280:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573882.531272:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360961792/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573882.531285:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573882.531288:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573882.531289:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573882.531292:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2228
00000100:00080000:1.0:1788573882.531294:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573882.531297:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573882.531301:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573882.531311:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360961920/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788573882.531317:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573882.531340:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573882/real 1788573882]  req@ffff8dc005dc3800 x1875453360961280/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573907 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573882.531350:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453360961280/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573907 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573882.531358:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573882.531360:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573882.531363:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360961280:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573882.531368:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360961408:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573882.531383:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573882.531390:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573882/real 1788573882]  req@ffff8dc005dc2d80 x1875453360961408/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573907 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573882.531398:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360961408/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573907 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573882.531405:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573882.531407:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573882.531409:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360961408:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573882.531412:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360961536:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573882.531422:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573882.531428:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573882/real 1788573882]  req@ffff8dc005dc1180 x1875453360961536/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573907 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573882.531435:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360961536/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573907 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573882.531441:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573882.531443:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573882.531445:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360961536:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573882.531449:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360961664:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573882.531467:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573882.531475:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573882/real 1788573882]  req@ffff8dc005dc0700 x1875453360961664/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573907 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573882.531483:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453360961664/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573907 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573882.531489:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573882.531491:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573882.531493:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360961664:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573882.531506:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360961792:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573882.531517:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573882.531524:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573882/real 1788573882]  req@ffff8dc005dc1500 x1875453360961792/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573907 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573882.531531:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360961792/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573907 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573882.531537:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573882.531539:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573882.531542:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360961792:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573882.531545:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360961920:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573882.531554:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573882.531560:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573882/real 1788573882]  req@ffff8dc005dc3b80 x1875453360961920/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573907 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573882.531567:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360961920/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573907 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573882.531573:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573882.531575:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573882.531577:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360961920:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573882.914972:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573882.914972:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573882.914972:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573882.914973:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573882.915006:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573882.915039:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573883.554981:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573883.938971:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573883.938971:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573883.938971:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573883.938980:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573883.939007:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573883.939046:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573884.578969:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573884.962973:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573884.962973:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573884.962981:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573884.963023:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573884.963026:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573884.963126:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573885.602966:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573885.987034:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573885.987055:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573885.987059:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573885.987074:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573885.987096:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573885.987115:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573886.626973:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573887.010971:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573887.010971:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573887.010972:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573887.011049:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573887.011159:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573887.011195:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00080000:1.0:1788573887.650968:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788573887.650974:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573887.650978:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788573887.650983:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573887.650991:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2233
00000100:00080000:1.0:1788573887.651000:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573887.651007:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573887.651048:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360962048/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573887.651069:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573887.651072:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573887.651074:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573887.651076:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2233
00000100:00080000:1.0:1788573887.651079:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573887.651081:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573887.651090:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573887.651101:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360962176/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573887.651107:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360962048:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788573887.651112:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573887.651117:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573887.651119:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573887.651123:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2233
00000100:00080000:1.0:1788573887.651127:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573887.651131:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573887.651136:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573887.651150:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360962304/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573887.651161:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573887.651165:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573887.651167:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573887.651171:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2233
00000100:00080000:1.0:1788573887.651175:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573887.651179:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573887.651185:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573887.651197:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360962432/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573887.651202:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360962176:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788573887.651211:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573887.651215:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573887.651216:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573887.651220:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2233
00000100:00080000:1.0:1788573887.651224:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573887.651227:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573887.651231:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573887.651235:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360962304:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573887.651244:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360962560/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573887.651252:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573887.651255:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:3.0:1788573887.651258:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360962432:192.168.202.140@tcp:8:kworker.0
00000100:00080000:1.0:1788573887.651259:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573887.651267:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2233
00000100:00080000:1.0:1788573887.651271:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573887.651273:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573887.651278:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573887.651284:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360962560:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573887.651289:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360962688/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573887.651300:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573887.651302:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573887.651304:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788573887.651308:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360962688:192.168.202.140@tcp:8:kworker.0
00000100:00080000:1.0:1788573887.651311:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2233
00000100:00080000:1.0:1788573887.651316:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573887.651319:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573887.651323:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573887.651334:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453360962816/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573887.651366:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360962816:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573888.034961:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573888.034962:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573888.034974:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573888.034979:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573888.035015:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788573888.035048:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573888.675039:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573889.059056:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573889.059059:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573889.059097:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573889.059110:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573889.059122:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573889.059124:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573889.698950:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573890.082964:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573890.082965:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573890.082967:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573890.083015:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573890.083017:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573890.083022:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573890.722978:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000400:00000100:0.0:1788573890.723115:0:2335:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.140:988
00000400:00000100:0.0:1788573890.723150:0:2335:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.140@tcp at host 192.168.202.140 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:0.0:1788573890.723165:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:0.0:1788573890.723205:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:0.0:1788573890.723215:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:0.0:1788573890.723224:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:0.0:1788573890.723235:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:0.0:1788573890.723245:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:0.0:1788573890.723256:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:3.0:1788573890.723262:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573887/real 1788573890]  req@ffff8dc005dc0700 x1875453360962432/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573912 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573890.723290:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453360962432/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573912 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573890.723303:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573890.723309:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573890.723314:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360962432:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573890.723323:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573887/real 1788573890]  req@ffff8dc005dc1180 x1875453360962560/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573912 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573890.723336:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360962560/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573912 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573890.723344:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573890.723347:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573890.723350:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360962560:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573890.723356:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573887/real 1788573890]  req@ffff8dc005dc3b80 x1875453360962176/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573912 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573890.723368:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360962176/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573912 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573890.723376:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573890.723380:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573890.723383:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360962176:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573890.723390:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573887/real 1788573890]  req@ffff8dc005dc1500 x1875453360962304/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573912 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573890.723402:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360962304/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573912 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573890.723410:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573890.723413:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573890.723416:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360962304:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573890.723423:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573887/real 1788573890]  req@ffff8dc005dc1c00 x1875453360962048/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573912 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573890.723437:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453360962048/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573912 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573890.723461:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573890.723465:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573890.723469:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360962048:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788573890.723497:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573887/real 1788573890]  req@ffff8dc005dc3800 x1875453360962816/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573912 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573890.723511:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453360962816/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573912 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573890.723519:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573890.723523:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573890.723526:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360962816:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573890.723533:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573887/real 1788573890]  req@ffff8dc005dc2d80 x1875453360962688/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573912 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573890.723544:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360962688/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573912 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573890.723552:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573890.723555:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573890.723558:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360962688:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573891.106957:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573891.106957:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573891.106959:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573891.107030:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573891.107070:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573891.107074:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573891.746970:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573892.130913:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573892.130929:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573892.130964:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573892.130987:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573892.131031:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788573892.131130:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573892.770948:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788573892.770996:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573892.771002:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788573892.771006:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573892.771014:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2238
00000100:00080000:0.0:1788573892.771023:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573892.771029:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788573892.771061:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453360962944/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573892.771093:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573892.771097:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573892.771099:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573892.771103:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2238
00000100:00080000:0.0:1788573892.771107:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573892.771111:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573892.771121:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573892.771135:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453360963072/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573892.771146:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573892.771150:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573892.771152:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573892.771155:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2238
00000100:00080000:0.0:1788573892.771159:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573892.771162:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573892.771168:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573892.771180:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453360963200/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573892.771189:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573892.771192:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573892.771194:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573892.771197:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2238
00000100:00080000:0.0:1788573892.771201:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573892.771205:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573892.771210:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573892.771221:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453360963328/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573892.771232:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788573892.771236:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360962944:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788573892.771238:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573892.771243:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573892.771250:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2238
00000100:00080000:0.0:1788573892.771253:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573892.771258:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573892.771263:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573892.771276:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453360963456/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573892.771285:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573892.771289:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573892.771291:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573892.771295:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2238
00000100:00080000:0.0:1788573892.771307:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573892.771312:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:3.0:1788573892.771318:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:0.0:1788573892.771319:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573892.771336:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453360963584/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573892.771352:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573892.771356:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573892.771358:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573892.771365:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2238
00000100:00100000:3.0:1788573892.771366:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573892/real 1788573892]  req@ffff8dc006713800 x1875453360962944/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573917 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573892.771369:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573892.771379:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573892.771389:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573892.771400:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453360962944/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573917 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573892.771432:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573892.771438:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573892.771440:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453360963712/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573892.771446:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360962944:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788573892.771462:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360963072:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573892.771493:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573892.771507:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573892/real 1788573892]  req@ffff8dc006713100 x1875453360963072/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573917 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573892.771520:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453360963072/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573917 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573892.771531:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573892.771535:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573892.771538:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360963072:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573892.771545:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360963200:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573892.771566:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573892.771577:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573892/real 1788573892]  req@ffff8dc006712300 x1875453360963200/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573917 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573892.771588:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453360963200/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573917 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573892.771598:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573892.771602:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573892.771606:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360963200:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573892.771633:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360963328:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573892.771654:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573892.771665:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573892/real 1788573892]  req@ffff8dc006710e00 x1875453360963328/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573917 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573892.771677:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453360963328/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573917 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573892.771694:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573892.771697:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573892.771700:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360963328:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573892.771706:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360963456:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573892.771811:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573892.771827:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573892/real 1788573892]  req@ffff8dc006713b80 x1875453360963456/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573917 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573892.771838:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453360963456/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573917 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573892.771848:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573892.771851:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573892.771854:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360963456:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573892.771861:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360963584:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573892.771916:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573892.771928:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573892/real 1788573892]  req@ffff8dc006711880 x1875453360963584/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573917 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573892.771939:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453360963584/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573917 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573892.771947:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573892.771950:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573892.771953:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360963584:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573892.771959:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360963712:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573892.771977:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573892.771989:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573892/real 1788573892]  req@ffff8dc006712a00 x1875453360963712/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573917 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573892.772002:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453360963712/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573917 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573892.772011:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573892.772014:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573892.772018:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360963712:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573893.154947:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573893.154953:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573893.154959:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573893.154979:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573893.154983:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573893.154992:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573893.794974:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573894.178988:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573894.178988:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573894.178989:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573894.179026:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573894.179027:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573894.179028:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573894.818941:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573895.202957:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573895.202957:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573895.202990:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573895.203007:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573895.203030:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573895.203030:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573895.842952:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573896.226960:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573896.226961:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573896.226964:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573896.226966:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573896.226997:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788573896.227043:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573896.867006:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573897.250966:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573897.251004:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573897.251005:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573897.251040:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573897.251045:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573897.251050:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1788573897.890992:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788573897.890996:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788573897.891003:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788573897.891009:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573897.891018:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2243
00000100:00080000:2.0:1788573897.891028:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573897.891036:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573897.891072:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453360963840/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573897.891097:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573897.891101:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573897.891103:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573897.891107:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2243
00000100:00080000:2.0:1788573897.891111:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573897.891115:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573897.891126:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573897.891138:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453360963968/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573897.891148:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360963840:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788573897.891151:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573897.891157:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573897.891159:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573897.891164:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2243
00000100:00080000:2.0:1788573897.891169:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573897.891173:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573897.891179:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573897.891190:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453360964096/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573897.891200:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573897.891203:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573897.891206:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1788573897.891211:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788573897.891215:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2243
00000100:00080000:2.0:1788573897.891222:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573897.891227:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573897.891233:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573897.891245:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453360964224/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573897.891253:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573897/real 1788573897]  req@ffff8dc020497100 x1875453360963840/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573922 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573897.891258:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573897.891267:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573897.891270:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573897.891277:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2243
00000100:00100000:3.0:1788573897.891280:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453360963840/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573922 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573897.891283:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573897.891292:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:3.0:1788573897.891295:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:2.0:1788573897.891298:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788573897.891314:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573897.891318:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360963840:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788573897.891340:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453360964352/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573897.891343:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360963968:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788573897.891359:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573897.891364:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573897.891366:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1788573897.891372:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788573897.891375:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2243
00000100:00080000:2.0:1788573897.891381:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573897.891386:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573897.891392:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573897.891393:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573897/real 1788573897]  req@ffff8dc020497480 x1875453360963968/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573922 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573897.891408:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453360964480/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573897.891415:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453360963968/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573922 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573897.891424:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573897.891433:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573897.891436:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573897.891438:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788573897.891442:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2243
00000100:00080000:3.0:1788573897.891446:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788573897.891449:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788573897.891451:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360963968:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788573897.891457:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573897.891461:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360964096:192.168.202.140@tcp:8:kworker.0
00000008:00100000:2.0:1788573897.891466:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573897.891482:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453360964608/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788573897.891491:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573897.891512:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573897/real 1788573897]  req@ffff8dc020494a80 x1875453360964096/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573922 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573897.891528:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453360964096/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573922 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573897.891538:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573897.891541:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573897.891544:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360964096:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573897.891548:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360964224:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573897.891564:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573897.891572:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573897/real 1788573897]  req@ffff8dc020496d80 x1875453360964224/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573922 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573897.891581:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453360964224/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573922 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573897.891586:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573897.891588:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573897.891590:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360964224:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573897.891602:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360964352:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573897.891614:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573897.891620:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573897/real 1788573897]  req@ffff8dc020495880 x1875453360964352/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573922 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573897.891627:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453360964352/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573922 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573897.891633:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573897.891636:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573897.891637:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360964352:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573897.891641:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360964480:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573897.891651:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573897.891656:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573897/real 1788573897]  req@ffff8dc020495180 x1875453360964480/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573922 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573897.891663:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453360964480/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573922 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573897.891673:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573897.891676:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573897.891678:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360964480:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573897.891681:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360964608:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573897.891690:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573897.891696:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573897/real 1788573897]  req@ffff8dc020497100 x1875453360964608/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573922 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573897.891703:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453360964608/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573922 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573897.891708:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573897.891710:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573897.891712:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360964608:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573898.274998:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573898.275002:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573898.275013:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573898.275035:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573898.275055:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788573898.275088:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573898.915028:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573899.299003:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573899.299004:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573899.299013:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573899.299151:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573899.299165:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573899.299231:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573899.939000:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573900.323042:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573900.323042:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573900.323050:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573900.323088:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573900.323094:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788573900.323110:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573900.962962:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573901.346936:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573901.346943:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573901.346943:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573901.346946:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573901.346976:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573901.347024:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573901.986930:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573902.370950:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573902.370952:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573902.370973:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788573902.370980:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573902.370996:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573902.371005:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00080000:1.0:1788573903.010973:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573903.010984:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:2.0:1788573903.010985:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573903.010989:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573903.011001:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2248
00000100:00080000:1.0:1788573903.011012:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573903.011020:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573903.011064:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453360964736/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573903.011087:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573903.011091:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573903.011093:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573903.011097:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2248
00000100:00080000:1.0:1788573903.011100:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573903.011104:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573903.011114:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573903.011129:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360964864/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573903.011142:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788573903.011142:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360964736:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788573903.011148:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573903.011153:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573903.011158:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2248
00000100:00080000:1.0:1788573903.011161:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573903.011165:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573903.011170:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573903.011182:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453360964992/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573903.011214:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573903.011218:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573903.011220:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573903.011224:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2248
00000100:00080000:1.0:1788573903.011229:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573903.011233:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573903.011238:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788573903.011241:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573903.011254:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360965120/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573903.011264:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573903.011267:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573903.011269:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573903.011273:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2248
00000100:00080000:1.0:1788573903.011277:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573903.011282:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573903.011286:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573903/real 1788573903]  req@ffff8dc005dc0a80 x1875453360964736/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573928 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1788573903.011289:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573903.011308:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360965248/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573903.011314:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453360964736/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573928 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573903.011323:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573903.011331:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573903.011334:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573903.011337:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573903.011340:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2248
00000100:00080000:1.0:1788573903.011345:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573903.011345:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788573903.011351:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573903.011355:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360964736:192.168.202.140@tcp:250:kworker.0
00000008:00100000:1.0:1788573903.011358:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573903.011372:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360965376/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573903.011382:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360964864:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788573903.011383:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573903.011394:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573903.011396:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573903.011400:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2248
00000100:00080000:1.0:1788573903.011404:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573903.011407:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573903.011412:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788573903.011419:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573903.011425:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360965504/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573903.011436:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573903/real 1788573903]  req@ffff8dc005dc2d80 x1875453360964864/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573928 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573903.011452:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360964864/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573928 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573903.011463:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573903.011467:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573903.011470:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360964864:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573903.011477:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360964992:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573903.011496:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573903.011506:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573903/real 1788573903]  req@ffff8dc005dc3800 x1875453360964992/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573928 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573903.011518:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453360964992/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573928 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573903.011527:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573903.011530:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573903.011533:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360964992:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573903.011539:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360965120:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573903.011555:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573903.011564:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573903/real 1788573903]  req@ffff8dc005dc1c00 x1875453360965120/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573928 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573903.011576:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453360965120/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573928 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573903.011585:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573903.011588:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573903.011591:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360965120:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573903.011597:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360965248:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573903.011614:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573903.011623:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573903/real 1788573903]  req@ffff8dc005dc1500 x1875453360965248/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573928 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573903.011635:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360965248/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573928 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573903.011643:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573903.011647:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573903.011650:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360965248:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573903.011667:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360965376:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573903.011684:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573903.011694:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573903/real 1788573903]  req@ffff8dc005dc3b80 x1875453360965376/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573928 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573903.011722:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360965376/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573928 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573903.011731:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573903.011734:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573903.011738:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360965376:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573903.011744:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360965504:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573903.011763:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573903.011773:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573903/real 1788573903]  req@ffff8dc005dc1180 x1875453360965504/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573928 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573903.011785:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360965504/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573928 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573903.011793:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573903.011796:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573903.011799:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360965504:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573903.394967:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573903.394967:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573903.394972:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573903.395153:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573903.395206:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788573903.395233:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573904.034943:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573904.419021:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573904.419022:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788573904.419074:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573904.419166:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573904.419220:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573904.419240:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573905.058967:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573905.442964:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573905.442964:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573905.442964:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573905.442964:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573905.442998:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788573905.443049:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573906.082977:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573906.466967:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573906.466967:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573906.466971:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573906.467005:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573906.467018:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788573906.467021:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573907.106952:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573907.490954:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573907.490954:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573907.490966:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573907.490987:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573907.490999:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573907.491003:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1788573908.130967:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573908.130976:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788573908.130981:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573908.130990:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2253
00000100:00080000:0.0:1788573908.131000:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573908.131007:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573908.131023:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573908.131039:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453360965632/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573908.131055:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573908.131057:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573908.131059:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573908.131062:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2253
00000100:00080000:0.0:1788573908.131066:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573908.131070:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573908.131077:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360965632:192.168.202.140@tcp:250:kworker.0
00000008:00100000:0.0:1788573908.131079:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573908.131108:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453360965760/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573908.131118:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573908.131121:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573908.131123:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573908.131127:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2253
00000100:00080000:0.0:1788573908.131131:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573908.131135:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573908.131141:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573908.131154:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453360965888/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788573908.131160:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788573908.131171:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573908.131174:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573908.131176:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573908.131180:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2253
00000100:00080000:0.0:1788573908.131183:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573908.131185:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573908.131189:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573908.131204:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573908/real 1788573908]  req@ffff8dc006710380 x1875453360965632/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573933 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573908.131205:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453360966016/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573908.131212:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573908.131215:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573908.131216:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573908.131219:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2253
00000100:00080000:0.0:1788573908.131221:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573908.131224:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573908.131226:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573908.131232:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453360966144/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573908.131237:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573908.131239:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573908.131240:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573908.131243:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2253
00000100:00080000:0.0:1788573908.131246:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573908.131249:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573908.131251:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573908.131258:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453360966272/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573908.131265:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573908.131271:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573908.131274:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573908.131279:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2253
00000100:00080000:0.0:1788573908.131283:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573908.131285:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573908.131288:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573908.131294:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453360966400/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573908.131308:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453360965632/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573933 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573908.131317:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573908.131320:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573908.131324:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360965632:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788573908.131342:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360965760:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573908.131360:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573908.131369:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573908/real 1788573908]  req@ffff8dc006712680 x1875453360965760/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573933 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573908.131377:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453360965760/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573933 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573908.131383:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573908.131385:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573908.131387:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360965760:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573908.131391:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360965888:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573908.131402:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573908.131408:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573908/real 1788573908]  req@ffff8dc006713480 x1875453360965888/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573933 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573908.131416:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453360965888/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573933 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573908.131519:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573908.131523:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573908.131526:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360965888:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573908.131531:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360966016:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573908.131599:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573908.131608:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573908/real 1788573908]  req@ffff8dc006711c00 x1875453360966016/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573933 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573908.131616:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453360966016/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573933 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573908.131622:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573908.131624:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573908.131627:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360966016:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573908.131631:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360966144:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573908.131642:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573908.131648:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573908/real 1788573908]  req@ffff8dc006711500 x1875453360966144/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573933 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573908.131655:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453360966144/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573933 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573908.131661:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573908.131662:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573908.131665:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360966144:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573908.131669:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360966272:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573908.131679:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573908.131684:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573908/real 1788573908]  req@ffff8dc006712a00 x1875453360966272/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573933 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573908.131691:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453360966272/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573933 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573908.131696:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573908.131698:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573908.131699:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360966272:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573908.131703:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360966400:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573908.131712:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573908.131717:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573908/real 1788573908]  req@ffff8dc006711880 x1875453360966400/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573933 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573908.131724:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453360966400/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573933 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573908.131729:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573908.131731:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573908.131732:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360966400:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573908.514966:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573908.514978:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573908.514978:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788573908.514994:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573908.515005:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573908.515009:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573909.154919:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573909.538945:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573909.538981:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573909.538984:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573909.539014:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573909.539021:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573909.539025:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573910.179017:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573910.562959:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573910.562971:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573910.562992:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573910.563002:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573910.563007:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788573910.563180:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573911.202924:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573911.586968:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573911.586969:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573911.586972:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573911.587002:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573911.587003:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788573911.587011:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573912.226995:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573912.610995:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573912.611020:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573912.611023:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788573912.611076:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573912.611080:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573912.611099:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573913.250978:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788573913.250983:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573913.250989:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788573913.250993:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573913.251000:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2258
00000100:00080000:3.0:1788573913.251009:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573913.251014:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573913.251045:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c700 x1875453360966528/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573913.251066:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573913.251070:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573913.251072:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573913.251077:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2258
00000100:00080000:3.0:1788573913.251080:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573913.251085:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573913.251096:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573913.251097:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360966528:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788573913.251114:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e680 x1875453360966656/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573913.251127:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573913.251130:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788573913.251144:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573913.251148:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2258
00000100:00080000:3.0:1788573913.251150:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573913.251154:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573913.251159:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573913.251169:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d180 x1875453360966784/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1788573913.251182:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788573913.251185:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573913.251189:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788573913.251191:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573913.251194:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2258
00000100:00080000:3.0:1788573913.251200:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573913.251203:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573913.251206:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573913.251215:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f480 x1875453360966912/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573913.251221:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788573913.251224:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573913/real 1788573913]  req@ffff8dc00644c700 x1875453360966528/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573938 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573913.251226:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573913.251229:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573913.251236:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2258
00000100:00080000:3.0:1788573913.251241:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573913.251244:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573913.251247:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573913.251248:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453360966528/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573938 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573913.251257:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d500 x1875453360967040/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573913.251259:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573913.251267:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788573913.251272:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788573913.251274:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360966528:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788573913.251277:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788573913.251281:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573913.251285:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2258
00000100:00080000:3.0:1788573913.251288:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573913.251292:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573913.251296:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573913.251307:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360966656:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573913.251311:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ea00 x1875453360967168/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573913.251325:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1788573913.251330:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788573913.251332:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788573913.251336:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573913.251341:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2258
00000100:00100000:0.0:1788573913.251344:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573913/real 1788573913]  req@ffff8dc00644e680 x1875453360966656/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573938 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573913.251348:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573913.251358:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788573913.251360:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453360966656/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573938 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1788573913.251364:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1788573913.251375:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573913.251378:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573913.251381:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ce00 x1875453360967296/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788573913.251384:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360966656:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573913.251395:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360966784:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573913.251419:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573913.251426:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573913/real 1788573913]  req@ffff8dc00644d180 x1875453360966784/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573938 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573913.251439:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453360966784/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573938 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573913.251445:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573913.251447:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573913.251449:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360966784:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573913.251452:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360966912:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573913.251463:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573913.251469:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573913/real 1788573913]  req@ffff8dc00644f480 x1875453360966912/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573938 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573913.251476:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453360966912/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573938 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573913.251481:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573913.251483:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573913.251485:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360966912:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573913.251488:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360967040:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788573913.251499:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573913.251505:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573913/real 1788573913]  req@ffff8dc00644d500 x1875453360967040/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573938 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573913.251511:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d500 x1875453360967040/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573938 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573913.251522:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573913.251524:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573913.251526:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360967040:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573913.251536:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360967168:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573913.251546:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573913.251552:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573913/real 1788573913]  req@ffff8dc00644ea00 x1875453360967168/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573938 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573913.251559:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ea00 x1875453360967168/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573938 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573913.251564:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573913.251566:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573913.251568:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360967168:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573913.251572:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360967296:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573913.251582:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573913.251592:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573913/real 1788573913]  req@ffff8dc00644ce00 x1875453360967296/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573938 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573913.251604:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ce00 x1875453360967296/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573938 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573913.251613:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573913.251616:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573913.251620:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360967296:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573913.634984:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573913.634984:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573913.634984:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573913.635112:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573913.635197:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788573913.635268:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573914.275006:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573914.659005:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573914.659005:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573914.659014:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573914.659037:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573914.659084:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788573914.659128:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573915.299054:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573915.683010:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573915.683010:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573915.683014:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788573915.683050:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573915.683052:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573915.683055:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573916.323042:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573916.706976:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573916.706976:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573916.706982:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573916.706984:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573916.707013:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788573916.707084:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573917.346934:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573917.731000:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573917.731000:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573917.731054:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573917.731069:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788573917.731085:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573917.731095:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573918.370955:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788573918.370970:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573918.370979:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788573918.370984:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573918.370992:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2264
00000100:00080000:3.0:1788573918.371002:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573918.371008:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573918.371045:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c000 x1875453360967424/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573918.371067:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573918.371071:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573918.371072:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573918.371075:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2264
00000100:00080000:3.0:1788573918.371077:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573918.371079:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573918.371094:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573918.371104:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f800 x1875453360967552/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573918.371111:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573918.371114:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788573918.371116:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573918.371118:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2264
00000100:00080000:3.0:1788573918.371121:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788573918.371123:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360967424:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788573918.371126:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573918.371134:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573918.371143:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ca80 x1875453360967680/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573918.371155:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573918.371158:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788573918.371159:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573918.371161:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2264
00000100:00080000:3.0:1788573918.371166:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573918.371168:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573918.371171:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573918.371178:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644dc00 x1875453360967808/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573918.371184:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1788573918.371189:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788573918.371203:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573918.371206:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573918.371210:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2264
00000100:00080000:3.0:1788573918.371215:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573918.371218:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573918.371223:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573918.371235:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ce00 x1875453360967936/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573918.371243:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788573918.371244:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573918/real 1788573918]  req@ffff8dc00644c000 x1875453360967424/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573943 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573918.371251:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788573918.371256:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573918.371265:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2264
00000100:00080000:3.0:1788573918.371269:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573918.371274:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788573918.371275:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c000 x1875453360967424/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573943 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1788573918.371278:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1788573918.371294:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1788573918.371296:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ea00 x1875453360968064/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573918.371302:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573918.371311:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360967424:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788573918.371318:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788573918.371324:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360967552:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788573918.371324:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788573918.371327:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573918.371335:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2264
00000100:00080000:3.0:1788573918.371339:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573918.371342:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573918.371348:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788573918.371354:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573918.371361:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d500 x1875453360968192/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788573918.371369:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573918/real 1788573918]  req@ffff8dc00644f800 x1875453360967552/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573943 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573918.371381:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f800 x1875453360967552/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573943 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573918.371389:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573918.371392:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573918.371395:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360967552:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573918.371415:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360967680:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573918.371428:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573918.371435:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573918/real 1788573918]  req@ffff8dc00644ca80 x1875453360967680/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573943 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573918.371442:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ca80 x1875453360967680/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573943 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573918.371448:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573918.371451:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573918.371453:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360967680:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573918.371456:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360967808:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573918.371475:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573918.371482:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573918/real 1788573918]  req@ffff8dc00644dc00 x1875453360967808/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573943 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573918.371489:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644dc00 x1875453360967808/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573943 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573918.371495:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573918.371497:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573918.371500:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360967808:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573918.371503:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360967936:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788573918.371514:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573918.371520:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573918/real 1788573918]  req@ffff8dc00644ce00 x1875453360967936/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573943 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573918.371528:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ce00 x1875453360967936/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573943 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573918.371533:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573918.371535:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573918.371537:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360967936:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573918.371540:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360968064:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573918.371550:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573918.371556:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573918/real 1788573918]  req@ffff8dc00644ea00 x1875453360968064/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573943 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573918.371563:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ea00 x1875453360968064/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573943 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573918.371568:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573918.371570:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573918.371571:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360968064:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573918.371575:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360968192:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573918.371584:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573918.371590:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573918/real 1788573918]  req@ffff8dc00644d500 x1875453360968192/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573943 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573918.371597:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d500 x1875453360968192/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573943 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573918.371602:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573918.371604:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573918.371605:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360968192:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573918.754978:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573918.754983:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573918.754996:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573918.755016:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573918.755025:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788573918.755032:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573919.395016:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573919.779021:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573919.779021:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573919.779021:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573919.779024:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573919.779055:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788573919.779130:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573920.418989:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573920.803011:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573920.803059:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788573920.803083:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573920.803248:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573920.803259:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573920.803336:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573921.442956:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573921.826948:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573921.826951:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573921.826957:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573921.826980:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573921.827032:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788573921.827045:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573922.467026:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573922.851016:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573922.851016:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573922.851033:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573922.851072:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573922.851085:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573922.851092:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1788573923.491021:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788573923.491023:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788573923.491034:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788573923.491039:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573923.491050:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2269
00000100:00080000:0.0:1788573923.491061:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573923.491070:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788573923.491114:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453360968320/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573923.491142:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573923.491145:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573923.491147:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573923.491151:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2269
00000100:00080000:0.0:1788573923.491153:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573923.491157:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573923.491168:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573923.491185:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453360968448/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573923.491192:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360968320:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788573923.491201:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573923.491207:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573923.491209:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573923.491214:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2269
00000100:00080000:0.0:1788573923.491219:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573923.491224:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573923.491231:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573923.491245:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453360968576/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573923.491285:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573923.491288:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573923.491290:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573923.491293:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2269
00000100:00080000:0.0:1788573923.491303:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573923.491307:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573923.491312:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788573923.491319:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573923.491329:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453360968704/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573923.491342:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573923.491346:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573923.491348:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573923.491353:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2269
00000100:00080000:0.0:1788573923.491358:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573923.491363:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573923.491370:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573923.491376:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573923/real 1788573923]  req@ffff8dc006713b80 x1875453360968320/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573948 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573923.491391:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453360968832/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573923.491400:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788573923.491402:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453360968320/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573948 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573923.491403:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573923.491408:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573923.491416:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2269
00000100:00080000:0.0:1788573923.491421:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573923.491426:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:3.0:1788573923.491427:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1788573923.491430:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788573923.491436:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573923.491443:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453360968960/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573923.491445:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360968320:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788573923.491459:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573923.491462:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573923.491468:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573923.491471:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2269
00000100:00080000:0.0:1788573923.491474:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573923.491477:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573923.491481:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573923.491485:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360968448:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573923.491493:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453360969088/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788573923.491523:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573923.491539:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573923/real 1788573923]  req@ffff8dc006710e00 x1875453360968448/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573948 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573923.491553:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453360968448/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573948 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573923.491565:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573923.491569:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573923.491573:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360968448:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573923.491580:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360968576:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573923.491605:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573923.491617:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573923/real 1788573923]  req@ffff8dc006712300 x1875453360968576/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573948 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573923.491630:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453360968576/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573948 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573923.491640:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573923.491644:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573923.491648:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360968576:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573923.491655:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360968704:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573923.491678:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573923.491691:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573923/real 1788573923]  req@ffff8dc006713100 x1875453360968704/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573948 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573923.491704:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453360968704/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573948 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573923.491714:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573923.491717:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573923.491721:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360968704:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573923.491728:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360968832:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573923.491749:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573923.491761:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573923/real 1788573923]  req@ffff8dc006713800 x1875453360968832/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573948 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573923.491773:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453360968832/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573948 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573923.491783:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573923.491787:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573923.491791:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360968832:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573923.491798:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360968960:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573923.491821:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573923.491834:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573923/real 1788573923]  req@ffff8dc006711880 x1875453360968960/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573948 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573923.491847:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453360968960/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573948 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573923.491856:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573923.491860:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573923.491863:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360968960:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573923.491911:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360969088:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573923.491934:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573923.491946:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573923/real 1788573923]  req@ffff8dc006712a00 x1875453360969088/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573948 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573923.491959:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453360969088/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573948 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573923.491968:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573923.491972:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573923.491976:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360969088:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573923.875021:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573923.875021:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573923.875021:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573923.875057:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573923.875059:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573923.875069:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573924.515037:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573924.899024:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573924.899027:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573924.899029:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573924.899051:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573924.899091:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573924.899107:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573925.538970:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573925.922977:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573925.922978:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573925.922980:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573925.923000:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573925.923008:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573925.923009:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573926.562951:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573926.946971:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573926.946972:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573926.947016:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573926.947154:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573926.947159:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573926.947208:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573927.586981:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573927.970996:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573927.970996:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573927.970996:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573927.971000:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573927.971031:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573927.971084:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1788573928.610950:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788573928.610951:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788573928.610960:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788573928.610964:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573928.610973:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2274
00000100:00080000:0.0:1788573928.610982:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573928.610988:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788573928.611023:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453360969216/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573928.611053:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573928.611058:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573928.611060:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573928.611064:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2274
00000100:00080000:0.0:1788573928.611067:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573928.611073:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573928.611082:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573928.611093:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360969216:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788573928.611101:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453360969344/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573928.611113:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573928.611117:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573928.611118:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573928.611122:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2274
00000100:00080000:0.0:1788573928.611125:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573928.611128:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573928.611132:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573928.611142:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453360969472/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788573928.611150:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788573928.611151:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573928.611157:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573928.611158:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573928.611161:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2274
00000100:00080000:0.0:1788573928.611164:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573928.611167:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573928.611170:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573928.611179:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453360969600/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573928.611186:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573928.611188:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573928.611192:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788573928.611193:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573928/real 1788573928]  req@ffff8dc006711500 x1875453360969216/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573953 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573928.611197:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2274
00000100:00080000:0.0:1788573928.611202:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573928.611208:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573928.611214:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573928.611221:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453360969216/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573953 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573928.611223:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453360969728/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573928.611249:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573928.611249:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573928.611255:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788573928.611259:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788573928.611260:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573928.611267:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2274
00000100:00080000:0.0:1788573928.611271:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788573928.611271:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360969216:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788573928.611277:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573928.611283:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573928.611290:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453360969856/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573928.611295:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573928.611297:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573928.611298:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573928.611301:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2274
00000100:00080000:0.0:1788573928.611303:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573928.611319:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573928.611321:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360969344:192.168.202.140@tcp:38:kworker.0
00000008:00100000:0.0:1788573928.611324:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573928.611336:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453360969984/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788573928.611358:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573928.611373:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573928/real 1788573928]  req@ffff8dc006711c00 x1875453360969344/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573953 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573928.611382:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453360969344/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573953 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573928.611389:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573928.611392:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573928.611394:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360969344:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573928.611398:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360969472:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573928.611412:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573928.611419:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573928/real 1788573928]  req@ffff8dc006713480 x1875453360969472/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573953 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573928.611426:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453360969472/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573953 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573928.611437:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573928.611439:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573928.611441:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360969472:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573928.611446:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360969600:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573928.611464:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573928.611475:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573928/real 1788573928]  req@ffff8dc006712680 x1875453360969600/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573953 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573928.611486:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453360969600/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573953 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573928.611494:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573928.611497:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573928.611500:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360969600:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573928.611506:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360969728:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573928.611524:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573928.611535:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573928/real 1788573928]  req@ffff8dc006710380 x1875453360969728/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573953 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573928.611545:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453360969728/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573953 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573928.611552:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573928.611555:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573928.611558:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360969728:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573928.611564:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360969856:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573928.611582:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573928.611593:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573928/real 1788573928]  req@ffff8dc006712a00 x1875453360969856/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573953 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573928.611604:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453360969856/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573953 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573928.611611:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573928.611614:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573928.611618:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360969856:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573928.611636:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360969984:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573928.611658:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573928.611669:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573928/real 1788573928]  req@ffff8dc006711880 x1875453360969984/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573953 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573928.611681:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453360969984/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573953 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573928.611688:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573928.611690:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573928.611693:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360969984:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573928.994968:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573928.994979:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573928.994996:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788573928.994999:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573928.995006:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573928.995022:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573929.634986:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573930.018949:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573930.018953:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573930.018957:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573930.019014:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573930.019030:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573930.019056:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573930.658932:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573931.042951:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573931.042956:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573931.042963:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573931.042982:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573931.043023:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573931.043036:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573931.683007:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573932.066980:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573932.066980:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573932.066983:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573932.066996:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573932.067013:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573932.067013:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573932.707001:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573933.090983:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573933.090983:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573933.090983:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573933.091016:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573933.091018:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573933.091035:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00080000:2.0:1788573933.730976:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788573933.730984:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788573933.730987:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788573933.730994:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573933.731004:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2279
00000100:00080000:2.0:1788573933.731024:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573933.731031:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573933.731065:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453360970112/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573933.731085:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573933.731088:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573933.731090:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573933.731093:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2279
00000100:00080000:2.0:1788573933.731095:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573933.731098:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573933.731106:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573933.731115:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453360970240/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573933.731122:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573933.731125:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573933.731126:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573933.731131:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2279
00000100:00080000:2.0:1788573933.731133:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788573933.731133:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360970112:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788573933.731141:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573933.731144:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573933.731152:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453360970368/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573933.731159:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573933.731162:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573933.731163:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573933.731165:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2279
00000100:00080000:2.0:1788573933.731178:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573933.731180:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573933.731183:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788573933.731190:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573933.731192:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453360970496/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573933.731200:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573933.731202:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573933.731203:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573933.731206:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2279
00000100:00080000:2.0:1788573933.731207:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573933.731210:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573933.731213:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573933.731219:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453360970624/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573933.731225:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573933.731227:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573933.731229:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573933.731231:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2279
00000100:00080000:2.0:1788573933.731234:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573933.731236:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573933.731239:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573933.731241:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573933/real 1788573933]  req@ffff8dc020495500 x1875453360970112/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573958 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573933.731250:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453360970752/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573933.731266:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573933.731269:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573933.731270:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573933.731273:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2279
00000100:00080000:2.0:1788573933.731277:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788573933.731278:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453360970112/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573958 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573933.731281:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573933.731287:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788573933.731297:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1788573933.731299:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453360970880/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573933.731310:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573933.731314:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360970112:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788573933.731321:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360970240:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573933.731341:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573933.731351:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573933/real 1788573933]  req@ffff8dc020494380 x1875453360970240/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573958 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573933.731360:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453360970240/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573958 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573933.731383:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573933.731387:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573933.731391:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360970240:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573933.731427:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360970368:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573933.731445:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573933.731453:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573933/real 1788573933]  req@ffff8dc020494700 x1875453360970368/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573958 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573933.731466:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453360970368/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573958 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573933.731474:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573933.731478:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573933.731481:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360970368:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573933.731488:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360970496:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573933.731517:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573933.731526:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573933/real 1788573933]  req@ffff8dc020496a00 x1875453360970496/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573958 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573933.731534:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453360970496/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573958 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573933.731540:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573933.731542:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573933.731544:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360970496:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573933.731548:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360970624:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573933.731561:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573933.731567:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573933/real 1788573933]  req@ffff8dc020494e00 x1875453360970624/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573958 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573933.731575:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453360970624/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573958 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573933.731581:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573933.731583:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573933.731585:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360970624:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573933.731588:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360970752:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573933.731598:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573933.731604:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573933/real 1788573933]  req@ffff8dc020494000 x1875453360970752/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573958 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573933.731611:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453360970752/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573958 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573933.731616:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573933.731617:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573933.731619:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360970752:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573933.731622:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360970880:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573933.731632:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573933.731638:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573933/real 1788573933]  req@ffff8dc020497100 x1875453360970880/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573958 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573933.731652:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453360970880/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573958 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573933.731661:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573933.731663:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573933.731665:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360970880:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573934.114988:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573934.114988:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573934.114988:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573934.115015:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573934.115047:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573934.115100:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573934.754969:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573935.138977:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573935.138977:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573935.138977:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573935.139005:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573935.139010:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573935.139024:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573935.778991:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573936.162955:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573936.162956:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573936.162961:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573936.162992:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573936.163021:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573936.163070:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573936.802974:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573937.187020:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573937.187021:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573937.187021:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573937.187030:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573937.187078:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573937.187132:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573937.826971:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573938.210989:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573938.211007:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573938.211019:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573938.211021:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573938.211062:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788573938.211119:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573938.850967:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788573938.850975:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573938.850984:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788573938.850989:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573938.851004:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2284
00000100:00080000:2.0:1788573938.851018:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573938.851028:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573938.851076:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453360971008/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573938.851104:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573938.851106:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573938.851108:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573938.851111:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2284
00000100:00080000:2.0:1788573938.851114:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573938.851117:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573938.851127:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573938.851137:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453360971136/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573938.851145:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573938.851148:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573938.851149:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573938.851154:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2284
00000100:00100000:3.0:1788573938.851156:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360971008:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788573938.851157:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573938.851163:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573938.851169:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573938.851176:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453360971264/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573938.851181:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573938.851184:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573938.851185:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573938.851187:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2284
00000100:00080000:2.0:1788573938.851189:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573938.851192:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573938.851203:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573938.851215:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453360971392/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573938.851221:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573938.851224:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573938.851225:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573938.851228:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2284
00000100:00080000:2.0:1788573938.851230:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573938.851233:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573938.851237:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573938.851250:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453360971520/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788573938.851251:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788573938.851260:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573938.851263:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573938.851265:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573938.851269:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2284
00000100:00080000:2.0:1788573938.851272:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573938.851275:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573938.851278:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573938.851286:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453360971648/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573938.851292:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573938.851294:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573938.851295:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573938.851299:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2284
00000100:00080000:2.0:1788573938.851301:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573938.851304:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573938.851309:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573938/real 1788573938]  req@ffff8dc020495180 x1875453360971008/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573963 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1788573938.851310:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573938.851322:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453360971776/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788573938.851331:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453360971008/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573963 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573938.851341:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573938.851345:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573938.851351:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360971008:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788573938.851380:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360971136:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573938.851406:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573938.851417:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573938/real 1788573938]  req@ffff8dc020495880 x1875453360971136/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573963 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573938.851456:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453360971136/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573963 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573938.851464:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573938.851467:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573938.851469:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360971136:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573938.851474:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360971264:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573938.851491:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573938.851499:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573938/real 1788573938]  req@ffff8dc020496d80 x1875453360971264/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573963 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573938.851506:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453360971264/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573963 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573938.851513:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573938.851515:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573938.851517:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360971264:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573938.851521:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360971392:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573938.851531:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573938.851537:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573938/real 1788573938]  req@ffff8dc020494a80 x1875453360971392/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573963 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573938.851544:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453360971392/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573963 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573938.851555:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573938.851557:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573938.851559:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360971392:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573938.851562:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360971520:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788573938.851572:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573938.851578:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573938/real 1788573938]  req@ffff8dc020497480 x1875453360971520/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573963 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573938.851585:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453360971520/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573963 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573938.851591:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573938.851594:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573938.851595:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360971520:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573938.851599:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360971648:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573938.851610:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573938.851615:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573938/real 1788573938]  req@ffff8dc020497100 x1875453360971648/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573963 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573938.851623:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453360971648/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573963 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573938.851628:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573938.851630:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573938.851633:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360971648:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788573938.851636:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360971776:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788573938.851647:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573938.851652:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573938/real 1788573938]  req@ffff8dc020494000 x1875453360971776/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573963 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573938.851659:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453360971776/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573963 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573938.851665:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573938.851666:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573938.851668:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360971776:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573939.235046:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573939.235064:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573939.235066:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573939.235066:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573939.235104:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788573939.235165:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573939.874988:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573940.258968:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573940.258970:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573940.258975:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573940.258990:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573940.259011:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788573940.259046:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573940.898961:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573941.282940:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573941.282963:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788573941.282977:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573941.282997:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573941.283010:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573941.283024:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573941.922985:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573942.306998:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573942.306998:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573942.306999:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573942.307036:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573942.307042:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788573942.307123:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573942.947002:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573943.330951:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573943.330983:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573943.330999:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573943.331003:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573943.331030:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573943.331032:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573943.970976:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788573943.970982:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573943.970990:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788573943.970995:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573943.971005:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2289
00000100:00080000:3.0:1788573943.971015:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573943.971024:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573943.971062:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f480 x1875453360971904/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573943.971091:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573943.971096:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573943.971098:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573943.971103:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2289
00000100:00080000:3.0:1788573943.971108:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573943.971113:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573943.971123:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573943.971131:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360971904:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788573943.971139:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d180 x1875453360972032/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573943.971152:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573943.971157:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788573943.971160:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573943.971165:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2289
00000100:00080000:3.0:1788573943.971170:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573943.971175:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573943.971181:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573943.971194:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e680 x1875453360972160/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788573943.971203:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788573943.971211:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573943.971216:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788573943.971219:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573943.971224:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2289
00000100:00080000:3.0:1788573943.971228:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573943.971234:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573943.971239:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573943.971246:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573943/real 1788573943]  req@ffff8dc00644f480 x1875453360971904/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573968 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573943.971263:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453360971904/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573968 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573943.971271:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573943.971275:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573943.971277:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360971904:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788573943.971296:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360972032:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788573943.971318:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573943.971318:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c700 x1875453360972288/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788573943.971331:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573943/real 1788573943]  req@ffff8dc00644d180 x1875453360972032/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573968 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573943.971334:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573943.971345:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573943.971348:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1788573943.971350:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453360972032/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573968 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573943.971356:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2289
00000100:00080000:1.0:1788573943.971363:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573943.971365:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573943.971368:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788573943.971374:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573943.971375:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360972032:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573943.971384:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360972160:192.168.202.140@tcp:8:kworker.0
00000008:00100000:3.0:1788573943.971386:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573943.971402:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c380 x1875453360972416/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788573943.971406:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573943.971416:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573943/real 1788573943]  req@ffff8dc00644e680 x1875453360972160/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573968 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573943.971418:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573943.971428:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:1.0:1788573943.971432:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453360972160/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573968 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573943.971432:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573943.971442:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2289
00000100:00080000:1.0:1788573943.971444:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573943.971450:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573943.971452:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360972160:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573943.971461:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360972288:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573943.971472:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573943.971478:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573943/real 1788573943]  req@ffff8dc00644c700 x1875453360972288/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573968 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573943.971511:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453360972288/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573968 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573943.971518:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573943.971520:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573943.971523:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360972288:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573943.971527:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360972416:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788573943.971544:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573943.971554:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573943/real 1788573943]  req@ffff8dc00644c380 x1875453360972416/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573968 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573943.971567:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453360972416/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573968 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573943.971569:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573943.971578:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573943.971578:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:1.0:1788573943.971585:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000008:00100000:3.0:1788573943.971586:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573943.971588:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360972416:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788573943.971602:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e300 x1875453360972544/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573943.971618:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573943.971621:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1788573943.971633:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360972544:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573943.971651:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573943.971662:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573943/real 1788573943]  req@ffff8dc00644e300 x1875453360972544/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573968 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573943.971668:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1788573943.971673:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453360972544/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573968 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573943.971676:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2289
00000100:00080000:3.0:1788573943.971682:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573943.971685:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573943.971688:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:1.0:1788573943.971692:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573943.971696:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360972544:192.168.202.140@tcp:8:kworker.0
00000008:00100000:3.0:1788573943.971696:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573943.971711:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644fb80 x1875453360972672/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788573943.971741:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360972672:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573943.971756:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573943.971764:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573943/real 1788573943]  req@ffff8dc00644fb80 x1875453360972672/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573968 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573943.971771:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644fb80 x1875453360972672/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573968 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573943.971781:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573943.971783:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573943.971785:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360972672:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573944.354967:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573944.354967:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573944.354978:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573944.355013:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573944.355014:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573944.355030:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573944.995029:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573945.378977:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573945.378977:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573945.378977:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573945.379011:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573945.379015:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573945.379017:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573946.019010:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573946.402966:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573946.402973:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573946.403024:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573946.403032:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573946.403042:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573946.403056:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573947.042972:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573947.426969:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573947.426969:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573947.426970:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573947.427076:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573947.427117:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788573947.427127:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573948.066984:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573948.450937:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573948.450937:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573948.450946:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573948.450972:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573948.450985:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573948.451026:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1788573949.090967:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788573949.090971:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788573949.090980:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788573949.090984:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573949.090994:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2294
00000100:00080000:3.0:1788573949.091005:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573949.091011:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573949.091043:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f100 x1875453360972800/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573949.091065:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573949.091069:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573949.091070:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573949.091073:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2294
00000100:00080000:3.0:1788573949.091076:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573949.091079:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573949.091090:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573949.091099:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360972800:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788573949.091106:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644df80 x1875453360972928/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573949.091121:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573949.091125:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788573949.091127:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573949.091132:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2294
00000100:00080000:3.0:1788573949.091136:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573949.091139:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573949.091143:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573949.091154:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ed80 x1875453360973056/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788573949.091165:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788573949.091166:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573949.091172:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788573949.091174:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573949.091180:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2294
00000100:00100000:1.0:1788573949.091207:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573949/real 1788573949]  req@ffff8dc00644f100 x1875453360972800/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573974 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573949.091213:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573949.091221:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573949.091228:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573949.091236:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f100 x1875453360972800/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573974 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573949.091240:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d880 x1875453360973184/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573949.091266:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573949.091268:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573949.091269:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573949.091274:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573949.091278:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788573949.091279:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2294
00000100:00080000:3.0:1788573949.091285:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788573949.091290:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360972800:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788573949.091290:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573949.091298:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573949.091308:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644fb80 x1875453360973312/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573949.091314:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573949.091316:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788573949.091320:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1788573949.091321:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360972928:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788573949.091325:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2294
00000100:00080000:3.0:1788573949.091329:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573949.091333:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573949.091338:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573949.091348:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e300 x1875453360973440/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573949.091356:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1788573949.091359:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788573949.091360:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788573949.091364:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573949.091368:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2294
00000100:00080000:3.0:1788573949.091371:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573949.091374:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573949.091378:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573949.091380:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573949/real 1788573949]  req@ffff8dc00644df80 x1875453360972928/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573974 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788573949.091395:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c380 x1875453360973568/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788573949.091402:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644df80 x1875453360972928/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573974 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573949.091418:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573949.091423:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573949.091427:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360972928:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573949.091434:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360973056:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573949.091454:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573949.091465:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573949/real 1788573949]  req@ffff8dc00644ed80 x1875453360973056/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573974 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573949.091478:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ed80 x1875453360973056/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573974 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573949.091497:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573949.091501:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573949.091506:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360973056:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573949.091512:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360973184:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573949.091531:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573949.091542:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573949/real 1788573949]  req@ffff8dc00644d880 x1875453360973184/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573974 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573949.091571:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d880 x1875453360973184/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573974 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573949.091582:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573949.091586:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573949.091590:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360973184:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573949.091596:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360973312:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788573949.091616:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573949.091628:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573949/real 1788573949]  req@ffff8dc00644fb80 x1875453360973312/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573974 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573949.091641:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644fb80 x1875453360973312/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573974 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573949.091650:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573949.091654:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573949.091657:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360973312:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573949.091676:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360973440:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573949.091693:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573949.091703:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573949/real 1788573949]  req@ffff8dc00644e300 x1875453360973440/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573974 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573949.091716:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453360973440/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573974 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573949.091725:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573949.091728:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573949.091733:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360973440:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573949.091739:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360973568:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573949.091755:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573949.091765:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573949/real 1788573949]  req@ffff8dc00644c380 x1875453360973568/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573974 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573949.091778:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453360973568/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573974 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573949.091787:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573949.091791:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573949.091794:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360973568:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573949.474941:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573949.474949:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573949.474966:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573949.474974:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573949.474989:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573949.474992:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573950.114943:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573950.498942:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573950.498968:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573950.498968:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573950.498988:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573950.499038:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573950.499080:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573951.138975:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573951.522958:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573951.522959:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573951.522966:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573951.523072:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573951.523093:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573951.523133:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573952.162955:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573952.546972:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573952.546972:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573952.546972:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573952.546973:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573952.547009:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573952.547045:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573953.187000:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573953.570939:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573953.570940:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573953.570951:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573953.570971:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573953.570986:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573953.571024:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573954.210960:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788573954.210972:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573954.210978:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788573954.210981:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573954.210990:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2299
00000100:00080000:2.0:1788573954.210998:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573954.211004:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573954.211035:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453360973696/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573954.211055:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573954.211058:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573954.211059:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573954.211062:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2299
00000100:00080000:2.0:1788573954.211065:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573954.211068:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573954.211077:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573954.211082:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360973696:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788573954.211088:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453360973824/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573954.211096:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573954.211099:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573954.211100:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573954.211102:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2299
00000100:00080000:2.0:1788573954.211104:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573954.211106:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573954.211109:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573954.211118:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453360973952/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573954.211124:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573954.211126:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573954.211127:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573954.211129:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2299
00000100:00080000:2.0:1788573954.211132:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573954.211135:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573954.211140:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573954.211152:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453360974080/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573954.211168:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573954.211172:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573954.211174:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573954.211179:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2299
00000100:00080000:2.0:1788573954.211183:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788573954.211190:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360973824:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788573954.211191:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573954.211203:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573954.211221:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453360974208/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788573954.211232:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360973952:192.168.202.140@tcp:8:kworker.0
00000100:00080000:2.0:1788573954.211234:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573954.211242:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573954.211244:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573954.211250:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2299
00000100:00080000:2.0:1788573954.211256:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573954.211261:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573954.211267:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573954.211269:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360974080:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573954.211283:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453360974336/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573954.211295:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573954.211299:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1788573954.211301:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360974208:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788573954.211303:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573954.211311:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2299
00000100:00080000:2.0:1788573954.211317:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788573954.211321:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360974336:192.168.202.140@tcp:8:kworker.0
00000100:00080000:2.0:1788573954.211327:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573954.211334:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573954.211349:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453360974464/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788573954.211381:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360974464:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573954.594971:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573954.594971:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573954.594971:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573954.594971:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573954.595002:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788573954.595056:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573955.234948:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573955.618951:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573955.618951:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573955.618954:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573955.618991:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573955.619001:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573955.619021:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573956.258959:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573956.642984:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573956.642986:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573956.642990:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573956.642990:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573956.643017:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573956.643088:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573957.282950:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000400:00000100:0.0:1788573957.283154:0:2337:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.140:988
00000400:00000100:0.0:1788573957.283192:0:2337:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.140@tcp at host 192.168.202.140 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:0.0:1788573957.283209:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:0.0:1788573957.283257:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:0.0:1788573957.283268:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:0.0:1788573957.283280:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:0.0:1788573957.283293:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:0.0:1788573957.283308:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:0.0:1788573957.283320:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:1.0:1788573957.283320:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573954/real 1788573957]  req@ffff8dc020496a00 x1875453360973824/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573979 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573957.283363:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453360973824/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573979 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573957.283381:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573957.283388:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573957.283393:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360973824:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573957.283402:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573954/real 1788573957]  req@ffff8dc020494700 x1875453360973952/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573979 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573957.283416:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453360973952/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573979 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573957.283431:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573957.283436:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573957.283440:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360973952:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573957.283449:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573954/real 1788573957]  req@ffff8dc020494380 x1875453360974080/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573979 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573957.283478:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453360974080/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573979 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573957.283488:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573957.283492:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573957.283495:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360974080:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573957.283504:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573954/real 1788573957]  req@ffff8dc020494e00 x1875453360973696/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573979 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573957.283516:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453360973696/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573979 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573957.283524:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573957.283528:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573957.283531:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360973696:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788573957.283573:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573954/real 1788573957]  req@ffff8dc020497100 x1875453360974464/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573979 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573957.283593:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453360974464/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573979 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573957.283601:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573957.283606:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573957.283609:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360974464:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573957.283618:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573954/real 1788573957]  req@ffff8dc020495500 x1875453360974208/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573979 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573957.283631:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453360974208/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573979 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573957.283674:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573957.283679:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573957.283683:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360974208:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573957.283692:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573954/real 1788573957]  req@ffff8dc020494000 x1875453360974336/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573979 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573957.283706:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453360974336/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573979 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573957.283714:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573957.283718:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573957.283721:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360974336:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573957.666955:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573957.666974:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573957.667021:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573957.667022:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573957.667023:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573957.667123:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573958.306951:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573958.690973:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573958.690974:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573958.690974:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573958.690974:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573958.691010:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573958.691061:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573959.330955:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788573959.330955:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573959.330964:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788573959.330967:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573959.330977:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2304
00000100:00080000:2.0:1788573959.330987:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573959.330995:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573959.331028:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453360974592/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573959.331050:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573959.331054:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573959.331056:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573959.331061:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2304
00000100:00080000:2.0:1788573959.331064:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573959.331070:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573959.331080:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573959.331086:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360974592:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788573959.331093:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453360974720/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573959.331103:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573959.331106:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573959.331108:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573959.331111:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2304
00000100:00080000:2.0:1788573959.331115:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573959.331118:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573959.331123:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573959.331132:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453360974848/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573959.331140:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573959.331143:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573959.331145:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1788573959.331146:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788573959.331148:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2304
00000100:00080000:2.0:1788573959.331151:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573959.331154:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573959.331159:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573959.331180:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453360974976/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788573959.331189:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573959/real 1788573959]  req@ffff8dc020497480 x1875453360974592/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573984 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573959.331189:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573959.331193:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573959.331195:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573959.331199:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2304
00000100:00080000:2.0:1788573959.331202:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573959.331205:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573959.331209:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453360974592/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573984 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1788573959.331210:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573959.331219:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453360975104/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573959.331220:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573959.331225:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573959.331229:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360974592:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788573959.331229:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573959.331233:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573959.331234:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573959.331238:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2304
00000100:00080000:2.0:1788573959.331241:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573959.331245:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573959.331250:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573959.331252:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360974720:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788573959.331259:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453360975232/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573959.331267:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573959.331271:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573959.331273:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1788573959.331274:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788573959.331276:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2304
00000100:00080000:2.0:1788573959.331280:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573959.331284:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573959.331286:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573959/real 1788573959]  req@ffff8dc020494a80 x1875453360974720/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573984 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1788573959.331289:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573959.331300:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453360974720/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573984 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573959.331300:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453360975360/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573959.331312:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573959.331315:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573959.331318:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360974720:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573959.331325:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360974848:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573959.331352:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573959.331364:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573959/real 1788573959]  req@ffff8dc020496d80 x1875453360974848/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573984 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573959.331377:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453360974848/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573984 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573959.331393:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573959.331396:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573959.331400:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360974848:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573959.331406:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360974976:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573959.331428:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573959.331439:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573959/real 1788573959]  req@ffff8dc020495880 x1875453360974976/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573984 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573959.331452:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453360974976/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573984 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573959.331462:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573959.331466:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573959.331469:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360974976:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573959.331476:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360975104:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788573959.331500:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573959.331512:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573959/real 1788573959]  req@ffff8dc020495180 x1875453360975104/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573984 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573959.331526:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453360975104/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573984 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573959.331535:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573959.331538:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573959.331542:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360975104:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573959.331562:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360975232:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573959.331584:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573959.331596:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573959/real 1788573959]  req@ffff8dc020497480 x1875453360975232/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573984 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573959.331607:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453360975232/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573984 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573959.331631:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573959.331634:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573959.331638:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360975232:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573959.331643:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360975360:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573959.331698:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573959.331710:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573959/real 1788573959]  req@ffff8dc020494000 x1875453360975360/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573984 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573959.331722:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453360975360/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573984 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573959.331731:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573959.331734:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573959.331737:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360975360:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573959.714969:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573959.714969:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573959.714969:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573959.714970:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573959.715003:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573959.715044:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573960.354932:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573960.739002:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573960.739002:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573960.739003:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573960.739004:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573960.739043:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573960.739090:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573961.379013:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573961.762995:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573961.762995:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573961.762995:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573961.762996:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573961.763037:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573961.763093:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573962.402935:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573962.786974:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573962.786974:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573962.786993:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573962.787040:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573962.787042:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788573962.787075:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573963.426970:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573963.810953:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573963.810953:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573963.810971:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573963.810981:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573963.811004:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573963.811018:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00080000:3.0:1788573964.451034:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788573964.451035:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788573964.451047:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788573964.451053:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573964.451064:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2310
00000100:00080000:3.0:1788573964.451075:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573964.451083:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573964.451124:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c700 x1875453360975488/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573964.451149:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573964.451152:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573964.451153:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573964.451156:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2310
00000100:00080000:3.0:1788573964.451159:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573964.451161:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573964.451171:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573964.451181:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e680 x1875453360975616/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573964.451190:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788573964.451191:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360975488:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788573964.451194:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788573964.451197:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573964.451203:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2310
00000100:00080000:3.0:1788573964.451206:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573964.451208:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573964.451212:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573964.451221:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d180 x1875453360975744/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573964.451227:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573964.451230:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788573964.451231:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573964.451234:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2310
00000100:00080000:3.0:1788573964.451236:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573964.451238:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573964.451241:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573964.451249:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f480 x1875453360975872/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573964.451255:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573964.451257:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573964.451258:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573964.451262:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2310
00000100:00080000:3.0:1788573964.451265:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573964.451268:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573964.451271:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573964.451279:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d500 x1875453360976000/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573964.451285:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573964.451288:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788573964.451289:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573964.451296:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2310
00000800:00000100:1.0:1788573964.451299:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788573964.451300:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573964.451306:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573964.451310:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573964.451317:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ea00 x1875453360976128/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573964.451325:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573964.451328:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788573964.451330:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573964.451332:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2310
00000100:00080000:3.0:1788573964.451334:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573964.451336:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573964.451339:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573964.451346:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ce00 x1875453360976256/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788573964.451361:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573964/real 1788573964]  req@ffff8dc00644c700 x1875453360975488/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573989 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573964.451385:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453360975488/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573989 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573964.451397:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573964.451401:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573964.451406:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360975488:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788573964.451433:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360975616:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788573964.451459:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573964.451475:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573964/real 1788573964]  req@ffff8dc00644e680 x1875453360975616/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573989 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573964.451489:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453360975616/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573989 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573964.451509:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573964.451513:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573964.451517:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360975616:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573964.451524:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360975744:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573964.451548:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573964.451561:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573964/real 1788573964]  req@ffff8dc00644d180 x1875453360975744/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573989 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573964.451574:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453360975744/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573989 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573964.451583:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573964.451587:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573964.451590:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360975744:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573964.451597:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360975872:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573964.451618:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573964.451630:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573964/real 1788573964]  req@ffff8dc00644f480 x1875453360975872/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573989 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573964.451644:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453360975872/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573989 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573964.451653:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573964.451657:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573964.451661:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360975872:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573964.451667:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360976000:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788573964.451689:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573964.451702:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573964/real 1788573964]  req@ffff8dc00644d500 x1875453360976000/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573989 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573964.451714:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d500 x1875453360976000/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573989 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573964.451754:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573964.451759:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573964.451763:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360976000:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573964.451769:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360976128:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573964.451791:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573964.451804:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573964/real 1788573964]  req@ffff8dc00644ea00 x1875453360976128/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573989 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573964.451817:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ea00 x1875453360976128/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573989 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573964.451825:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573964.451828:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573964.451832:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360976128:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573964.451838:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360976256:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573964.451856:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573964.451891:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573964/real 1788573964]  req@ffff8dc00644ce00 x1875453360976256/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573989 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573964.451904:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ce00 x1875453360976256/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573989 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573964.451913:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573964.451916:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573964.451919:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360976256:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573964.835010:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573964.835010:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573964.835010:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788573964.835051:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573964.835052:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573964.835063:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573965.474974:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573965.858954:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573965.858959:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573965.858987:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573965.859021:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573965.859044:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573965.859047:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573966.498978:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573966.882955:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573966.882958:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573966.882958:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573966.882963:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573966.882991:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573966.883031:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573967.522965:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573967.906957:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573967.906971:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573967.906977:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573967.906993:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573967.906995:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573967.907001:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573968.547035:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573968.930988:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573968.931028:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573968.931028:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573968.931034:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573968.931066:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573968.931082:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573969.570948:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788573969.570956:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573969.570964:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788573969.570969:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573969.570979:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2315
00000100:00080000:0.0:1788573969.570990:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573969.570998:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788573969.571035:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453360976384/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573969.571063:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573969.571067:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573969.571070:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573969.571075:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2315
00000100:00080000:0.0:1788573969.571080:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573969.571085:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573969.571092:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360976384:192.168.202.140@tcp:250:kworker.0
00000008:00100000:0.0:1788573969.571096:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573969.571115:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453360976512/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573969.571128:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573969.571132:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573969.571134:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573969.571139:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2315
00000100:00080000:0.0:1788573969.571145:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573969.571150:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:1.0:1788573969.571154:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:0.0:1788573969.571157:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573969.571173:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453360976640/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573969.571185:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573969.571189:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1788573969.571192:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573969/real 1788573969]  req@ffff8dc006713800 x1875453360976384/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573994 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573969.571194:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573969.571204:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2315
00000100:00080000:0.0:1788573969.571211:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573969.571217:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573969.571219:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453360976384/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573994 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1788573969.571225:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1788573969.571240:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1788573969.571246:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453360976768/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573969.571248:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573969.571254:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360976384:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788573969.571270:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573969.571274:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573969.571277:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1788573969.571282:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360976512:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788573969.571293:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2315
00000100:00080000:0.0:1788573969.571307:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1788573969.571313:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788573969.571317:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573969.571325:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573969.571335:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573969/real 1788573969]  req@ffff8dc006713100 x1875453360976512/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573994 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573969.571341:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453360976896/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573969.571366:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788573969.571367:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453360976512/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573994 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573969.571374:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573969.571378:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573969.571388:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2315
00000100:00080000:1.0:1788573969.571391:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573969.571393:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573969.571402:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788573969.571403:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573969.571413:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573969.571414:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360976512:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573969.571428:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360976640:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573969.571430:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453360977024/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573969.571445:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573969.571449:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573969.571452:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573969.571461:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2315
00000800:00000100:1.0:1788573969.571462:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788573969.571469:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573969.571476:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573969.571482:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573969.571484:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573969/real 1788573969]  req@ffff8dc006712300 x1875453360976640/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573994 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573969.571497:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453360977152/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788573969.571505:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453360976640/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573994 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573969.571521:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573969.571525:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573969.571531:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360976640:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573969.571540:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360976768:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573969.571562:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573969.571573:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573969/real 1788573969]  req@ffff8dc006710e00 x1875453360976768/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573994 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573969.571586:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453360976768/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573994 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573969.571596:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573969.571599:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573969.571602:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360976768:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573969.571619:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360976896:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788573969.571639:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573969.571650:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573969/real 1788573969]  req@ffff8dc006713b80 x1875453360976896/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573994 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573969.571662:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453360976896/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573994 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573969.571672:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573969.571675:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573969.571679:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360976896:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573969.571685:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360977024:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573969.571701:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573969.571712:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573969/real 1788573969]  req@ffff8dc006713800 x1875453360977024/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573994 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573969.571725:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453360977024/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573994 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573969.571734:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573969.571737:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573969.571740:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360977024:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573969.571746:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360977152:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573969.571763:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573969.571773:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573969/real 1788573969]  req@ffff8dc006711880 x1875453360977152/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573994 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573969.571800:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453360977152/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573994 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573969.571809:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573969.571812:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573969.571816:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360977152:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573969.954953:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573969.954963:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573969.954970:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573969.954981:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573969.954998:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788573969.955025:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573970.594997:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573970.978973:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573970.978976:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573970.978977:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573970.978980:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573970.979008:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573970.979049:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573971.618951:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573972.002979:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573972.002979:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573972.003017:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573972.003046:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573972.003066:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788573972.003078:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573972.642991:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573973.026977:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573973.026977:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573973.026977:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573973.026980:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573973.027013:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573973.027043:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573973.666957:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573974.050967:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573974.050970:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573974.050973:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573974.050974:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573974.050996:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788573974.051046:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573974.690962:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788573974.690994:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573974.691000:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788573974.691003:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573974.691011:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2320
00000100:00080000:3.0:1788573974.691021:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573974.691027:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788573974.691058:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644dc00 x1875453360977280/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573974.691077:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573974.691080:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573974.691081:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573974.691084:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2320
00000100:00080000:3.0:1788573974.691086:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573974.691088:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573974.691096:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573974.691105:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ca80 x1875453360977408/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573974.691113:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788573974.691115:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360977280:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788573974.691118:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788573974.691123:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573974.691127:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2320
00000100:00080000:3.0:1788573974.691130:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573974.691132:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573974.691136:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573974.691144:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f800 x1875453360977536/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573974.691150:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573974.691153:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788573974.691154:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573974.691157:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2320
00000100:00080000:3.0:1788573974.691160:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573974.691162:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573974.691165:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573974.691173:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c000 x1875453360977664/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788573974.691178:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788573974.691185:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573974.691189:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573974.691191:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573974.691195:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2320
00000100:00080000:3.0:1788573974.691198:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573974.691201:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573974.691204:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573974.691212:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ce00 x1875453360977792/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788573974.691219:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573974/real 1788573974]  req@ffff8dc00644dc00 x1875453360977280/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573999 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573974.691238:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573974.691243:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788573974.691245:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573974.691249:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2320
00000100:00080000:3.0:1788573974.691251:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573974.691256:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573974.691257:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644dc00 x1875453360977280/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788573999 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1788573974.691259:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573974.691272:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ea00 x1875453360977920/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573974.691276:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788573974.691281:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573974.691286:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788573974.691286:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788573974.691291:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1788573974.691294:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360977280:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788573974.691298:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2320
00000100:00080000:3.0:1788573974.691303:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573974.691305:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573974.691308:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573974.691315:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d500 x1875453360978048/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788573974.691321:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360977408:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788573974.691345:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573974.691355:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573974/real 1788573974]  req@ffff8dc00644ca80 x1875453360977408/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573999 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573974.691364:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ca80 x1875453360977408/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573999 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573974.691371:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573974.691374:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573974.691376:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360977408:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573974.691380:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360977536:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573974.691395:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573974.691401:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573974/real 1788573974]  req@ffff8dc00644f800 x1875453360977536/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573999 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573974.691409:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f800 x1875453360977536/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573999 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573974.691415:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573974.691417:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573974.691420:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360977536:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573974.691423:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360977664:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573974.691434:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573974.691439:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573974/real 1788573974]  req@ffff8dc00644c000 x1875453360977664/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573999 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573974.691446:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c000 x1875453360977664/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573999 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573974.691452:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573974.691454:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573974.691456:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360977664:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573974.691459:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360977792:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788573974.691470:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573974.691476:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573974/real 1788573974]  req@ffff8dc00644ce00 x1875453360977792/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573999 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573974.691488:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ce00 x1875453360977792/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788573999 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573974.691494:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573974.691496:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573974.691498:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360977792:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573974.691501:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360977920:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573974.691511:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573974.691517:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573974/real 1788573974]  req@ffff8dc00644ea00 x1875453360977920/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573999 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573974.691524:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ea00 x1875453360977920/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573999 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573974.691529:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573974.691531:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573974.691532:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360977920:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573974.691553:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360978048:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573974.691565:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573974.691572:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573974/real 1788573974]  req@ffff8dc00644d500 x1875453360978048/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573999 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573974.691580:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d500 x1875453360978048/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788573999 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573974.691592:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573974.691595:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573974.691599:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360978048:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573975.074993:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573975.074993:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573975.074998:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573975.075005:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573975.075058:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573975.075085:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573975.715001:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573976.098940:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573976.098957:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573976.098967:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573976.098968:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573976.098980:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788573976.099054:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573976.738969:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573977.122937:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573977.122938:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573977.123017:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788573977.123132:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573977.123159:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573977.123202:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573977.762966:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573978.147029:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573978.147030:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573978.147030:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573978.147083:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573978.147085:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573978.147088:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573978.786972:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573979.171020:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573979.171021:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573979.171021:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573979.171079:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788573979.171087:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573979.171089:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00080000:3.0:1788573979.810967:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573979.810976:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788573979.810980:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573979.810993:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2325
00000100:00080000:3.0:1788573979.811001:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573979.811009:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788573979.811023:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573979.811042:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f480 x1875453360978176/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573979.811063:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573979.811067:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573979.811069:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573979.811073:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2325
00000100:00080000:3.0:1788573979.811076:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573979.811079:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573979.811087:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573979.811098:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d180 x1875453360978304/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573979.811107:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573979.811109:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788573979.811113:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788573979.811119:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360978176:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788573979.811124:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2325
00000100:00080000:3.0:1788573979.811134:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573979.811140:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573979.811148:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573979.811176:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e680 x1875453360978432/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788573979.811190:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573979.811194:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788573979.811197:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573979.811203:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2325
00000100:00080000:3.0:1788573979.811209:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573979.811214:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573979.811219:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788573979.811232:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573979.811232:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c700 x1875453360978560/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788573979.811293:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573979/real 1788573979]  req@ffff8dc00644f480 x1875453360978176/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574004 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573979.811310:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573979.811323:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788573979.811328:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573979.811336:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2325
00000100:00080000:3.0:1788573979.811341:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788573979.811343:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453360978176/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574004 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573979.811352:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573979.811360:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1788573979.811381:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573979.811387:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573979.811393:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360978176:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788573979.811432:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360978304:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788573979.811468:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788573979.811477:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c380 x1875453360978688/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788573979.811497:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573979/real 1788573979]  req@ffff8dc00644d180 x1875453360978304/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574004 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573979.811524:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788573979.811529:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453360978304/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574004 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788573979.811530:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788573979.811536:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573979.811549:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2325
00000100:00080000:3.0:1788573979.811558:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788573979.811565:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:0.0:1788573979.811571:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:3.0:1788573979.811572:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1788573979.811586:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788573979.811588:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e300 x1875453360978816/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788573979.811600:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360978304:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788573979.811602:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788573979.811611:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788573979.811616:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788573979.811621:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2325
00000100:00080000:3.0:1788573979.811623:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788573979.811629:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360978432:192.168.202.140@tcp:8:kworker.0
00000100:00080000:3.0:1788573979.811630:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788573979.811638:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788573979.811651:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644fb80 x1875453360978944/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1788573979.811677:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573979.811694:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573979/real 1788573979]  req@ffff8dc00644e680 x1875453360978432/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574004 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573979.811705:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453360978432/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574004 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573979.811712:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573979.811715:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573979.811718:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360978432:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573979.811724:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360978560:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573979.811740:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573979.811747:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573979/real 1788573979]  req@ffff8dc00644c700 x1875453360978560/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574004 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573979.811755:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453360978560/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574004 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573979.811762:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573979.811764:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573979.811766:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360978560:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573979.811778:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360978688:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788573979.811790:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573979.811797:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573979/real 1788573979]  req@ffff8dc00644c380 x1875453360978688/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574004 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573979.811805:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453360978688/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574004 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573979.811811:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573979.811813:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573979.811815:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360978688:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573979.811819:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360978816:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573979.811830:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573979.811837:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573979/real 1788573979]  req@ffff8dc00644e300 x1875453360978816/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574004 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573979.811845:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453360978816/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574004 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573979.811935:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573979.811938:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573979.811941:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360978816:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573979.811946:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360978944:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573979.811963:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573979.811972:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573979/real 1788573979]  req@ffff8dc00644fb80 x1875453360978944/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574004 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573979.811980:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644fb80 x1875453360978944/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574004 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573979.811985:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573979.811988:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573979.811990:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360978944:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573980.195002:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573980.195003:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573980.195003:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573980.195039:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573980.195048:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573980.195053:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573980.834992:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573981.219011:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573981.219011:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573981.219011:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573981.219044:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573981.219050:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573981.219058:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573981.858976:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573982.242993:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573982.242993:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573982.242993:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573982.243033:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573982.243035:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788573982.243066:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573982.883008:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573983.266965:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573983.266965:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573983.266966:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573983.266980:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573983.267001:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573983.267035:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573983.906926:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573984.290977:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573984.290977:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573984.290978:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573984.290987:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573984.291009:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788573984.291044:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1788573984.931015:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573984.931027:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788573984.931032:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788573984.931032:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788573984.931047:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2330
00000100:00080000:0.0:1788573984.931059:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573984.931067:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788573984.931107:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453360979072/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573984.931134:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573984.931138:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573984.931141:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573984.931146:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2330
00000100:00080000:0.0:1788573984.931151:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573984.931157:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573984.931164:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360979072:192.168.202.140@tcp:250:kworker.0
00000008:00100000:0.0:1788573984.931167:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573984.931187:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453360979200/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573984.931200:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573984.931204:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573984.931206:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573984.931210:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2330
00000100:00080000:0.0:1788573984.931216:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573984.931221:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:1.0:1788573984.931226:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:0.0:1788573984.931230:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573984.931247:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453360979328/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573984.931258:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573984.931264:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1788573984.931265:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573984/real 1788573984]  req@ffff8dc006712a00 x1875453360979072/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574009 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573984.931267:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573984.931279:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2330
00000100:00080000:0.0:1788573984.931287:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788573984.931294:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573984.931298:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453360979072/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574009 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1788573984.931302:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1788573984.931309:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573984.931313:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573984.931317:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360979072:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788573984.931323:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453360979456/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573984.931337:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788573984.931341:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360979200:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788573984.931344:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788573984.931349:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573984.931355:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2330
00000100:00080000:0.0:1788573984.931360:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1788573984.931364:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788573984.931369:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573984.931377:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573984.931377:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573984/real 1788573984]  req@ffff8dc006710380 x1875453360979200/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574009 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573984.931390:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453360979200/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574009 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573984.931396:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453360979584/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573984.931400:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573984.931408:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573984.931415:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360979200:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788573984.931426:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788573984.931426:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360979328:192.168.202.140@tcp:8:kworker.0
00000100:00080000:0.0:1788573984.931437:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788573984.931440:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573984.931448:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2330
00000800:00000100:1.0:1788573984.931448:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788573984.931457:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788573984.931462:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573984/real 1788573984]  req@ffff8dc006712680 x1875453360979328/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574009 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573984.931466:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573984.931477:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573984.931481:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453360979328/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574009 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573984.931495:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453360979712/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573984.931496:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573984.931504:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573984.931511:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360979328:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573984.931523:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360979456:192.168.202.140@tcp:8:kworker.0
00000100:00080000:0.0:1788573984.931524:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788573984.931531:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788573984.931534:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788573984.931540:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2330
00000800:00000100:1.0:1788573984.931541:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788573984.931549:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788573984.931555:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573984/real 1788573984]  req@ffff8dc006713480 x1875453360979456/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574009 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573984.931558:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788573984.931568:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573984.931572:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453360979456/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574009 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573984.931581:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1788573984.931586:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453360979840/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573984.931587:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573984.931594:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360979456:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573984.931605:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360979584:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788573984.931628:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573984.931638:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573984/real 1788573984]  req@ffff8dc006711c00 x1875453360979584/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574009 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573984.931651:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453360979584/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574009 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573984.931661:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573984.931664:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573984.931669:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360979584:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573984.931676:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360979712:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573984.931697:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573984.931717:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573984/real 1788573984]  req@ffff8dc006711500 x1875453360979712/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574009 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573984.931726:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453360979712/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574009 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573984.931731:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573984.931733:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573984.931735:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360979712:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573984.931745:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360979840:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573984.931758:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573984.931765:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573984/real 1788573984]  req@ffff8dc006712a00 x1875453360979840/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574009 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573984.931772:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453360979840/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574009 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573984.931777:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573984.931779:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573984.931782:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360979840:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788573985.314942:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573985.314964:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573985.314982:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788573985.315079:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573985.315099:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573985.315166:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573985.955025:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573986.339021:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573986.339021:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573986.339027:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573986.339047:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573986.339082:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573986.339170:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573986.979020:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573987.362966:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573987.362967:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573987.362975:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573987.362979:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573987.363005:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573987.363064:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573988.003082:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573988.387008:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573988.387008:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573988.387008:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573988.387009:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573988.387051:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788573988.387131:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573989.027010:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573989.410946:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573989.410967:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573989.410972:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788573989.410977:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573989.411005:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788573989.411055:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1788573990.051023:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573990.051039:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788573990.051046:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788573990.051052:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788573990.051060:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2335
00000100:00080000:2.0:1788573990.051075:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573990.051084:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788573990.051137:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453360979968/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573990.051165:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573990.051171:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573990.051172:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573990.051176:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2335
00000100:00080000:2.0:1788573990.051179:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573990.051182:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573990.051194:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573990.051212:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453360980096/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788573990.051217:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360979968:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788573990.051228:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573990.051231:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573990.051233:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573990.051237:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2335
00000100:00080000:2.0:1788573990.051239:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573990.051241:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573990.051245:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573990.051254:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453360980224/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573990.051261:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573990.051264:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573990.051266:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573990.051268:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2335
00000100:00080000:2.0:1788573990.051270:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573990.051272:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573990.051277:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573990.051286:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453360980352/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573990.051293:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573990.051296:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788573990.051297:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573990.051299:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2335
00000100:00080000:2.0:1788573990.051301:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573990.051304:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573990.051307:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1788573990.051309:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788573990.051317:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453360980480/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573990.051324:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573990.051327:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788573990.051329:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788573990.051332:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2335
00000100:00080000:2.0:1788573990.051335:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573990.051338:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573990.051341:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788573990.051348:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453360980608/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788573990.051354:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788573990.051357:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788573990.051361:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1788573990.051362:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573990/real 1788573990]  req@ffff8dc020495500 x1875453360979968/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574015 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788573990.051369:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2335
00000100:00080000:2.0:1788573990.051375:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788573990.051382:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788573990.051386:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573990.051392:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453360979968/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574015 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788573990.051396:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453360980736/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573990.051413:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573990.051418:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573990.051422:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360979968:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788573990.051448:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360980096:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788573990.051466:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573990.051476:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573990/real 1788573990]  req@ffff8dc020497100 x1875453360980096/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574015 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573990.051485:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453360980096/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574015 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573990.051493:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573990.051495:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573990.051497:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360980096:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573990.051504:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360980224:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573990.051517:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573990.051523:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573990/real 1788573990]  req@ffff8dc020494e00 x1875453360980224/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574015 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573990.051531:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453360980224/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574015 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573990.051537:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573990.051539:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573990.051541:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360980224:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573990.051545:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360980352:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573990.051567:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573990.051574:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573990/real 1788573990]  req@ffff8dc020494380 x1875453360980352/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574015 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573990.051582:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453360980352/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574015 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573990.051589:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573990.051591:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573990.051593:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360980352:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573990.051596:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360980480:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788573990.051608:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573990.051614:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573990/real 1788573990]  req@ffff8dc020494700 x1875453360980480/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574015 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573990.051622:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453360980480/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574015 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573990.051628:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573990.051630:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573990.051632:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360980480:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573990.051637:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360980608:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573990.051656:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573990.051669:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573990/real 1788573990]  req@ffff8dc020496a00 x1875453360980608/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574015 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573990.051682:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453360980608/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574015 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573990.051691:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573990.051695:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573990.051698:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360980608:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573990.051705:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360980736:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788573990.051721:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573990.051729:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573990/real 1788573990]  req@ffff8dc020494000 x1875453360980736/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574015 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573990.051737:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453360980736/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574015 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788573990.051748:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788573990.051750:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788573990.051752:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360980736:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573990.434993:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573990.434993:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573990.434993:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573990.434994:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573990.435030:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788573990.435097:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573991.074989:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573991.459001:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573991.459008:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788573991.459031:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573991.459053:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573991.459069:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788573991.459074:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573992.098982:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573992.482971:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573992.482971:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573992.482971:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573992.482988:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573992.483015:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788573992.483071:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573993.122977:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573993.506995:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573993.506997:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788573993.506997:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573993.506998:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573993.507028:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573993.507073:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573994.146992:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573994.530976:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573994.530981:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573994.531016:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573994.531019:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573994.531052:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573994.531105:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573995.170966:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788573995.170971:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573995.170977:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788573995.170980:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573995.170988:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2340
00000100:00080000:1.0:1788573995.170998:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573995.171004:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788573995.171035:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360980864/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573995.171057:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573995.171060:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573995.171061:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573995.171064:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2340
00000100:00080000:1.0:1788573995.171066:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573995.171069:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573995.171077:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573995.171087:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360980992/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788573995.171094:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360980864:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788573995.171097:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573995.171103:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573995.171105:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573995.171108:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2340
00000100:00080000:1.0:1788573995.171110:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573995.171112:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573995.171116:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788573995.171133:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360981120/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573995.171139:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573995.171141:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573995.171142:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573995.171145:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2340
00000100:00080000:1.0:1788573995.171148:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573995.171150:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573995.171153:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788573995.171157:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788573995.171164:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360981248/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573995.171172:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573995.171174:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788573995.171177:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573995.171181:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2340
00000100:00080000:1.0:1788573995.171185:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573995.171190:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788573995.171195:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573995/real 1788573995]  req@ffff8dc005dc0700 x1875453360980864/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574020 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1788573995.171197:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573995.171217:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453360980864/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574020 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573995.171225:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360981376/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788573995.171231:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573995.171238:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788573995.171242:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788573995.171246:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360980864:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788573995.171247:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788573995.171251:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788573995.171259:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2340
00000100:00080000:1.0:1788573995.171262:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573995.171265:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573995.171269:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573995.171278:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360980992:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788573995.171287:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453360981504/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788573995.171296:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788573995.171299:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788573995.171302:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1788573995.171303:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788573995.171308:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2340
00000100:00080000:1.0:1788573995.171311:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788573995.171314:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788573995.171317:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788573995.171324:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573995/real 1788573995]  req@ffff8dc005dc1180 x1875453360980992/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574020 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788573995.171328:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360981632/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788573995.171367:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360980992/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574020 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573995.171374:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573995.171377:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573995.171379:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360980992:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573995.171384:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360981120:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573995.171400:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573995.171408:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573995/real 1788573995]  req@ffff8dc005dc3b80 x1875453360981120/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574020 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573995.171415:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360981120/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574020 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573995.171421:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573995.171423:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573995.171425:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360981120:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573995.171429:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360981248:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573995.171439:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573995.171444:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573995/real 1788573995]  req@ffff8dc005dc1500 x1875453360981248/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574020 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573995.171451:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360981248/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574020 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573995.171461:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573995.171463:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573995.171465:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360981248:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573995.171468:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360981376:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788573995.171478:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573995.171483:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573995/real 1788573995]  req@ffff8dc005dc1c00 x1875453360981376/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574020 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573995.171490:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453360981376/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574020 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573995.171496:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573995.171498:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573995.171500:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360981376:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788573995.171519:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360981504:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573995.171537:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573995.171547:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573995/real 1788573995]  req@ffff8dc005dc3800 x1875453360981504/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574020 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573995.171559:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453360981504/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574020 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573995.171569:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573995.171572:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573995.171576:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360981504:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788573995.171582:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360981632:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788573995.171596:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788573995.171603:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788573995/real 1788573995]  req@ffff8dc005dc2d80 x1875453360981632/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574020 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788573995.171611:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360981632/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574020 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788573995.171616:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788573995.171618:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788573995.171620:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360981632:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788573995.555038:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573995.555038:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788573995.555038:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573995.555041:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788573995.555102:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788573995.555151:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573996.195007:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573996.578963:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573996.578963:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573996.578979:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573996.579003:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573996.579008:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573996.579014:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573997.218990:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573997.603045:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573997.603050:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788573997.603055:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788573997.603076:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573997.603092:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573997.603097:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788573998.243020:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573998.626997:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573998.626997:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788573998.626997:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788573998.627031:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788573998.627035:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788573998.627061:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788573999.266973:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788573999.651004:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788573999.651022:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788573999.651030:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788573999.651049:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788573999.651057:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788573999.651058:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574000.290981:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788574000.290988:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574000.290991:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788574000.290996:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574000.291005:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2345
00000100:00080000:0.0:1788574000.291014:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574000.291021:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574000.291055:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453360981760/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574000.291077:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574000.291080:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574000.291081:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574000.291093:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2345
00000100:00080000:0.0:1788574000.291095:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574000.291101:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574000.291108:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360981760:192.168.202.140@tcp:250:kworker.0
00000008:00100000:0.0:1788574000.291111:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574000.291123:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453360981888/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574000.291130:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574000.291133:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574000.291134:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574000.291137:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2345
00000100:00080000:0.0:1788574000.291140:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574000.291142:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574000.291146:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574000.291154:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453360982016/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574000.291161:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574000.291163:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574000.291165:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574000.291169:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2345
00000800:00000100:1.0:1788574000.291173:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788574000.291175:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574000.291180:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574000.291184:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574000.291192:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453360982144/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574000.291199:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574000.291201:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574000.291202:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574000.291205:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2345
00000100:00080000:0.0:1788574000.291207:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574000.291210:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574000.291214:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574000/real 1788574000]  req@ffff8dc006711880 x1875453360981760/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574025 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1788574000.291215:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574000.291228:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453360982272/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574000.291235:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788574000.291236:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453360981760/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574025 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574000.291241:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574000.291245:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574000.291253:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2345
00000100:00080000:1.0:1788574000.291255:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574000.291256:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574000.291263:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788574000.291264:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574000.291271:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574000.291272:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360981760:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788574000.291282:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453360982400/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574000.291288:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574000.291290:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574000.291292:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574000.291297:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2345
00000100:00100000:1.0:1788574000.291297:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360981888:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788574000.291303:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574000.291306:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574000.291310:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574000.291321:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453360982528/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788574000.291326:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574000.291342:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574000/real 1788574000]  req@ffff8dc006713800 x1875453360981888/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574025 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574000.291357:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453360981888/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574025 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574000.291365:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574000.291367:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574000.291369:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360981888:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574000.291373:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360982016:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574000.291385:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574000.291391:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574000/real 1788574000]  req@ffff8dc006713b80 x1875453360982016/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574025 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574000.291399:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453360982016/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574025 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574000.291404:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574000.291406:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574000.291409:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360982016:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574000.291412:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360982144:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574000.291432:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574000.291439:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574000/real 1788574000]  req@ffff8dc006710e00 x1875453360982144/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574025 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574000.291446:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453360982144/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574025 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574000.291457:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574000.291459:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574000.291461:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360982144:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574000.291464:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360982272:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574000.291475:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574000.291481:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574000/real 1788574000]  req@ffff8dc006712300 x1875453360982272/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574025 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574000.291488:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453360982272/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574025 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574000.291494:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574000.291496:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574000.291498:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360982272:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574000.291501:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360982400:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574000.291512:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574000.291518:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574000/real 1788574000]  req@ffff8dc006713100 x1875453360982400/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574025 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574000.291525:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453360982400/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574025 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574000.291530:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574000.291532:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574000.291534:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360982400:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574000.291551:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360982528:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574000.291572:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574000.291583:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574000/real 1788574000]  req@ffff8dc006711880 x1875453360982528/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574025 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574000.291597:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453360982528/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574025 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574000.291604:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574000.291606:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574000.291608:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360982528:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574000.674965:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574000.674965:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574000.674980:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574000.675079:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574000.675090:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788574000.675133:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574001.314979:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574001.698989:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574001.698989:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574001.698995:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574001.699097:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574001.699127:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574001.699152:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574002.338989:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574002.722977:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574002.722977:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574002.722977:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574002.722978:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574002.723014:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788574002.723082:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574003.363001:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574003.746994:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574003.746995:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574003.747029:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574003.747048:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574003.747085:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574003.747142:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574004.386961:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574004.770976:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574004.770976:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574004.770976:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574004.770980:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574004.771007:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788574004.771051:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574005.410983:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788574005.410986:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574005.410993:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788574005.410997:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574005.411005:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2351
00000100:00080000:2.0:1788574005.411014:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574005.411020:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574005.411053:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453360982656/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574005.411072:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574005.411075:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574005.411076:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574005.411079:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2351
00000100:00080000:2.0:1788574005.411081:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574005.411084:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574005.411091:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574005.411100:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453360982784/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574005.411104:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360982656:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788574005.411116:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574005.411119:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574005.411120:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574005.411124:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2351
00000100:00080000:2.0:1788574005.411126:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574005.411130:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574005.411133:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574005.411143:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453360982912/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574005.411149:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574005.411152:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574005.411153:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574005.411156:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2351
00000100:00080000:2.0:1788574005.411158:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574005.411160:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574005.411163:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1788574005.411165:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574005.411173:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453360983040/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574005.411179:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574005.411182:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574005.411183:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574005.411186:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2351
00000100:00080000:2.0:1788574005.411188:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574005.411191:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574005.411194:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574005.411204:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574005/real 1788574005]  req@ffff8dc020497480 x1875453360982656/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574030 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574005.411206:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453360983168/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574005.411230:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788574005.411234:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453360982656/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574030 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574005.411237:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574005.411243:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574005.411248:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574005.411251:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2351
00000100:00080000:1.0:1788574005.411254:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788574005.411259:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788574005.411260:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360982656:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788574005.411269:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574005.411275:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574005.411290:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360982784:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574005.411291:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453360983296/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574005.411309:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574005.411312:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574005.411315:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574005.411320:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2351
00000100:00080000:2.0:1788574005.411324:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1788574005.411328:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788574005.411331:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574005.411339:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574005.411348:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574005/real 1788574005]  req@ffff8dc020495180 x1875453360982784/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574030 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574005.411353:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453360983424/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574005.411367:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453360982784/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574030 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574005.411378:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574005.411380:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574005.411383:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360982784:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574005.411388:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360982912:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574005.411404:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574005.411411:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574005/real 1788574005]  req@ffff8dc020495880 x1875453360982912/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574030 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574005.411419:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453360982912/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574030 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574005.411429:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574005.411431:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574005.411433:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360982912:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574005.411437:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360983040:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574005.411447:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574005.411452:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574005/real 1788574005]  req@ffff8dc020496d80 x1875453360983040/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574030 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574005.411459:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453360983040/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574030 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574005.411464:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574005.411466:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574005.411468:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360983040:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574005.411472:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360983168:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574005.411482:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574005.411487:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574005/real 1788574005]  req@ffff8dc020494a80 x1875453360983168/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574030 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574005.411494:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453360983168/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574030 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574005.411499:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574005.411501:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574005.411503:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360983168:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574005.411516:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360983296:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574005.411527:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574005.411533:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574005/real 1788574005]  req@ffff8dc020497480 x1875453360983296/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574030 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574005.411540:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453360983296/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574030 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574005.411545:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574005.411546:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574005.411548:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360983296:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574005.411561:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360983424:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574005.411579:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574005.411591:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574005/real 1788574005]  req@ffff8dc020494000 x1875453360983424/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574030 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574005.411603:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453360983424/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574030 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574005.411611:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574005.411615:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574005.411618:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360983424:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574005.794997:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574005.795009:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574005.795015:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574005.795029:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574005.795043:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574005.795062:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574006.434954:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574006.818963:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574006.818964:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574006.818974:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574006.818974:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574006.819002:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788574006.819059:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574007.459005:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574007.842960:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574007.842964:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574007.842969:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574007.842985:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574007.842998:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574007.843031:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574008.482989:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574008.866939:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574008.866947:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574008.866970:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574008.866971:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574008.867002:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788574008.867054:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574009.507009:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574009.890934:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574009.890983:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574009.890994:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574009.891011:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574009.891033:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574009.891075:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1788574010.530942:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788574010.530953:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788574010.530953:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788574010.530972:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574010.531019:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2356
00000100:00080000:2.0:1788574010.531030:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574010.531037:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574010.531068:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453360983552/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574010.531090:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574010.531093:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574010.531095:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574010.531098:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2356
00000100:00080000:2.0:1788574010.531101:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574010.531105:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574010.531113:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574010.531121:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360983552:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788574010.531125:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453360983680/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574010.531134:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574010.531136:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574010.531138:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574010.531140:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2356
00000100:00080000:2.0:1788574010.531143:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574010.531145:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574010.531149:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574010.531157:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453360983808/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574010.531165:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574010.531167:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574010.531169:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574010.531171:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2356
00000100:00080000:2.0:1788574010.531174:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1788574010.531177:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788574010.531182:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574010.531189:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574010.531202:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453360983936/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574010.531212:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788574010.531214:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574010/real 1788574010]  req@ffff8dc020496a00 x1875453360983552/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574035 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574010.531221:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574010.531226:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574010.531233:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2356
00000100:00080000:2.0:1788574010.531237:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788574010.531238:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453360983552/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574035 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574010.531245:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574010.531253:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1788574010.531256:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574010.531261:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574010.531267:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453360984064/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574010.531268:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360983552:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788574010.531276:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574010.531283:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574010.531286:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574010.531291:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2356
00000100:00080000:2.0:1788574010.531294:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574010.531296:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574010.531299:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574010.531304:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360983680:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574010.531309:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453360984192/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574010.531318:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574010.531320:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574010.531322:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574010.531328:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2356
00000800:00000100:1.0:1788574010.531329:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788574010.531331:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574010.531336:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574010.531339:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574010.531344:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574010/real 1788574010]  req@ffff8dc020494700 x1875453360983680/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574035 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574010.531350:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453360984320/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574010.531359:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453360983680/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574035 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574010.531373:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574010.531376:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574010.531379:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360983680:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574010.531384:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360983808:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574010.531396:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574010.531402:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574010/real 1788574010]  req@ffff8dc020494380 x1875453360983808/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574035 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574010.531410:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453360983808/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574035 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574010.531416:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574010.531418:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574010.531420:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360983808:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574010.531424:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360983936:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574010.531433:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574010.531439:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574010/real 1788574010]  req@ffff8dc020494e00 x1875453360983936/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574035 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574010.531445:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453360983936/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574035 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574010.531451:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574010.531453:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574010.531456:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360983936:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574010.531459:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360984064:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574010.531469:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574010.531474:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574010/real 1788574010]  req@ffff8dc020497100 x1875453360984064/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574035 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574010.531481:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453360984064/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574035 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574010.531486:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574010.531488:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574010.531490:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360984064:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574010.531500:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360984192:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574010.531510:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574010.531516:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574010/real 1788574010]  req@ffff8dc020495500 x1875453360984192/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574035 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574010.531523:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453360984192/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574035 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574010.531529:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574010.531530:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574010.531532:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360984192:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574010.531536:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360984320:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574010.531551:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574010.531562:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574010/real 1788574010]  req@ffff8dc020496a00 x1875453360984320/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574035 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574010.531574:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453360984320/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574035 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574010.531583:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574010.531586:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574010.531590:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360984320:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574010.914943:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574010.914944:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574010.914981:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574010.914998:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574010.915107:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788574010.915190:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574011.554948:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574011.938957:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574011.938959:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574011.938979:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574011.938981:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574011.939018:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574011.939039:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574012.578988:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574012.962991:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574012.962991:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574012.962991:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574012.963002:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574012.963020:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574012.963094:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574013.603046:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574013.987010:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574013.987014:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574013.987031:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574013.987067:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574013.987077:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574013.987162:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574014.626948:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574015.010996:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574015.010996:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574015.010996:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574015.010997:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574015.011032:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574015.011083:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1788574015.651005:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788574015.651014:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788574015.651014:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788574015.651021:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574015.651033:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2361
00000100:00080000:3.0:1788574015.651043:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574015.651052:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788574015.651086:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d880 x1875453360984448/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574015.651110:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574015.651114:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574015.651116:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574015.651119:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2361
00000100:00080000:3.0:1788574015.651123:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574015.651127:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574015.651137:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574015.651153:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360984448:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788574015.651155:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ed80 x1875453360984576/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574015.651172:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574015.651178:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574015.651180:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574015.651185:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2361
00000100:00080000:3.0:1788574015.651189:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574015.651193:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574015.651198:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574015.651210:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644df80 x1875453360984704/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1788574015.651214:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788574015.651224:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574015.651228:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574015.651230:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574015.651235:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2361
00000100:00080000:3.0:1788574015.651239:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574015.651241:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574015.651245:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574015.651256:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574015/real 1788574015]  req@ffff8dc00644d880 x1875453360984448/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574040 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574015.651271:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d880 x1875453360984448/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574040 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574015.651280:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574015.651283:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574015.651286:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360984448:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788574015.651306:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360984576:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574015.651323:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574015.651331:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f100 x1875453360984832/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574015.651336:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574015/real 1788574015]  req@ffff8dc00644ed80 x1875453360984576/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574040 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574015.651365:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ed80 x1875453360984576/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574040 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574015.651365:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574015.651373:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574015.651380:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574015.651384:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574015.651388:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788574015.651392:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2361
00000100:00080000:3.0:1788574015.651399:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788574015.651400:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360984576:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788574015.651405:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574015.651413:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574015.651416:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360984704:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574015.651426:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d880 x1875453360984960/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574015.651435:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574015.651437:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574015.651440:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574015.651443:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2361
00000800:00000100:0.0:1788574015.651448:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788574015.651449:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574015.651454:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574015.651458:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574015.651464:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574015/real 1788574015]  req@ffff8dc00644df80 x1875453360984704/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574040 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574015.651471:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644fb80 x1875453360985088/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574015.651478:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644df80 x1875453360984704/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574040 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574015.651499:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574015.651499:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574015.651504:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574015.651506:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360984704:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574015.651527:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360984832:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574015.651543:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574015.651550:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574015/real 1788574015]  req@ffff8dc00644f100 x1875453360984832/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574040 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574015.651558:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f100 x1875453360984832/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574040 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574015.651564:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574015.651567:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574015.651570:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360984832:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574015.651573:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360984960:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574015.651587:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574015.651595:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574015/real 1788574015]  req@ffff8dc00644d880 x1875453360984960/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574040 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574015.651604:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d880 x1875453360984960/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574040 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574015.651615:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574015.651617:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574015.651621:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788574015.651621:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788574015.651629:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360984960:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788574015.651634:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2361
00000100:00100000:0.0:1788574015.651653:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360985088:192.168.202.140@tcp:8:kworker.0
00000100:00080000:3.0:1788574015.651677:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1788574015.651683:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788574015.651686:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574015.651694:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574015.651706:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574015/real 1788574015]  req@ffff8dc00644fb80 x1875453360985088/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574040 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574015.651711:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e300 x1875453360985216/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574015.651728:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644fb80 x1875453360985088/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574040 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574015.651737:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574015.651739:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574015.651742:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360985088:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574015.651756:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360985216:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574015.651771:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574015.651777:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574015/real 1788574015]  req@ffff8dc00644e300 x1875453360985216/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574040 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574015.651784:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453360985216/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574040 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574015.651790:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574015.651792:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574015.651794:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360985216:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574016.034936:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574016.034936:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574016.034960:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574016.034963:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574016.035009:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574016.035036:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574016.674941:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574017.058975:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574017.058975:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574017.058975:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574017.059019:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574017.059027:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788574017.059089:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574017.699016:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574018.082968:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574018.082970:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574018.082972:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574018.082974:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574018.083028:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574018.083069:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574018.722935:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574019.106988:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574019.106988:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574019.106988:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574019.107116:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574019.107129:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788574019.107171:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574019.746988:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574020.130971:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574020.130971:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574020.130972:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574020.130975:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574020.131034:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574020.131075:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1788574020.770956:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788574020.770959:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788574020.770968:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788574020.770972:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574020.770980:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2366
00000100:00080000:3.0:1788574020.770989:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574020.771007:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788574020.771045:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c380 x1875453360985344/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574020.771065:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574020.771068:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574020.771070:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574020.771074:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2366
00000100:00080000:3.0:1788574020.771078:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574020.771084:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574020.771094:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574020.771108:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360985344:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788574020.771110:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c700 x1875453360985472/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574020.771124:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574020.771127:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574020.771129:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574020.771132:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2366
00000100:00080000:3.0:1788574020.771135:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574020.771138:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574020.771143:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574020.771153:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e680 x1875453360985600/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574020.771160:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574020.771163:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574020.771164:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574020.771166:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2366
00000100:00080000:3.0:1788574020.771168:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574020.771170:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574020.771173:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574020.771181:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d180 x1875453360985728/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574020.771187:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574020.771190:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574020.771191:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574020.771193:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2366
00000100:00080000:3.0:1788574020.771195:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574020.771198:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574020.771201:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574020.771210:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f480 x1875453360985856/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574020.771217:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574020.771219:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574020.771221:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788574020.771224:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360985472:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788574020.771227:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2366
00000100:00080000:3.0:1788574020.771232:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574020.771235:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574020.771239:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574020.771248:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d500 x1875453360985984/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574020.771258:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574020.771262:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574020.771264:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788574020.771269:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360985600:192.168.202.140@tcp:8:kworker.0
00000100:00080000:3.0:1788574020.771272:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2366
00000100:00080000:3.0:1788574020.771280:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574020.771284:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574020.771290:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574020.771305:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360985728:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574020.771307:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ea00 x1875453360986112/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574020.771341:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360985856:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574020.771388:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360985984:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574020.771410:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360986112:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574021.154980:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574021.154987:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574021.155030:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574021.155123:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574021.155143:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574021.155156:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574021.794974:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574022.178960:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574022.179018:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574022.179023:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574022.179035:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574022.179060:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574022.179074:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574022.818964:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574023.202942:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574023.202946:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574023.202959:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574023.202967:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574023.202987:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574023.203053:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574023.842963:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000400:00000100:1.0:1788574023.843204:0:2336:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.140:988
00000400:00000100:1.0:1788574023.843251:0:2336:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.140@tcp at host 192.168.202.140 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:1.0:1788574023.843273:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788574023.843325:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788574023.843337:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788574023.843347:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788574023.843359:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788574023.843370:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788574023.843382:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:0.0:1788574023.843390:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574020/real 1788574023]  req@ffff8dc00644c700 x1875453360985472/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574045 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574023.843423:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453360985472/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574045 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574023.843440:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574023.843446:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574023.843450:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360985472:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574023.843460:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574020/real 1788574023]  req@ffff8dc00644e680 x1875453360985600/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574045 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574023.843475:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453360985600/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574045 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574023.843484:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574023.843488:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574023.843491:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360985600:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574023.843498:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574020/real 1788574023]  req@ffff8dc00644d180 x1875453360985728/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574045 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574023.843529:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453360985728/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574045 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574023.843540:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574023.843544:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574023.843548:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360985728:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574023.843558:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574020/real 1788574023]  req@ffff8dc00644f480 x1875453360985856/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574045 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574023.843572:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453360985856/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574045 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574023.843581:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574023.843585:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574023.843588:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360985856:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574023.843596:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574020/real 1788574023]  req@ffff8dc00644c380 x1875453360985344/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574045 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574023.843609:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453360985344/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574045 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574023.843617:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574023.843620:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574023.843623:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360985344:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788574023.843658:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574020/real 1788574023]  req@ffff8dc00644d500 x1875453360985984/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574045 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574023.843670:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d500 x1875453360985984/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574045 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574023.843678:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574023.843682:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574023.843686:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360985984:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574023.843694:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574020/real 1788574023]  req@ffff8dc00644ea00 x1875453360986112/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574045 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574023.843707:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ea00 x1875453360986112/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574045 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574023.843715:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574023.843718:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574023.843721:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360986112:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574024.226991:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574024.226991:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574024.227003:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574024.227042:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574024.227054:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574024.227132:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574024.866921:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574025.250914:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574025.250930:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574025.250954:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574025.251029:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574025.251030:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574025.251061:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574025.890916:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788574025.890923:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574025.890929:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788574025.890933:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574025.890942:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2371
00000100:00080000:3.0:1788574025.890952:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574025.890958:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788574025.890986:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ce00 x1875453360986240/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574025.891004:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574025.891007:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574025.891008:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574025.891012:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2371
00000100:00080000:3.0:1788574025.891029:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574025.891036:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574025.891046:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360986240:192.168.202.140@tcp:250:kworker.0
00000008:00100000:3.0:1788574025.891047:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574025.891067:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c000 x1875453360986368/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574025.891079:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574025.891082:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574025.891084:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574025.891089:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2371
00000100:00080000:3.0:1788574025.891094:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574025.891099:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574025.891105:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788574025.891121:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574025.891122:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f800 x1875453360986496/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574025.891136:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574025.891140:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574025.891142:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574025.891147:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2371
00000100:00080000:3.0:1788574025.891151:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574025.891156:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574025.891162:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574025.891165:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574025/real 1788574025]  req@ffff8dc00644ce00 x1875453360986240/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574050 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574025.891178:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ca80 x1875453360986624/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574025.891190:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ce00 x1875453360986240/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574050 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574025.891191:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574025.891202:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574025.891204:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574025.891209:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2371
00000100:00080000:3.0:1788574025.891212:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574025.891218:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574025.891229:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1788574025.891233:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574025.891243:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574025.891247:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644dc00 x1875453360986752/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574025.891252:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360986240:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788574025.891275:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574025.891279:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574025.891282:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788574025.891285:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360986368:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788574025.891290:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2371
00000100:00080000:3.0:1788574025.891295:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574025.891302:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574025.891308:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788574025.891324:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574025.891334:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ce00 x1875453360986880/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574025.891343:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574025/real 1788574025]  req@ffff8dc00644c000 x1875453360986368/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574050 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574025.891360:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574025.891367:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:0.0:1788574025.891368:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c000 x1875453360986368/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574050 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574025.891370:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574025.891381:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2371
00000100:00080000:0.0:1788574025.891389:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574025.891389:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574025.891398:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788574025.891400:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574025.891408:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360986368:192.168.202.140@tcp:38:kworker.0
00000008:00100000:3.0:1788574025.891409:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574025.891425:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ea00 x1875453360987008/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574025.891428:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360986496:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574025.891465:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574025.891480:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574025/real 1788574025]  req@ffff8dc00644f800 x1875453360986496/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574050 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574025.891493:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f800 x1875453360986496/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574050 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574025.891503:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574025.891506:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574025.891510:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360986496:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574025.891517:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360986624:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574025.891540:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574025.891552:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574025/real 1788574025]  req@ffff8dc00644ca80 x1875453360986624/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574050 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574025.891566:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ca80 x1875453360986624/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574050 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574025.891576:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574025.891580:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574025.891583:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360986624:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574025.891590:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360986752:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574025.891610:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574025.891621:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574025/real 1788574025]  req@ffff8dc00644dc00 x1875453360986752/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574050 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574025.891633:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644dc00 x1875453360986752/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574050 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574025.891643:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574025.891646:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574025.891657:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360986752:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574025.891676:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360986880:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574025.891704:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574025.891717:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574025/real 1788574025]  req@ffff8dc00644ce00 x1875453360986880/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574050 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574025.891729:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ce00 x1875453360986880/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574050 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574025.891737:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574025.891740:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574025.891744:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360986880:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574025.891751:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360987008:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574025.891779:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574025.891790:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574025/real 1788574025]  req@ffff8dc00644ea00 x1875453360987008/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574050 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574025.891803:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ea00 x1875453360987008/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574050 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574025.891811:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574025.891814:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574025.891818:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360987008:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574026.274939:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574026.274947:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574026.274963:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574026.274977:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574026.275084:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574026.275129:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574026.915010:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574027.299042:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574027.299044:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574027.299044:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574027.299050:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574027.299090:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574027.299146:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574027.938958:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574028.322973:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574028.322981:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574028.322999:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574028.323000:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574028.323054:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574028.323094:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574028.963068:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574029.346999:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574029.347018:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574029.347018:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574029.347084:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574029.347089:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574029.347094:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574029.986994:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574030.370982:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574030.370987:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574030.370998:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574030.371000:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574030.371016:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574030.371051:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574031.010964:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788574031.010995:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574031.011002:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788574031.011007:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574031.011017:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2376
00000100:00080000:3.0:1788574031.011027:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574031.011065:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788574031.011105:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d500 x1875453360987136/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574031.011134:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574031.011139:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574031.011141:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574031.011145:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2376
00000100:00080000:3.0:1788574031.011149:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574031.011153:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574031.011164:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574031.011178:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c380 x1875453360987264/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574031.011190:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574031.011194:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574031.011196:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788574031.011202:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360987136:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788574031.011205:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2376
00000100:00080000:3.0:1788574031.011214:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574031.011219:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574031.011225:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574031.011239:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f480 x1875453360987392/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574031.011251:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574031.011254:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574031.011256:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574031.011261:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2376
00000100:00080000:3.0:1788574031.011265:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574031.011268:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574031.011273:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788574031.011274:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574031.011291:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d180 x1875453360987520/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574031.011302:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574031.011306:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574031.011308:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574031.011313:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2376
00000100:00080000:3.0:1788574031.011318:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788574031.011323:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574031/real 1788574031]  req@ffff8dc00644d500 x1875453360987136/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574056 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574031.011328:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574031.011338:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574031.011349:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d500 x1875453360987136/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574056 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574031.011356:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e680 x1875453360987648/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574031.011362:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574031.011369:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574031.011378:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360987136:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788574031.011379:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574031.011386:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574031.011387:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788574031.011389:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360987264:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788574031.011394:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2376
00000100:00080000:3.0:1788574031.011398:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574031.011400:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574031.011405:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788574031.011414:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574031.011418:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c700 x1875453360987776/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574031.011426:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788574031.011429:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574031/real 1788574031]  req@ffff8dc00644c380 x1875453360987264/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574056 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574031.011431:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574031.011434:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574031.011442:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2376
00000100:00080000:3.0:1788574031.011447:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788574031.011450:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453360987264/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574056 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574031.011453:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574031.011460:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1788574031.011464:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1788574031.011469:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e300 x1875453360987904/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574031.011470:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574031.011477:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360987264:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574031.011504:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360987392:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574031.011518:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574031.011525:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574031/real 1788574031]  req@ffff8dc00644f480 x1875453360987392/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574056 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574031.011532:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453360987392/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574056 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574031.011538:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574031.011541:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574031.011543:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360987392:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574031.011546:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360987520:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574031.011556:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574031.011562:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574031/real 1788574031]  req@ffff8dc00644d180 x1875453360987520/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574056 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574031.011569:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453360987520/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574056 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574031.011574:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574031.011576:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574031.011578:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360987520:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574031.011582:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360987648:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574031.011591:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574031.011597:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574031/real 1788574031]  req@ffff8dc00644e680 x1875453360987648/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574056 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574031.011604:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453360987648/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574056 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574031.011610:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574031.011611:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574031.011613:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360987648:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574031.011617:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360987776:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574031.011627:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574031.011632:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574031/real 1788574031]  req@ffff8dc00644c700 x1875453360987776/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574056 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574031.011639:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453360987776/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574056 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574031.011645:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574031.011647:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574031.011649:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360987776:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574031.011652:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360987904:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574031.011661:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574031.011667:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574031/real 1788574031]  req@ffff8dc00644e300 x1875453360987904/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574056 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574031.011673:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453360987904/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574056 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574031.011678:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574031.011680:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574031.011682:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360987904:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574031.394947:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574031.394948:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574031.394972:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574031.394979:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574031.394996:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574031.394997:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574032.034960:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574032.418948:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574032.418953:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574032.418966:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574032.418980:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574032.418993:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574032.418997:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574033.059014:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574033.442973:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574033.442973:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574033.442974:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574033.443021:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574033.443052:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574033.443079:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574034.082938:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574034.467055:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574034.467055:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574034.467056:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574034.467056:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574034.467129:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574034.467165:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574035.107003:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574035.490978:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574035.490983:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574035.490993:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574035.491004:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574035.491018:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574035.491021:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574036.130944:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788574036.130996:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574036.131007:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788574036.131013:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574036.131028:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2381
00000100:00080000:3.0:1788574036.131040:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574036.131061:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788574036.131115:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644fb80 x1875453360988032/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574036.131151:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574036.131155:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574036.131158:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574036.131163:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2381
00000100:00080000:3.0:1788574036.131169:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574036.131173:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574036.131194:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574036.131210:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d880 x1875453360988160/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574036.131217:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360988032:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788574036.131221:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574036.131225:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574036.131227:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574036.131231:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2381
00000100:00080000:3.0:1788574036.131235:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574036.131238:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574036.131244:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574036.131256:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f100 x1875453360988288/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574036.131265:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574036.131268:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574036.131270:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574036.131273:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2381
00000100:00080000:3.0:1788574036.131275:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574036.131279:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574036.131284:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788574036.131294:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574036.131294:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644df80 x1875453360988416/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574036.131302:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574036.131305:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574036.131307:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574036.131311:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2381
00000100:00080000:3.0:1788574036.131315:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574036.131319:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574036.131323:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574036.131333:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ed80 x1875453360988544/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574036.131341:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788574036.131345:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574036/real 1788574036]  req@ffff8dc00644fb80 x1875453360988032/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574061 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574036.131345:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574036.131347:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574036.131352:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2381
00000100:00080000:3.0:1788574036.131356:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574036.131359:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574036.131364:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574036.131373:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644fb80 x1875453360988032/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574061 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574036.131374:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e300 x1875453360988672/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574036.131385:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574036.131386:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574036.131389:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574036.131391:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788574036.131391:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574036.131395:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2381
00000100:00100000:0.0:1788574036.131396:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360988032:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788574036.131398:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574036.131402:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574036.131406:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574036.131415:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c700 x1875453360988800/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574036.131424:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360988160:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574036.131457:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574036.131472:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574036/real 1788574036]  req@ffff8dc00644d880 x1875453360988160/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574061 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574036.131487:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d880 x1875453360988160/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574061 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574036.131497:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574036.131499:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574036.131502:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360988160:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574036.131507:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360988288:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574036.131525:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574036.131532:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574036/real 1788574036]  req@ffff8dc00644f100 x1875453360988288/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574061 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574036.131541:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f100 x1875453360988288/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574061 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574036.131552:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574036.131554:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574036.131556:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360988288:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574036.131560:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360988416:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574036.131571:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574036.131576:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574036/real 1788574036]  req@ffff8dc00644df80 x1875453360988416/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574061 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574036.131584:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644df80 x1875453360988416/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574061 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574036.131590:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574036.131592:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574036.131594:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360988416:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574036.131597:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360988544:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574036.131615:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574036.131623:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574036/real 1788574036]  req@ffff8dc00644ed80 x1875453360988544/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574061 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574036.131630:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ed80 x1875453360988544/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574061 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574036.131637:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574036.131639:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574036.131642:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360988544:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574036.131646:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360988672:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574036.131658:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574036.131664:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574036/real 1788574036]  req@ffff8dc00644e300 x1875453360988672/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574061 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574036.131671:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453360988672/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574061 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574036.131676:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574036.131678:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574036.131680:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360988672:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574036.131698:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360988800:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574036.131710:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574036.131717:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574036/real 1788574036]  req@ffff8dc00644c700 x1875453360988800/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574061 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574036.131724:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453360988800/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574061 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574036.131729:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574036.131731:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574036.131734:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360988800:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574036.515014:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574036.515014:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574036.515014:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574036.515071:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574036.515086:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788574036.515088:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574037.155003:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574037.538930:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574037.538953:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574037.538959:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574037.538970:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574037.538975:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574037.538988:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574038.178950:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574038.563046:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574038.563046:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574038.563049:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574038.563110:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574038.563125:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574038.563139:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574039.202994:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574039.587021:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574039.587022:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574039.587085:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574039.587101:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574039.587106:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574039.587106:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574040.226959:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574040.611007:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574040.611007:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574040.611009:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574040.611013:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574040.611073:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574040.611078:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574041.250960:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574041.250982:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574041.250987:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788574041.250992:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574041.251001:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2386
00000100:00080000:0.0:1788574041.251011:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574041.251018:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574041.251062:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453360988928/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574041.251089:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574041.251093:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574041.251095:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574041.251100:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2386
00000100:00080000:0.0:1788574041.251104:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574041.251109:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574041.251119:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574041.251122:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360988928:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788574041.251132:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453360989056/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574041.251142:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574041.251145:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574041.251147:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574041.251150:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2386
00000100:00080000:0.0:1788574041.251154:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574041.251158:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574041.251163:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574041.251173:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453360989184/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574041.251181:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1788574041.251182:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788574041.251185:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574041.251186:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574041.251189:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2386
00000100:00080000:0.0:1788574041.251192:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574041.251195:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574041.251199:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574041.251209:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453360989312/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574041.251218:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788574041.251220:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574041/real 1788574041]  req@ffff8dc006712a00 x1875453360988928/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574066 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574041.251222:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574041.251223:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574041.251227:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2386
00000100:00080000:0.0:1788574041.251231:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574041.251234:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574041.251238:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574041.251238:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453360988928/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574066 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574041.251247:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453360989440/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574041.251249:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574041.251253:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574041.251258:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360988928:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788574041.251263:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574041.251266:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574041.251268:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574041.251271:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2386
00000100:00080000:0.0:1788574041.251274:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574041.251278:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574041.251279:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360989056:192.168.202.140@tcp:38:kworker.0
00000008:00100000:0.0:1788574041.251283:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574041.251293:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453360989568/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788574041.251300:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788574041.251302:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574041.251306:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574041.251308:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574041.251312:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2386
00000100:00100000:1.0:1788574041.251313:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574041/real 1788574041]  req@ffff8dc006711500 x1875453360989056/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574066 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574041.251315:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574041.251319:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574041.251324:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574041.251326:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453360989056/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574066 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574041.251334:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453360989696/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574041.251336:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574041.251340:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574041.251343:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360989056:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574041.251350:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360989184:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574041.251371:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574041.251384:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574041/real 1788574041]  req@ffff8dc006711c00 x1875453360989184/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574066 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574041.251393:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453360989184/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574066 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574041.251399:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574041.251401:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574041.251403:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360989184:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574041.251407:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360989312:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574041.251422:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574041.251428:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574041/real 1788574041]  req@ffff8dc006713480 x1875453360989312/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574066 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574041.251440:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453360989312/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574066 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574041.251445:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574041.251447:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574041.251449:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360989312:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574041.251452:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360989440:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574041.251463:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574041.251469:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574041/real 1788574041]  req@ffff8dc006712680 x1875453360989440/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574066 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574041.251477:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453360989440/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574066 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574041.251482:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574041.251484:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574041.251486:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360989440:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574041.251497:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360989568:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574041.251513:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574041.251524:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574041/real 1788574041]  req@ffff8dc006710380 x1875453360989568/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574066 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574041.251537:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453360989568/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574066 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574041.251552:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574041.251555:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574041.251559:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360989568:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574041.251563:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360989696:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574041.251578:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574041.251586:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574041/real 1788574041]  req@ffff8dc006712a00 x1875453360989696/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574066 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574041.251594:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453360989696/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574066 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574041.251599:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574041.251601:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574041.251603:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360989696:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574041.634983:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574041.634984:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574041.635012:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574041.635052:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574041.635056:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574041.635083:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574042.274934:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574042.658985:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574042.658986:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574042.658986:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574042.658986:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574042.659041:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574042.659070:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574043.298996:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574043.682991:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574043.683007:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574043.683038:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574043.683038:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574043.683038:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574043.683063:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574044.322995:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574044.706973:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574044.706973:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574044.706973:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574044.706986:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574044.707022:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574044.707063:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574045.346940:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574045.730939:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574045.730945:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574045.730980:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574045.730992:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574045.731015:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574045.731073:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574046.370984:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788574046.371009:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574046.371016:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788574046.371021:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574046.371031:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2392
00000100:00080000:3.0:1788574046.371041:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574046.371050:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788574046.371093:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e680 x1875453360989824/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574046.371122:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574046.371127:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574046.371130:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574046.371136:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2392
00000100:00080000:3.0:1788574046.371141:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574046.371148:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574046.371159:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574046.371167:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360989824:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788574046.371177:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d180 x1875453360989952/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574046.371191:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574046.371194:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574046.371196:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574046.371199:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2392
00000100:00080000:3.0:1788574046.371203:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574046.371208:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574046.371215:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574046.371230:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f480 x1875453360990080/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1788574046.371239:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788574046.371248:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574046.371252:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574046.371255:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574046.371260:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2392
00000100:00080000:3.0:1788574046.371273:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574046.371277:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574046.371283:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574046.371285:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574046/real 1788574046]  req@ffff8dc00644e680 x1875453360989824/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574071 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574046.371296:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c380 x1875453360990208/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574046.371309:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788574046.371312:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453360989824/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574071 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574046.371314:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574046.371318:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574046.371328:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2392
00000100:00080000:0.0:1788574046.371333:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574046.371334:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574046.371344:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788574046.371345:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574046.371354:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360989824:192.168.202.140@tcp:250:kworker.0
00000008:00100000:3.0:1788574046.371355:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574046.371370:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d500 x1875453360990336/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574046.371378:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574046.371381:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574046.371383:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788574046.371387:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360989952:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788574046.371389:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2392
00000100:00080000:3.0:1788574046.371395:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574046.371400:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574046.371404:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574046.371413:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ea00 x1875453360990464/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574046.371420:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574046.371425:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000800:00000100:0.0:1788574046.371426:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788574046.371427:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574046.371434:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2392
00000100:00080000:3.0:1788574046.371438:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574046.371441:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574046.371444:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574046.371451:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574046/real 1788574046]  req@ffff8dc00644d180 x1875453360989952/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574071 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574046.371454:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ce00 x1875453360990592/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574046.371494:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453360989952/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574071 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574046.371509:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574046.371513:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574046.371518:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360989952:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574046.371525:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360990080:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574046.371548:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574046.371562:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574046/real 1788574046]  req@ffff8dc00644f480 x1875453360990080/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574071 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574046.371583:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453360990080/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574071 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574046.371592:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574046.371595:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574046.371599:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360990080:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574046.371606:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360990208:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574046.371627:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574046.371638:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574046/real 1788574046]  req@ffff8dc00644c380 x1875453360990208/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574071 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574046.371650:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453360990208/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574071 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574046.371659:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574046.371662:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574046.371666:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360990208:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574046.371672:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360990336:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574046.371693:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574046.371705:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574046/real 1788574046]  req@ffff8dc00644d500 x1875453360990336/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574071 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574046.371717:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d500 x1875453360990336/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574071 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574046.371733:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574046.371736:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574046.371740:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360990336:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574046.371758:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360990464:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574046.371780:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574046.371793:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574046/real 1788574046]  req@ffff8dc00644ea00 x1875453360990464/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574071 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574046.371805:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ea00 x1875453360990464/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574071 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574046.371813:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574046.371817:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574046.371820:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360990464:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574046.371839:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360990592:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574046.371861:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574046.371898:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574046/real 1788574046]  req@ffff8dc00644ce00 x1875453360990592/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574071 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574046.371913:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ce00 x1875453360990592/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574071 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574046.371922:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574046.371925:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574046.371929:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360990592:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574046.754985:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574046.754985:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574046.754985:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574046.754985:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574046.755042:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574046.755076:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574047.394965:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574047.778952:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574047.778966:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574047.779001:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574047.779042:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574047.779097:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574047.779119:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574048.418959:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574048.802988:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574048.802988:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574048.802988:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574048.802992:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574048.803015:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574048.803060:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574049.442956:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574049.826986:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574049.826986:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574049.827007:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574049.827024:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574049.827033:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574049.827036:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574050.466980:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574050.850983:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574050.850983:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574050.850984:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574050.851000:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574050.851018:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574050.851019:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574051.490949:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788574051.490967:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574051.490973:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788574051.490977:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574051.490985:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2397
00000100:00080000:3.0:1788574051.490996:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574051.491005:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788574051.491043:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644dc00 x1875453360990720/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574051.491083:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574051.491088:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574051.491090:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574051.491096:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2397
00000100:00080000:3.0:1788574051.491102:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574051.491107:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574051.491118:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574051.491121:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360990720:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788574051.491137:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ca80 x1875453360990848/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574051.491151:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574051.491155:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574051.491157:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574051.491163:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2397
00000100:00080000:3.0:1788574051.491178:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574051.491184:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574051.491191:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788574051.491196:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574051.491210:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f800 x1875453360990976/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574051.491242:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574051/real 1788574051]  req@ffff8dc00644dc00 x1875453360990720/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574076 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574051.491263:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644dc00 x1875453360990720/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574076 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574051.491277:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574051.491281:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574051.491285:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788574051.491286:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574051.491290:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788574051.491295:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360990720:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788574051.491295:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2397
00000100:00080000:3.0:1788574051.491301:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574051.491307:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574051.491311:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574051.491321:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c000 x1875453360991104/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574051.491328:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788574051.491329:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360990848:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788574051.491333:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574051.491337:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574051.491341:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2397
00000100:00080000:3.0:1788574051.491343:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574051.491346:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574051.491349:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574051.491356:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644dc00 x1875453360991232/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574051.491362:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1788574051.491367:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788574051.491368:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574051.491371:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574051.491376:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2397
00000100:00080000:3.0:1788574051.491380:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574051.491382:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574051.491386:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574051.491387:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574051/real 1788574051]  req@ffff8dc00644ca80 x1875453360990848/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574076 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574051.491398:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ca80 x1875453360990848/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574076 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574051.491406:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574051.491411:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574051.491414:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ce00 x1875453360991360/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574051.491418:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360990848:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574051.491430:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360990976:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574051.491447:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574051.491455:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574051/real 1788574051]  req@ffff8dc00644f800 x1875453360990976/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574076 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574051.491463:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f800 x1875453360990976/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574076 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574051.491469:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574051.491471:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574051.491474:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360990976:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574051.491488:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360991104:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574051.491502:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574051.491509:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574051/real 1788574051]  req@ffff8dc00644c000 x1875453360991104/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574076 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574051.491520:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c000 x1875453360991104/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574076 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574051.491534:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574051.491535:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574051.491542:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788574051.491542:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574051.491546:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788574051.491549:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360991104:192.168.202.140@tcp:8:kworker.0
00000100:00080000:3.0:1788574051.491554:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2397
00000100:00080000:3.0:1788574051.491559:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788574051.491561:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360991232:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788574051.491565:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574051.491571:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788574051.491586:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574051.491586:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ea00 x1875453360991488/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574051.491598:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574051/real 1788574051]  req@ffff8dc00644dc00 x1875453360991232/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574076 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574051.491612:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644dc00 x1875453360991232/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574076 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574051.491621:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574051.491624:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574051.491628:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360991232:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574051.491642:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360991360:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574051.491662:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574051.491671:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574051/real 1788574051]  req@ffff8dc00644ce00 x1875453360991360/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574076 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574051.491680:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ce00 x1875453360991360/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574076 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574051.491686:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574051.491688:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574051.491690:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360991360:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574051.491697:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360991488:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574051.491708:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574051.491714:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574051/real 1788574051]  req@ffff8dc00644ea00 x1875453360991488/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574076 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574051.491721:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ea00 x1875453360991488/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574076 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574051.491726:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574051.491728:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574051.491730:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360991488:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574051.874973:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574051.874973:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574051.874986:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574051.875007:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574051.875008:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574051.875011:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574052.514990:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574052.898936:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574052.898938:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574052.898980:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574052.898993:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574052.899054:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574052.899098:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574053.538944:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574053.923002:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574053.923002:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574053.923004:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574053.923004:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574053.923041:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574053.923087:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574054.562974:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574054.946960:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574054.946974:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574054.946975:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574054.946991:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574054.947016:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574054.947054:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574055.586958:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574055.971003:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574055.971004:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574055.971004:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574055.971008:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574055.971041:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574055.971073:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574056.610981:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574056.611009:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574056.611013:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788574056.611016:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574056.611023:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2402
00000100:00080000:1.0:1788574056.611031:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574056.611037:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574056.611070:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453360991616/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574056.611090:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574056.611093:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574056.611094:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574056.611097:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2402
00000100:00080000:1.0:1788574056.611099:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574056.611102:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574056.611110:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574056.611120:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360991744/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574056.611128:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574056.611133:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:0.0:1788574056.611134:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360991616:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574056.611135:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574056.611143:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2402
00000100:00080000:1.0:1788574056.611146:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574056.611148:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574056.611151:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574056.611160:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453360991872/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574056.611167:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574056.611169:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574056.611170:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574056.611173:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2402
00000100:00080000:1.0:1788574056.611183:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574056.611185:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574056.611190:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788574056.611194:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574056.611201:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360992000/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574056.611209:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574056.611211:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574056.611212:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574056.611215:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2402
00000100:00080000:1.0:1788574056.611217:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574056.611225:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574056.611228:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574056.611239:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360992128/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574056.611241:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574056/real 1788574056]  req@ffff8dc005dc0a80 x1875453360991616/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574081 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574056.611251:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574056.611258:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574056.611261:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574056.611267:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2402
00000100:00080000:1.0:1788574056.611270:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574056.611273:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574056.611277:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574056.611278:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453360991616/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574081 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574056.611286:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360992256/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574056.611290:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574056.611299:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574056.611300:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788574056.611305:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:0.0:1788574056.611309:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360991616:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574056.611309:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574056.611317:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2402
00000100:00080000:1.0:1788574056.611319:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574056.611322:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574056.611324:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574056.611330:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360992384/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574056.611335:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360991744:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574056.611361:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574056.611371:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574056/real 1788574056]  req@ffff8dc005dc2d80 x1875453360991744/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574081 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574056.611380:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360991744/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574081 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574056.611386:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574056.611389:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574056.611391:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360991744:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574056.611395:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360991872:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574056.611407:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574056.611413:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574056/real 1788574056]  req@ffff8dc005dc3800 x1875453360991872/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574081 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574056.611421:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453360991872/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574081 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574056.611427:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574056.611428:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574056.611430:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360991872:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574056.611434:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360992000:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574056.611443:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574056.611460:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574056/real 1788574056]  req@ffff8dc005dc1c00 x1875453360992000/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574081 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574056.611472:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453360992000/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574081 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574056.611478:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574056.611480:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574056.611482:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360992000:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574056.611486:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360992128:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574056.611497:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574056.611503:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574056/real 1788574056]  req@ffff8dc005dc1500 x1875453360992128/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574081 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574056.611510:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360992128/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574081 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574056.611516:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574056.611524:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574056.611526:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360992128:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574056.611529:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360992256:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574056.611540:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574056.611547:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574056/real 1788574056]  req@ffff8dc005dc3b80 x1875453360992256/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574081 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574056.611554:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360992256/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574081 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574056.611564:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574056.611566:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574056.611568:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360992256:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574056.611579:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360992384:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574056.611589:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574056.611595:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574056/real 1788574056]  req@ffff8dc005dc1180 x1875453360992384/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574081 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574056.611602:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360992384/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574081 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574056.611607:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574056.611609:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574056.611611:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360992384:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574056.994954:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574056.994970:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574056.994976:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574056.995009:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574056.995025:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574056.995056:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574057.634963:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574058.018992:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574058.018992:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574058.019000:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574058.019001:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574058.019031:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574058.019068:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574058.659017:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574059.042977:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574059.042982:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574059.043002:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574059.043023:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574059.043028:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574059.043038:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574059.682971:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574060.067005:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574060.067014:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574060.067036:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574060.067036:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574060.067040:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574060.067052:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574060.706981:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574061.090995:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574061.090999:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574061.091033:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574061.091040:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574061.091064:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574061.091065:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574061.731009:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788574061.731017:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574061.731024:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788574061.731030:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574061.731041:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2407
00000100:00080000:1.0:1788574061.731053:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574061.731061:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574061.731112:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360992512/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574061.731147:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574061.731151:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574061.731152:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574061.731156:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2407
00000100:00080000:1.0:1788574061.731159:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574061.731163:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574061.731174:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574061.731189:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360992640/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574061.731197:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574061.731200:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574061.731201:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574061.731204:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2407
00000100:00080000:1.0:1788574061.731206:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574061.731209:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574061.731213:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574061.731224:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360992512:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788574061.731224:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360992768/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574061.731252:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574061.731256:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574061.731257:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574061.731260:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2407
00000100:00080000:1.0:1788574061.731264:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574061.731267:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574061.731271:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574061.731280:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360992896/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574061.731287:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574061.731290:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574061.731291:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574061.731295:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2407
00000100:00080000:1.0:1788574061.731315:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574061.731317:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574061.731321:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788574061.731329:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574061.731331:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360993024/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574061.731342:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574061.731345:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574061.731348:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574061.731352:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2407
00000100:00080000:1.0:1788574061.731357:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574061.731361:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574061.731364:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574061.731376:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453360993152/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574061.731385:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574061/real 1788574061]  req@ffff8dc005dc0700 x1875453360992512/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574086 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574061.731411:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574061.731423:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574061.731424:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574061.731430:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2407
00000100:00080000:1.0:1788574061.731439:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574061.731451:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574061.731458:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574061.731466:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453360992512/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574086 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574061.731471:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360993280/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574061.731508:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574061.731517:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574061.731523:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360992512:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788574061.731531:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360992640:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574061.731559:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574061.731575:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574061/real 1788574061]  req@ffff8dc005dc1180 x1875453360992640/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574086 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574061.731589:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360992640/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574086 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574061.731601:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574061.731605:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574061.731609:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360992640:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574061.731636:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360992768:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574061.731661:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574061.731674:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574061/real 1788574061]  req@ffff8dc005dc3b80 x1875453360992768/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574086 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574061.731686:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360992768/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574086 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574061.731700:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574061.731704:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574061.731707:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360992768:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574061.731714:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360992896:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574061.731734:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574061.731745:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574061/real 1788574061]  req@ffff8dc005dc1500 x1875453360992896/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574086 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574061.731757:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360992896/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574086 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574061.731766:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574061.731781:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574061.731785:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360992896:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574061.731792:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360993024:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574061.731812:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574061.731824:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574061/real 1788574061]  req@ffff8dc005dc1c00 x1875453360993024/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574086 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574061.731836:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453360993024/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574086 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574061.731845:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574061.731849:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574061.731853:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360993024:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574061.731860:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360993152:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574061.731916:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574061.731925:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574061/real 1788574061]  req@ffff8dc005dc3800 x1875453360993152/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574086 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574061.731933:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453360993152/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574086 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574061.731938:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574061.731940:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574061.731943:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360993152:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574061.731947:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360993280:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574061.731958:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574061.731964:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574061/real 1788574061]  req@ffff8dc005dc2d80 x1875453360993280/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574086 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574061.731971:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360993280/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574086 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574061.731977:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574061.731978:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574061.731980:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360993280:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574062.115019:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574062.115019:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574062.115028:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574062.115059:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574062.115063:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574062.115070:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574062.754980:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574063.138971:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574063.138971:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574063.138975:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574063.138976:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574063.139004:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574063.139066:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574063.778971:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574064.162950:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574064.162951:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574064.162951:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574064.162969:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574064.162994:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574064.163035:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574064.802931:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574065.186950:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574065.186957:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574065.186966:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574065.186967:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574065.186990:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788574065.187043:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574065.827003:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574066.210965:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574066.210965:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574066.210965:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574066.211001:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574066.211008:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788574066.211016:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574066.850967:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788574066.850987:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574066.850994:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788574066.850999:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574066.851008:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2412
00000100:00080000:2.0:1788574066.851019:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574066.851027:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574066.851066:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453360993408/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574066.851094:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574066.851098:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574066.851100:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574066.851104:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2412
00000100:00080000:2.0:1788574066.851107:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574066.851112:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574066.851122:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574066.851136:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360993408:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788574066.851139:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453360993536/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574066.851153:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574066.851157:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574066.851158:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574066.851163:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2412
00000100:00080000:2.0:1788574066.851167:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574066.851171:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574066.851177:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574066.851188:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453360993664/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1788574066.851195:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788574066.851205:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574066.851209:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574066.851211:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574066.851216:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2412
00000100:00080000:2.0:1788574066.851220:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574066.851225:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574066.851230:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574066.851232:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574066/real 1788574066]  req@ffff8dc020494000 x1875453360993408/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574091 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574066.851243:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453360993792/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574066.851269:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788574066.851273:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453360993408/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574091 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574066.851275:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574066.851279:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574066.851289:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2412
00000100:00080000:0.0:1788574066.851291:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574066.851293:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574066.851298:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788574066.851302:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574066.851305:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360993408:192.168.202.140@tcp:250:kworker.0
00000008:00100000:2.0:1788574066.851310:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574066.851324:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453360993920/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574066.851327:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360993536:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788574066.851347:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574066.851351:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000800:00000100:0.0:1788574066.851355:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788574066.851356:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574066.851364:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2412
00000100:00080000:2.0:1788574066.851369:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788574066.851370:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574066/real 1788574066]  req@ffff8dc020497480 x1875453360993536/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574091 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574066.851378:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574066.851388:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574066.851389:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453360993536/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574091 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574066.851403:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574066.851408:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574066.851408:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453360994048/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574066.851414:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360993536:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574066.851431:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360993664:192.168.202.140@tcp:8:kworker.0
00000100:00080000:2.0:1788574066.851437:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574066.851442:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574066.851444:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1788574066.851452:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788574066.851452:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2412
00000100:00080000:2.0:1788574066.851459:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788574066.851466:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574066/real 1788574066]  req@ffff8dc020494a80 x1875453360993664/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574091 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574066.851467:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574066.851476:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574066.851481:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453360993664/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574091 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574066.851489:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1788574066.851491:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453360994176/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574066.851495:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574066.851502:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360993664:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574066.851513:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360993792:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574066.851530:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574066.851539:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574066/real 1788574066]  req@ffff8dc020496d80 x1875453360993792/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574091 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574066.851547:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453360993792/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574091 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574066.851552:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574066.851554:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574066.851556:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360993792:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574066.851568:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360993920:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574066.851581:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574066.851593:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574066/real 1788574066]  req@ffff8dc020495880 x1875453360993920/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574091 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574066.851605:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453360993920/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574091 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574066.851615:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574066.851619:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574066.851623:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360993920:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574066.851630:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360994048:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574066.851647:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574066.851656:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574066/real 1788574066]  req@ffff8dc020495180 x1875453360994048/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574091 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574066.851663:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453360994048/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574091 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574066.851669:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574066.851671:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574066.851673:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360994048:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574066.851677:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360994176:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574066.851686:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574066.851692:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574066/real 1788574066]  req@ffff8dc020494000 x1875453360994176/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574091 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574066.851699:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453360994176/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574091 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574066.851708:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574066.851710:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574066.851713:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360994176:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574067.234957:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574067.234957:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574067.234957:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574067.234961:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574067.234993:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788574067.235037:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574067.874928:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574068.258942:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574068.258946:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574068.258950:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574068.258976:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788574068.258983:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574068.258984:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574068.898945:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574069.282952:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574069.282959:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574069.282963:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788574069.282982:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574069.282983:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574069.282990:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574069.923013:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574070.306952:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574070.306959:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574070.306959:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574070.306985:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788574070.306996:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574070.307002:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574070.946958:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574071.330981:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574071.330981:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574071.330989:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574071.331012:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788574071.331015:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574071.331031:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00080000:2.0:1788574071.970966:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788574071.970972:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788574071.970974:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788574071.970981:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574071.970990:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2417
00000100:00080000:2.0:1788574071.971000:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574071.971006:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574071.971039:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453360994304/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574071.971066:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574071.971069:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574071.971070:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574071.971073:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2417
00000100:00080000:2.0:1788574071.971075:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574071.971078:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574071.971085:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574071.971093:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453360994432/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574071.971099:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574071.971102:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574071.971103:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574071.971105:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2417
00000100:00080000:2.0:1788574071.971107:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574071.971110:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574071.971113:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574071.971119:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453360994560/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574071.971127:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574071.971130:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574071.971131:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574071.971135:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2417
00000100:00100000:0.0:1788574071.971136:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360994304:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788574071.971138:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574071.971145:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574071.971151:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574071.971164:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453360994688/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574071.971173:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574071.971177:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574071.971179:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574071.971184:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2417
00000100:00080000:2.0:1788574071.971188:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574071.971193:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:0.0:1788574071.971199:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:2.0:1788574071.971212:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574071.971233:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453360994816/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574071.971244:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788574071.971246:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574071/real 1788574071]  req@ffff8dc020496a00 x1875453360994304/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574096 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574071.971251:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574071.971255:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574071.971264:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2417
00000100:00080000:2.0:1788574071.971271:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574071.971275:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574071.971280:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453360994304/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574096 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1788574071.971282:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574071.971295:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453360994944/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574071.971308:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574071.971318:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788574071.971322:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788574071.971325:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360994304:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788574071.971326:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574071.971331:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574071.971335:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2417
00000100:00100000:0.0:1788574071.971339:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360994432:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788574071.971339:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574071.971347:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574071.971350:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574071.971358:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453360995072/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1788574071.971370:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574071.971383:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574071/real 1788574071]  req@ffff8dc020495500 x1875453360994432/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574096 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574071.971392:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453360994432/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574096 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574071.971399:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574071.971401:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574071.971404:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360994432:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574071.971421:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360994560:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574071.971434:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574071.971441:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574071/real 1788574071]  req@ffff8dc020497100 x1875453360994560/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574096 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574071.971449:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453360994560/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574096 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574071.971454:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574071.971456:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574071.971458:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360994560:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574071.971461:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360994688:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574071.971471:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574071.971477:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574071/real 1788574071]  req@ffff8dc020494e00 x1875453360994688/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574096 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574071.971484:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453360994688/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574096 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574071.971490:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574071.971492:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574071.971494:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360994688:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574071.971498:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360994816:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574071.971507:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574071.971513:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574071/real 1788574071]  req@ffff8dc020494380 x1875453360994816/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574096 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574071.971520:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453360994816/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574096 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574071.971526:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574071.971527:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574071.971529:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360994816:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574071.971533:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360994944:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574071.971543:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574071.971548:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574071/real 1788574071]  req@ffff8dc020494700 x1875453360994944/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574096 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574071.971555:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453360994944/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574096 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574071.971560:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574071.971562:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574071.971564:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360994944:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574071.971568:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360995072:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574071.971578:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574071.971584:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574071/real 1788574071]  req@ffff8dc020494000 x1875453360995072/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574096 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574071.971590:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453360995072/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574096 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574071.971596:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574071.971597:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574071.971599:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360995072:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574072.354986:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574072.355016:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788574072.355023:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574072.355042:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574072.355054:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574072.355064:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574072.994947:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574073.378981:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574073.378981:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574073.378981:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574073.378981:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574073.379013:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788574073.379057:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574074.018993:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574074.402945:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574074.402945:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788574074.402983:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574074.402989:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574074.402995:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574074.403016:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574075.042931:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574075.426968:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574075.426968:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574075.426996:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574075.427009:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574075.427017:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788574075.427027:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574076.067030:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574076.450938:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574076.450984:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574076.450992:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574076.451011:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574076.451018:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788574076.451041:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1788574077.090956:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788574077.090965:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574077.090968:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788574077.090975:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574077.090986:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2422
00000100:00080000:1.0:1788574077.090997:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574077.091006:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574077.091043:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453360995200/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574077.091073:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574077.091078:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574077.091080:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574077.091084:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2422
00000100:00080000:1.0:1788574077.091088:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574077.091092:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574077.091102:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574077.091118:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453360995328/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574077.091129:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360995200:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574077.091133:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574077.091138:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574077.091140:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574077.091145:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2422
00000100:00080000:1.0:1788574077.091150:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574077.091163:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574077.091169:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788574077.091186:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574077.091186:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453360995456/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574077.091199:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574077.091204:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574077.091205:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574077.091210:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2422
00000100:00080000:1.0:1788574077.091214:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574077.091218:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574077.091223:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574077.091238:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574077/real 1788574077]  req@ffff8dc005dc0a80 x1875453360995200/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574102 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574077.091239:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453360995584/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574077.091276:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788574077.091277:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453360995200/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574102 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574077.091288:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574077.091291:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574077.091292:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574077.091300:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788574077.091303:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2422
00000100:00100000:0.0:1788574077.091307:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360995200:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574077.091310:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574077.091316:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574077.091322:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574077.091329:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360995328:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574077.091338:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453360995712/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1788574077.091350:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788574077.091352:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574077.091358:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574077.091361:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788574077.091362:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574077/real 1788574077]  req@ffff8dc005dc2d80 x1875453360995328/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574102 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574077.091372:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2422
00000100:00100000:0.0:1788574077.091379:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453360995328/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574102 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574077.091380:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574077.091390:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:0.0:1788574077.091391:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574077.091397:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000008:00100000:1.0:1788574077.091400:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574077.091401:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360995328:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574077.091410:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360995456:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574077.091420:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360995840/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1788574077.091429:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788574077.091439:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788574077.091440:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574077/real 1788574077]  req@ffff8dc005dc3800 x1875453360995456/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574102 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574077.091451:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574077.091456:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788574077.091457:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453360995456/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574102 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574077.091468:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2422
00000100:00080000:0.0:1788574077.091470:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574077.091476:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574077.091477:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574077.091484:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360995456:192.168.202.140@tcp:8:kworker.0
00000100:00080000:1.0:1788574077.091488:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574077.091494:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360995584:192.168.202.140@tcp:8:kworker.0
00000008:00100000:1.0:1788574077.091496:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788574077.091511:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574077.091525:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574077/real 1788574077]  req@ffff8dc005dc1c00 x1875453360995584/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574102 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574077.091526:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360995968/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574077.091554:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453360995584/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574102 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574077.091566:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574077.091571:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574077.091575:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360995584:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574077.091593:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360995712:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574077.091611:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574077.091618:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574077/real 1788574077]  req@ffff8dc005dc1500 x1875453360995712/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574102 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574077.091626:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453360995712/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574102 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574077.091633:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574077.091635:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574077.091637:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360995712:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574077.091641:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360995840:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574077.091652:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574077.091657:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574077/real 1788574077]  req@ffff8dc005dc3b80 x1875453360995840/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574102 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574077.091665:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360995840/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574102 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574077.091670:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574077.091672:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574077.091674:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360995840:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574077.091677:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360995968:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574077.091686:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574077.091693:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574077/real 1788574077]  req@ffff8dc005dc1180 x1875453360995968/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574102 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574077.091704:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360995968/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574102 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574077.091712:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574077.091715:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574077.091719:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360995968:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574077.474993:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574077.474993:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574077.475008:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574077.475008:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574077.475051:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788574077.475095:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574078.114978:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574078.498942:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574078.498953:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574078.498958:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574078.498960:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574078.498997:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788574078.499021:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574079.138958:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574079.522962:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574079.522962:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574079.522966:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574079.522966:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574079.522995:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788574079.523056:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574080.162981:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574080.546962:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574080.546962:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574080.547136:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574080.547174:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574080.547174:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574080.547209:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574081.186983:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574081.570971:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574081.570972:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574081.570972:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574081.570972:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574081.571009:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788574081.571054:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574082.210974:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788574082.211004:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574082.211014:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788574082.211020:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574082.211032:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2427
00000100:00080000:3.0:1788574082.211046:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574082.211056:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788574082.211107:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d500 x1875453360996096/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574082.211137:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574082.211142:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574082.211143:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574082.211147:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2427
00000100:00080000:3.0:1788574082.211150:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574082.211154:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574082.211166:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574082.211180:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c380 x1875453360996224/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574082.211184:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360996096:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788574082.211215:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574082.211220:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574082.211223:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574082.211231:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2427
00000100:00080000:3.0:1788574082.211235:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574082.211239:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574082.211246:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574082.211276:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f480 x1875453360996352/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574082.211285:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574082.211292:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574082.211295:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1788574082.211301:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788574082.211303:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2427
00000100:00080000:3.0:1788574082.211311:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574082.211315:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574082.211322:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574082.211334:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d180 x1875453360996480/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574082.211343:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574082.211347:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574082.211349:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574082.211354:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2427
00000100:00080000:3.0:1788574082.211357:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574082.211364:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574082.211369:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574082/real 1788574082]  req@ffff8dc00644d500 x1875453360996096/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574107 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1788574082.211371:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574082.211403:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e680 x1875453360996608/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574082.211409:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d500 x1875453360996096/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574107 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574082.211443:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574082.211460:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574082.211463:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574082.211467:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574082.211471:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2427
00000100:00080000:0.0:1788574082.211477:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788574082.211480:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788574082.211487:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360996096:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788574082.211491:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574082.211507:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574082.211520:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c700 x1875453360996736/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574082.211531:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360996224:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788574082.211553:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574082.211557:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574082.211560:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574082.211565:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2427
00000100:00080000:3.0:1788574082.211568:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574082.211572:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574082.211576:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788574082.211584:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574082.211590:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e300 x1875453360996864/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574082.211608:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574082/real 1788574082]  req@ffff8dc00644c380 x1875453360996224/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574107 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574082.211629:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453360996224/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574107 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574082.211638:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574082.211641:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574082.211643:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360996224:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574082.211649:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360996352:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574082.211669:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574082.211677:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574082/real 1788574082]  req@ffff8dc00644f480 x1875453360996352/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574107 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574082.211685:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453360996352/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574107 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574082.211691:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574082.211693:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574082.211695:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360996352:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574082.211699:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360996480:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574082.211710:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574082.211743:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574082/real 1788574082]  req@ffff8dc00644d180 x1875453360996480/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574107 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574082.211752:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453360996480/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574107 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574082.211763:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574082.211766:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574082.211768:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360996480:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574082.211773:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360996608:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574082.211788:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574082.211795:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574082/real 1788574082]  req@ffff8dc00644e680 x1875453360996608/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574107 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574082.211808:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453360996608/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574107 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574082.211814:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574082.211816:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574082.211818:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360996608:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574082.211844:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360996736:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574082.211856:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574082.211862:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574082/real 1788574082]  req@ffff8dc00644c700 x1875453360996736/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574107 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574082.211891:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453360996736/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574107 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574082.211906:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574082.211909:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574082.211911:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360996736:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574082.211915:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360996864:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574082.211927:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574082.211933:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574082/real 1788574082]  req@ffff8dc00644e300 x1875453360996864/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574107 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574082.211941:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453360996864/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574107 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574082.211950:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574082.211952:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574082.211954:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360996864:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574082.594991:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574082.595010:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574082.595032:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574082.595033:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574082.595078:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574082.595148:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574083.234977:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574083.618953:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574083.618955:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788574083.618991:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574083.619005:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574083.619006:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574083.619018:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574084.258981:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574084.642964:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574084.642965:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574084.642965:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574084.642965:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574084.642999:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574084.643047:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574085.282956:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574085.667000:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574085.667000:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574085.667019:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574085.667026:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574085.667072:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788574085.667145:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574086.306990:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574086.690950:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574086.690966:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574086.691006:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574086.691007:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574086.691010:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574086.691097:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574087.331003:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788574087.331003:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574087.331015:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788574087.331020:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574087.331031:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2432
00000100:00080000:2.0:1788574087.331044:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574087.331052:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574087.331095:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453360996992/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574087.331132:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574087.331135:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574087.331136:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574087.331139:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2432
00000100:00080000:2.0:1788574087.331142:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574087.331146:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574087.331157:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574087.331169:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453360997120/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574087.331183:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788574087.331185:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360996992:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788574087.331187:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574087.331192:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574087.331200:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2432
00000100:00080000:2.0:1788574087.331203:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574087.331205:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574087.331210:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574087.331221:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453360997248/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574087.331228:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574087.331231:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574087.331232:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574087.331236:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2432
00000100:00080000:2.0:1788574087.331239:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574087.331241:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574087.331244:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574087.331259:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453360997376/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574087.331267:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574087.331270:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574087.331271:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574087.331275:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2432
00000100:00080000:2.0:1788574087.331280:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574087.331284:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574087.331288:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574087.331301:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453360997504/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574087.331308:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574087.331311:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574087.331312:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574087.331316:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2432
00000100:00080000:2.0:1788574087.331319:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574087.331322:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574087.331325:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574087.331334:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453360997632/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574087.331342:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360997120:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788574087.331345:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574087.331353:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574087.331355:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574087.331360:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2432
00000100:00080000:2.0:1788574087.331365:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574087.331370:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574087.331376:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574087.331392:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360997248:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574087.331394:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453360997760/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574087.331429:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360997376:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574087.331466:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360997504:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574087.331498:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360997632:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574087.331531:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360997760:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574087.715009:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574087.715010:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574087.715010:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574087.715042:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574087.715073:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788574087.715163:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574088.355003:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574088.738982:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574088.739004:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574088.739054:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574088.739169:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574088.739169:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574088.739181:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574089.379003:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574089.763002:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574089.763019:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574089.763021:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788574089.763061:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574089.763064:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574089.763080:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574090.402971:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000400:00000100:3.0:1788574090.403140:0:2334:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.140:988
00000400:00000100:3.0:1788574090.403188:0:2334:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.140@tcp at host 192.168.202.140 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:3.0:1788574090.403206:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788574090.403246:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788574090.403272:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788574090.403283:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788574090.403295:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788574090.403306:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:1.0:1788574090.403314:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574087/real 1788574090]  req@ffff8dc020495880 x1875453360997120/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574112 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:3.0:1788574090.403320:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:1.0:1788574090.403348:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453360997120/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574112 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574090.403362:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574090.403368:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574090.403373:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360997120:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574090.403381:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574087/real 1788574090]  req@ffff8dc020496d80 x1875453360997248/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574112 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574090.403394:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453360997248/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574112 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574090.403402:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574090.403405:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574090.403409:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360997248:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574090.403418:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574087/real 1788574090]  req@ffff8dc020494a80 x1875453360997376/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574112 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574090.403431:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453360997376/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574112 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574090.403447:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574090.403451:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574090.403455:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360997376:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574090.403463:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574087/real 1788574090]  req@ffff8dc020497480 x1875453360997504/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574112 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574090.403481:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453360997504/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574112 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574090.403489:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574090.403492:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574090.403495:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360997504:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574090.403502:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574087/real 1788574090]  req@ffff8dc020495180 x1875453360996992/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574112 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574090.403513:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453360996992/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574112 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574090.403521:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574090.403524:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574090.403527:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360996992:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788574090.403560:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574087/real 1788574090]  req@ffff8dc020494000 x1875453360997632/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574112 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574090.403572:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453360997632/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574112 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574090.403580:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574090.403583:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574090.403586:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360997632:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574090.403608:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574087/real 1788574090]  req@ffff8dc020494700 x1875453360997760/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574112 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574090.403621:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453360997760/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574112 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574090.403628:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574090.403632:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574090.403636:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360997760:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574090.786982:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574090.786984:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574090.787030:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574090.787043:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574090.787067:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574090.787077:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574091.427039:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574091.811017:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574091.811017:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574091.811017:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788574091.811061:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574091.811064:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574091.811079:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574092.450965:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788574092.450998:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574092.451006:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788574092.451011:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574092.451021:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2438
00000100:00080000:2.0:1788574092.451033:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574092.451041:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574092.451083:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453360997888/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574092.451118:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574092.451122:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574092.451125:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574092.451130:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2438
00000100:00080000:2.0:1788574092.451134:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574092.451140:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574092.451154:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574092.451171:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453360998016/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574092.451174:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360997888:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788574092.451207:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574092.451210:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574092.451212:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574092.451216:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2438
00000100:00080000:2.0:1788574092.451220:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574092.451223:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574092.451227:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574092.451239:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453360998144/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574092.451247:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574092.451252:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574092.451254:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574092.451259:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2438
00000800:00000100:1.0:1788574092.451267:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788574092.451268:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574092.451281:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574092.451289:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574092.451314:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453360998272/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574092.451327:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788574092.451332:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574092/real 1788574092]  req@ffff8dc020494380 x1875453360997888/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574117 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574092.451335:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574092.451340:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574092.451355:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2438
00000100:00080000:2.0:1788574092.451363:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574092.451373:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574092.451393:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574092.451415:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453360997888/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574117 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574092.451418:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453360998400/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574092.451504:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574092.451505:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574092.451520:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574092.451521:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788574092.451525:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1788574092.451536:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360997888:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788574092.451543:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2438
00000100:00080000:2.0:1788574092.451554:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574092.451562:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574092.451571:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574092.451593:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453360998528/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574092.451603:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360998016:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788574092.451615:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574092.451622:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574092.451624:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574092.451632:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2438
00000100:00080000:2.0:1788574092.451653:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574092.451659:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574092.451664:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1788574092.451680:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574092.451686:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453360998656/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574092.451708:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574092/real 1788574092]  req@ffff8dc020494e00 x1875453360998016/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574117 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574092.451726:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453360998016/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574117 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574092.451741:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574092.451746:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574092.451750:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360998016:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574092.451759:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360998144:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574092.451782:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574092.451793:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574092/real 1788574092]  req@ffff8dc020497100 x1875453360998144/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574117 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574092.451822:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453360998144/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574117 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574092.451838:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574092.451842:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574092.451846:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360998144:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574092.451855:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360998272:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574092.451905:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574092.451919:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574092/real 1788574092]  req@ffff8dc020495500 x1875453360998272/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574117 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574092.451932:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453360998272/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574117 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574092.451941:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574092.451945:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574092.451949:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360998272:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574092.451956:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360998400:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574092.451976:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574092.451987:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574092/real 1788574092]  req@ffff8dc020496a00 x1875453360998400/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574117 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574092.451998:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453360998400/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574117 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574092.452007:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574092.452010:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574092.452014:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360998400:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574092.452036:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360998528:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574092.452056:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574092.452066:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574092/real 1788574092]  req@ffff8dc020494380 x1875453360998528/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574117 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574092.452078:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453360998528/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574117 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574092.452086:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574092.452090:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574092.452093:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360998528:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574092.452100:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360998656:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574092.452118:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574092.452128:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574092/real 1788574092]  req@ffff8dc020494700 x1875453360998656/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574117 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574092.452139:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453360998656/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574117 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574092.452148:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574092.452151:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574092.452155:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360998656:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574092.834983:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574092.834984:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574092.834984:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574092.835040:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574092.835056:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574092.835074:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574093.474975:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574093.858955:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574093.858966:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574093.858994:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788574093.858996:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574093.859014:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574093.859021:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574094.498971:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574094.882955:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574094.882958:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574094.882970:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574094.883025:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574094.883031:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574094.883058:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574095.522960:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574095.906942:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574095.906948:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574095.906970:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574095.906994:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574095.907008:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788574095.907012:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574096.546985:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574096.931014:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574096.931043:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574096.931047:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574096.931051:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574096.931089:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574096.931121:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1788574097.570993:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788574097.571002:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788574097.571010:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788574097.571017:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574097.571032:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2443
00000100:00080000:2.0:1788574097.571045:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574097.571054:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574097.571107:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453360998784/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574097.571136:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574097.571139:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574097.571141:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574097.571144:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2443
00000100:00080000:2.0:1788574097.571147:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574097.571149:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574097.571159:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574097.571171:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453360998912/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574097.571179:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574097.571181:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574097.571182:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574097.571187:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2443
00000100:00080000:2.0:1788574097.571190:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574097.571193:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574097.571199:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574097.571200:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360998784:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788574097.571219:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453360999040/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574097.571226:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574097.571228:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574097.571230:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574097.571233:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2443
00000100:00080000:2.0:1788574097.571235:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574097.571237:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574097.571240:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574097.571248:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453360999168/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574097.571254:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574097.571256:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574097.571257:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574097.571259:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2443
00000100:00080000:2.0:1788574097.571263:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574097.571266:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574097.571270:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574097.571283:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453360999296/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788574097.571285:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788574097.571298:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574097.571301:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574097.571303:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574097.571306:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2443
00000100:00080000:2.0:1788574097.571310:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574097.571313:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574097.571318:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574097.571330:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453360999424/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574097.571339:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788574097.571344:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574097/real 1788574097]  req@ffff8dc020494000 x1875453360998784/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574122 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574097.571345:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574097.571347:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574097.571354:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2443
00000100:00080000:2.0:1788574097.571356:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574097.571368:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574097.571378:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574097.571393:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453360999552/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574097.571394:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453360998784/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574122 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574097.571454:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574097.571460:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574097.571468:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360998784:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788574097.571479:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360998912:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574097.571502:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574097.571512:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574097/real 1788574097]  req@ffff8dc020495180 x1875453360998912/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574122 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574097.571521:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453360998912/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574122 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574097.571534:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574097.571538:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574097.571542:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360998912:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574097.571569:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360999040:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574097.571592:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574097.571627:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574097/real 1788574097]  req@ffff8dc020497480 x1875453360999040/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574122 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574097.571636:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453360999040/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574122 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574097.571642:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574097.571645:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574097.571647:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360999040:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574097.571652:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360999168:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574097.571666:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574097.571679:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574097/real 1788574097]  req@ffff8dc020494a80 x1875453360999168/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574122 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574097.571687:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453360999168/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574122 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574097.571693:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574097.571695:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574097.571698:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360999168:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574097.571702:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360999296:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574097.571714:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574097.571721:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574097/real 1788574097]  req@ffff8dc020496d80 x1875453360999296/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574122 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574097.571728:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453360999296/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574122 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574097.571737:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574097.571741:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574097.571744:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360999296:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574097.571751:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360999424:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574097.571773:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574097.571785:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574097/real 1788574097]  req@ffff8dc020495880 x1875453360999424/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574122 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574097.571795:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453360999424/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574122 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574097.571800:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574097.571803:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574097.571805:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360999424:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574097.571809:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360999552:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574097.571823:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574097.571830:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574097/real 1788574097]  req@ffff8dc020494700 x1875453360999552/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574122 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574097.571837:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453360999552/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574122 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574097.571843:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574097.571845:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574097.571846:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453360999552:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574097.954993:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574097.954993:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574097.954993:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574097.955046:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574097.955056:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788574097.955089:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574098.594948:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574098.978986:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574098.979007:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574098.979008:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574098.979008:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574098.979013:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574098.979114:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574099.618978:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574100.002999:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574100.003004:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574100.003005:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574100.003049:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574100.003050:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788574100.003125:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574100.642956:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574101.026998:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574101.026998:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574101.027030:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574101.027083:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574101.027089:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574101.027101:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574101.667020:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574102.050975:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574102.050975:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574102.050975:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574102.051011:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574102.051017:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574102.051038:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574102.690985:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788574102.690987:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574102.691000:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788574102.691005:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574102.691019:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2448
00000100:00080000:1.0:1788574102.691032:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574102.691040:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574102.691101:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453360999680/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574102.691132:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574102.691135:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574102.691137:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574102.691141:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2448
00000100:00080000:1.0:1788574102.691145:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574102.691150:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574102.691162:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574102.691171:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360999680:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788574102.691181:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453360999808/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574102.691197:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574102.691202:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574102.691204:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574102.691210:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2448
00000100:00080000:1.0:1788574102.691227:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574102.691232:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:0.0:1788574102.691240:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:1.0:1788574102.691243:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574102.691263:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453360999936/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574102.691274:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574102.691280:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574102.691282:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574102.691289:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2448
00000100:00100000:0.0:1788574102.691292:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574102/real 1788574102]  req@ffff8dc005dc0700 x1875453360999680/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574127 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574102.691297:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574102.691310:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574102.691318:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574102.691321:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453360999680/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574127 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574102.691338:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1788574102.691339:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361000064/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574102.691355:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574102.691368:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453360999680:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574102.691369:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574102.691385:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574102.691388:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574102.691395:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2448
00000100:00080000:1.0:1788574102.691399:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574102.691405:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574102.691410:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574102.691414:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360999808:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574102.691445:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361000192/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574102.691461:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1788574102.691469:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788574102.691481:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574102.691485:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788574102.691489:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574102/real 1788574102]  req@ffff8dc005dc1180 x1875453360999808/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574127 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574102.691495:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2448
00000100:00080000:1.0:1788574102.691505:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788574102.691527:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453360999808/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574127 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574102.691533:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574102.691550:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1788574102.691575:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1788574102.691582:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361000320/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574102.691586:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574102.691601:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360999808:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788574102.691608:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574102.691613:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:0.0:1788574102.691617:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360999936:192.168.202.140@tcp:8:kworker.0
00000100:00080000:1.0:1788574102.691619:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574102.691642:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2448
00000100:00080000:1.0:1788574102.691651:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1788574102.691659:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788574102.691662:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574102.691672:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574102.691681:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574102/real 1788574102]  req@ffff8dc005dc3b80 x1875453360999936/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574127 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574102.691699:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361000448/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574102.691702:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453360999936/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574127 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574102.691743:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574102.691748:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574102.691752:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453360999936:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574102.691760:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361000064:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574102.691787:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574102.691799:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574102/real 1788574102]  req@ffff8dc005dc1500 x1875453361000064/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574127 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574102.691811:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361000064/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574127 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574102.691820:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574102.691824:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574102.691827:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361000064:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574102.691845:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361000192:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574102.691864:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574102.691906:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574102/real 1788574102]  req@ffff8dc005dc1c00 x1875453361000192/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574127 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574102.691919:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361000192/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574127 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574102.691929:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574102.691932:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574102.691936:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361000192:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574102.691943:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361000320:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574102.691964:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574102.691975:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574102/real 1788574102]  req@ffff8dc005dc3800 x1875453361000320/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574127 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574102.691993:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361000320/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574127 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574102.692002:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574102.692005:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574102.692009:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361000320:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574102.692015:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361000448:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574102.692033:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574102.692043:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574102/real 1788574102]  req@ffff8dc005dc2d80 x1875453361000448/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574127 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574102.692054:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361000448/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574127 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574102.692062:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574102.692065:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574102.692068:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361000448:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574103.074986:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574103.075004:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574103.075005:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574103.075041:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574103.075042:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574103.075063:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574103.714947:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574104.098951:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574104.098985:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574104.099025:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574104.099031:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574104.099036:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574104.099071:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574104.739011:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574105.122971:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574105.123001:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574105.123007:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574105.123019:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574105.123031:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574105.123097:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574105.762955:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574106.146952:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574106.146982:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574106.146982:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788574106.146989:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574106.147009:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574106.147012:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574106.786964:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574107.170950:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574107.170951:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574107.170954:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574107.170960:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574107.170992:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574107.171038:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574107.810956:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788574107.810956:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574107.810964:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788574107.810970:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574107.810978:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2453
00000100:00080000:2.0:1788574107.810987:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574107.810993:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574107.811030:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453361000576/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574107.811058:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574107.811061:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574107.811068:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574107.811072:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2453
00000100:00080000:2.0:1788574107.811075:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574107.811079:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574107.811087:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574107.811100:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361000576:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788574107.811102:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453361000704/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574107.811115:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574107.811118:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574107.811119:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574107.811122:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2453
00000100:00080000:2.0:1788574107.811125:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574107.811130:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574107.811136:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574107.811150:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361000832/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574107.811161:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574107.811165:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574107.811167:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1788574107.811172:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788574107.811177:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2453
00000100:00080000:2.0:1788574107.811183:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574107.811186:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574107.811191:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574107.811202:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453361000960/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574107.811209:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574107.811212:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574107.811214:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788574107.811219:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574107/real 1788574107]  req@ffff8dc020494380 x1875453361000576/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574132 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574107.811221:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2453
00000100:00080000:2.0:1788574107.811227:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574107.811235:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574107.811243:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574107.811250:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453361000576/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574132 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574107.811258:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453361001088/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574107.811265:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574107.811275:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788574107.811277:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574107.811284:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574107.811285:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788574107.811291:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361000576:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788574107.811291:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2453
00000100:00080000:2.0:1788574107.811296:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574107.811307:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574107.811314:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574107.811326:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361000704:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574107.811331:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453361001216/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574107.811346:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574107.811350:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574107.811353:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1788574107.811358:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788574107.811363:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2453
00000100:00080000:2.0:1788574107.811369:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788574107.811376:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574107/real 1788574107]  req@ffff8dc020496a00 x1875453361000704/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574132 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574107.811376:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574107.811387:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574107.811412:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453361000704/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574132 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574107.811424:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574107.811428:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574107.811433:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361000704:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574107.811439:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361001344/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574107.811445:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361000832:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574107.811478:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574107.811492:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574107/real 1788574107]  req@ffff8dc020495500 x1875453361000832/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574132 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574107.811504:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361000832/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574132 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574107.811513:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574107.811516:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574107.811520:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361000832:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574107.811526:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361000960:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574107.811543:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574107.811554:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574107/real 1788574107]  req@ffff8dc020497100 x1875453361000960/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574132 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574107.811566:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453361000960/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574132 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574107.811575:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574107.811578:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574107.811581:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361000960:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574107.811587:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361001088:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574107.811605:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574107.811615:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574107/real 1788574107]  req@ffff8dc020494e00 x1875453361001088/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574132 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574107.811627:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453361001088/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574132 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574107.811637:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574107.811640:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574107.811644:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361001088:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574107.811661:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361001216:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574107.811680:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574107.811691:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574107/real 1788574107]  req@ffff8dc020494380 x1875453361001216/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574132 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574107.811703:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453361001216/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574132 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574107.811712:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574107.811716:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574107.811719:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361001216:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574107.811725:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361001344:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574107.811742:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574107.811753:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574107/real 1788574107]  req@ffff8dc020494700 x1875453361001344/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574132 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574107.811764:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361001344/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574132 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574107.811772:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574107.811775:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574107.811779:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361001344:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574108.194958:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574108.194997:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574108.195002:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574108.195003:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574108.195030:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574108.195124:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574108.835014:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574109.218981:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574109.218998:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574109.218998:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574109.219011:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574109.219039:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574109.219107:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574109.858959:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574110.242935:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574110.242943:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574110.242950:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574110.242963:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574110.242973:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574110.243042:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574110.882957:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574111.266977:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574111.266977:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574111.266983:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574111.267029:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788574111.267061:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574111.267064:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574111.906987:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574112.290983:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574112.290984:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574112.290986:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574112.290986:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574112.291013:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574112.291083:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574112.930972:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788574112.930972:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574112.930981:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788574112.930985:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574112.930994:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2458
00000100:00080000:2.0:1788574112.931003:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574112.931010:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574112.931043:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361001472/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574112.931065:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574112.931068:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574112.931069:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574112.931072:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2458
00000100:00080000:2.0:1788574112.931075:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574112.931078:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574112.931087:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574112.931094:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361001472:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788574112.931099:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453361001600/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574112.931107:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574112.931110:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574112.931111:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574112.931113:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2458
00000100:00080000:2.0:1788574112.931115:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574112.931117:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574112.931120:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574112.931135:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453361001728/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574112.931142:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574112.931145:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574112.931146:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574112.931149:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2458
00000100:00080000:2.0:1788574112.931151:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574112.931154:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574112.931157:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788574112.931165:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574112.931166:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453361001856/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574112.931175:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574112.931178:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574112.931180:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574112.931183:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2458
00000100:00080000:2.0:1788574112.931185:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574112.931188:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574112.931191:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574112.931198:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361001984/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574112.931203:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574112.931205:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574112.931207:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574112.931210:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2458
00000100:00080000:2.0:1788574112.931212:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788574112.931216:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574112/real 1788574112]  req@ffff8dc020495880 x1875453361001472/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574137 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574112.931218:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574112.931227:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574112.931237:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361001472/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574137 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574112.931262:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361002112/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574112.931263:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574112.931271:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574112.931278:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361001472:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788574112.931287:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574112.931290:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574112.931292:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574112.931296:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2458
00000100:00080000:2.0:1788574112.931300:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788574112.931304:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361001600:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788574112.931306:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574112.931314:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574112.931328:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361002240/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1788574112.931336:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574112.931350:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574112/real 1788574112]  req@ffff8dc020496d80 x1875453361001600/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574137 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574112.931360:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453361001600/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574137 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574112.931368:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574112.931370:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574112.931373:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361001600:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574112.931377:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361001728:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574112.931389:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574112.931395:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574112/real 1788574112]  req@ffff8dc020494a80 x1875453361001728/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574137 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574112.931403:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453361001728/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574137 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574112.931409:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574112.931411:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574112.931413:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361001728:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574112.931417:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361001856:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574112.931428:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574112.931434:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574112/real 1788574112]  req@ffff8dc020497480 x1875453361001856/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574137 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574112.931441:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453361001856/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574137 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574112.931446:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574112.931448:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574112.931451:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361001856:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574112.931454:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361001984:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574112.931465:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574112.931471:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574112/real 1788574112]  req@ffff8dc020495180 x1875453361001984/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574137 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574112.931477:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361001984/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574137 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574112.931483:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574112.931485:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574112.931487:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361001984:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574112.931490:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361002112:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574112.931501:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574112.931506:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574112/real 1788574112]  req@ffff8dc020494000 x1875453361002112/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574137 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574112.931514:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361002112/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574137 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574112.931519:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574112.931520:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574112.931522:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361002112:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574112.931534:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361002240:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574112.931545:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574112.931551:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574112/real 1788574112]  req@ffff8dc020495880 x1875453361002240/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574137 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574112.931559:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361002240/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574137 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574112.931564:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574112.931566:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574112.931568:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361002240:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574113.314992:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574113.314993:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574113.314993:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574113.315029:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574113.315073:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788574113.315117:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574113.954996:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574114.338988:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574114.338993:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574114.339044:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788574114.339070:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574114.339071:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574114.339092:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574114.979035:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574115.362964:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574115.362978:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574115.362990:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574115.363006:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788574115.363011:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574115.363011:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574116.002951:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574116.386965:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574116.386983:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574116.387004:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574116.387100:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574116.387122:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574116.387125:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574117.026936:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574117.410946:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574117.410946:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574117.410950:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574117.410953:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574117.410979:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788574117.411059:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574118.050962:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788574118.050981:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574118.050988:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788574118.050993:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574118.051003:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2463
00000100:00080000:3.0:1788574118.051014:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574118.051021:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788574118.051057:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ed80 x1875453361002368/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574118.051082:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574118.051098:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574118.051101:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574118.051106:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2463
00000100:00080000:3.0:1788574118.051111:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574118.051119:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574118.051120:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361002368:192.168.202.140@tcp:250:kworker.0
00000008:00100000:3.0:1788574118.051136:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574118.051154:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644df80 x1875453361002496/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574118.051166:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574118.051170:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574118.051172:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574118.051176:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2463
00000100:00080000:3.0:1788574118.051182:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1788574118.051183:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788574118.051191:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574118.051198:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574118.051212:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f100 x1875453361002624/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574118.051222:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574118.051226:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:0.0:1788574118.051230:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574118/real 1788574118]  req@ffff8dc00644ed80 x1875453361002368/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574143 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574118.051231:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574118.051239:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2463
00000100:00080000:3.0:1788574118.051245:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574118.051253:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574118.051259:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574118.051266:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ed80 x1875453361002368/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574143 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574118.051274:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d880 x1875453361002752/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574118.051290:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574118.051293:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574118.051297:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788574118.051302:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:0.0:1788574118.051304:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361002368:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788574118.051307:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574118.051315:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2463
00000100:00080000:3.0:1788574118.051320:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574118.051325:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574118.051329:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361002496:192.168.202.140@tcp:38:kworker.0
00000008:00100000:3.0:1788574118.051333:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574118.051351:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644fb80 x1875453361002880/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1788574118.051357:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574118.051372:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574118/real 1788574118]  req@ffff8dc00644df80 x1875453361002496/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574143 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574118.051377:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574118.051386:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574118.051389:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788574118.051393:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644df80 x1875453361002496/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574143 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574118.051397:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2463
00000100:00080000:3.0:1788574118.051403:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574118.051409:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574118.051409:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:0.0:1788574118.051416:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000008:00100000:3.0:1788574118.051416:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574118.051420:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361002496:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574118.051427:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361002624:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574118.051432:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ed80 x1875453361003008/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574118.051440:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574118.051442:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574118.051445:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1788574118.051446:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788574118.051450:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2463
00000100:00080000:3.0:1788574118.051454:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788574118.051459:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574118/real 1788574118]  req@ffff8dc00644f100 x1875453361002624/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574143 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574118.051459:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574118.051466:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574118.051479:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e300 x1875453361003136/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574118.051481:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f100 x1875453361002624/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574143 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574118.051510:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574118.051513:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574118.051517:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361002624:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574118.051522:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361002752:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574118.051536:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574118.051543:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574118/real 1788574118]  req@ffff8dc00644d880 x1875453361002752/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574143 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574118.051550:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d880 x1875453361002752/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574143 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574118.051556:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574118.051558:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574118.051560:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361002752:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574118.051569:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361002880:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574118.051580:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574118.051586:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574118/real 1788574118]  req@ffff8dc00644fb80 x1875453361002880/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574143 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574118.051593:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644fb80 x1875453361002880/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574143 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574118.051599:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574118.051601:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574118.051603:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361002880:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574118.051606:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361003008:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574118.051616:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574118.051621:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574118/real 1788574118]  req@ffff8dc00644ed80 x1875453361003008/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574143 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574118.051629:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ed80 x1875453361003008/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574143 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574118.051634:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574118.051636:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574118.051638:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361003008:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574118.051641:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361003136:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574118.051650:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574118.051655:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574118/real 1788574118]  req@ffff8dc00644e300 x1875453361003136/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574143 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574118.051662:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453361003136/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574143 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574118.051667:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574118.051669:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574118.051670:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361003136:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574118.434957:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574118.434979:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574118.434998:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574118.434999:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574118.435025:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574118.435091:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574119.074942:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574119.458972:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574119.458972:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574119.458985:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574119.459023:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574119.459036:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788574119.459157:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574120.098959:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574120.483005:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574120.483006:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574120.483036:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574120.483044:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574120.483071:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574120.483129:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574121.122943:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574121.506977:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574121.506977:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574121.507062:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574121.507087:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574121.507093:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788574121.507121:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574122.147020:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574122.531049:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574122.531050:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574122.531058:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574122.531091:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574122.531098:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574122.531172:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574123.170976:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788574123.171004:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574123.171016:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788574123.171021:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574123.171035:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2468
00000100:00080000:3.0:1788574123.171051:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574123.171061:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788574123.171116:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c700 x1875453361003264/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574123.171143:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574123.171146:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574123.171147:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574123.171150:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2468
00000100:00080000:3.0:1788574123.171154:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574123.171156:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574123.171167:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574123.171177:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e680 x1875453361003392/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574123.171184:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574123.171187:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574123.171189:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574123.171192:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2468
00000100:00080000:3.0:1788574123.171194:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574123.171200:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574123.171201:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361003264:192.168.202.140@tcp:250:kworker.0
00000008:00100000:3.0:1788574123.171205:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574123.171216:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d180 x1875453361003520/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574123.171224:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574123.171227:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574123.171229:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574123.171231:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2468
00000100:00080000:3.0:1788574123.171233:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574123.171235:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574123.171239:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574123.171252:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f480 x1875453361003648/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574123.171261:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574123.171265:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574123.171268:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574123.171272:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2468
00000100:00080000:3.0:1788574123.171277:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1788574123.171279:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788574123.171286:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574123.171293:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574123.171305:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c380 x1875453361003776/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574123.171312:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574123.171315:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574123.171316:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574123.171320:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2468
00000100:00080000:3.0:1788574123.171323:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574123.171326:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574123.171330:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574123.171338:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d500 x1875453361003904/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574123.171343:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574123/real 1788574123]  req@ffff8dc00644c700 x1875453361003264/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574148 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574123.171349:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574123.171357:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574123.171360:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574123.171365:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2468
00000100:00080000:3.0:1788574123.171368:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574123.171371:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574123.171374:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574123.171376:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453361003264/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574148 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574123.171384:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ea00 x1875453361004032/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574123.171391:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574123.171396:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574123.171400:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361003264:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788574123.171407:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361003392:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574123.171431:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574123.171443:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574123/real 1788574123]  req@ffff8dc00644e680 x1875453361003392/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574148 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574123.171452:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453361003392/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574148 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574123.171460:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574123.171462:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574123.171466:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361003392:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574123.171498:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361003520:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574123.171524:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574123.171558:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574123/real 1788574123]  req@ffff8dc00644d180 x1875453361003520/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574148 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574123.171572:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453361003520/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574148 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574123.171586:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574123.171590:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574123.171593:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361003520:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574123.171601:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361003648:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574123.171625:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574123.171639:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574123/real 1788574123]  req@ffff8dc00644f480 x1875453361003648/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574148 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574123.171666:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453361003648/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574148 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574123.171675:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574123.171678:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574123.171681:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361003648:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574123.171687:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361003776:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574123.171706:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574123.171718:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574123/real 1788574123]  req@ffff8dc00644c380 x1875453361003776/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574148 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574123.171730:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453361003776/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574148 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574123.171738:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574123.171741:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574123.171746:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361003776:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574123.171758:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361003904:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574123.171785:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574123.171808:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574123/real 1788574123]  req@ffff8dc00644d500 x1875453361003904/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574148 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574123.171823:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d500 x1875453361003904/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574148 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574123.171834:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574123.171837:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574123.171842:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361003904:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574123.171851:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361004032:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574123.171952:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574123.171967:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574123/real 1788574123]  req@ffff8dc00644ea00 x1875453361004032/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574148 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574123.171977:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ea00 x1875453361004032/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574148 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574123.171983:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574123.171986:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574123.171989:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361004032:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574123.555028:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574123.555086:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574123.555089:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574123.555089:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574123.555092:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788574123.555205:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574124.195077:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574124.579033:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574124.579040:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574124.579045:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574124.579053:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574124.579093:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574124.579137:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574125.218981:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574125.602984:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574125.602985:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574125.603025:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574125.603025:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574125.603066:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788574125.603141:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574126.242973:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574126.627010:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574126.627014:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574126.627014:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574126.627015:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574126.627084:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574126.627116:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574127.266999:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574127.651021:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574127.651033:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574127.651039:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574127.651051:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574127.651081:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788574127.651153:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574128.290984:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574128.290994:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574128.291003:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788574128.291008:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574128.291023:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2473
00000100:00080000:1.0:1788574128.291034:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574128.291043:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574128.291091:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361004160/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574128.291120:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574128.291124:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574128.291125:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574128.291128:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2473
00000100:00080000:1.0:1788574128.291131:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574128.291134:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574128.291144:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574128.291157:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361004288/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574128.291167:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574128.291171:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574128.291176:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788574128.291178:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361004160:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574128.291184:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2473
00000100:00080000:1.0:1788574128.291202:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574128.291208:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574128.291214:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574128.291231:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361004416/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574128.291238:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574128.291241:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574128.291243:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574128.291245:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2473
00000100:00080000:1.0:1788574128.291254:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574128.291257:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574128.291260:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788574128.291262:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574128.291272:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361004544/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574128.291281:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574128.291284:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574128.291286:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574128.291290:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2473
00000100:00080000:1.0:1788574128.291294:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574128.291298:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574128.291303:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574128.291308:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574128/real 1788574128]  req@ffff8dc005dc0a80 x1875453361004160/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574153 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574128.291315:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361004672/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574128.291357:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574128.291361:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574128.291363:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788574128.291369:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361004160/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574153 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574128.291374:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2473
00000100:00080000:1.0:1788574128.291390:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574128.291393:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574128.291399:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:0.0:1788574128.291405:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000008:00100000:1.0:1788574128.291406:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574128.291416:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361004160:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788574128.291421:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361004800/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574128.291440:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574128.291442:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574128.291443:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574128.291446:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2473
00000100:00080000:1.0:1788574128.291450:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574128.291452:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574128.291455:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574128.291462:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361004928/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574128.291468:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361004288:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574128.291504:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574128.291516:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574128/real 1788574128]  req@ffff8dc005dc2d80 x1875453361004288/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574153 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574128.291526:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361004288/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574153 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574128.291534:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574128.291536:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574128.291538:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361004288:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574128.291543:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361004416:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574128.291557:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574128.291563:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574128/real 1788574128]  req@ffff8dc005dc3800 x1875453361004416/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574153 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574128.291571:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361004416/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574153 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574128.291577:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574128.291579:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574128.291581:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361004416:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574128.291585:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361004544:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574128.291596:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574128.291602:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574128/real 1788574128]  req@ffff8dc005dc1c00 x1875453361004544/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574153 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574128.291609:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361004544/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574153 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574128.291615:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574128.291618:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574128.291621:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361004544:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574128.291628:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361004672:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574128.291649:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574128.291661:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574128/real 1788574128]  req@ffff8dc005dc1500 x1875453361004672/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574153 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574128.291674:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361004672/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574153 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574128.291682:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574128.291684:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574128.291686:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361004672:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574128.291691:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361004800:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574128.291709:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574128.291717:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574128/real 1788574128]  req@ffff8dc005dc3b80 x1875453361004800/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574153 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574128.291732:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361004800/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574153 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574128.291739:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574128.291741:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574128.291744:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361004800:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574128.291759:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361004928:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574128.291787:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574128.291797:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574128/real 1788574128]  req@ffff8dc005dc1180 x1875453361004928/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574153 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574128.291805:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361004928/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574153 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574128.291810:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574128.291813:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574128.291815:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361004928:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574128.675016:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574128.675027:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574128.675029:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574128.675030:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574128.675098:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574128.675104:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574129.314993:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574129.698982:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574129.699002:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574129.699004:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574129.699045:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574129.699051:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574129.699061:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574130.338997:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574130.723015:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574130.723015:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574130.723016:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574130.723041:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574130.723070:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574130.723096:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574131.362990:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574131.747002:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574131.747003:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574131.747010:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574131.747010:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574131.747049:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574131.747103:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574132.387029:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574132.770980:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574132.770980:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574132.770982:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574132.771013:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574132.771041:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574132.771088:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574133.410975:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788574133.410987:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574133.410994:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788574133.410999:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574133.411010:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2479
00000100:00080000:2.0:1788574133.411023:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574133.411031:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574133.411076:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361005056/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574133.411102:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574133.411105:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574133.411106:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574133.411109:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2479
00000100:00080000:2.0:1788574133.411112:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574133.411116:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574133.411130:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574133.411139:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361005056:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788574133.411147:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453361005184/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574133.411160:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574133.411164:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574133.411166:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574133.411171:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2479
00000100:00080000:2.0:1788574133.411175:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574133.411179:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574133.411184:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574133.411195:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453361005312/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574133.411202:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574133.411205:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574133.411206:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574133.411209:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2479
00000100:00080000:2.0:1788574133.411212:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1788574133.411217:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788574133.411219:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574133.411224:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574133.411233:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453361005440/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574133.411240:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574133.411243:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574133.411244:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574133.411246:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2479
00000100:00080000:2.0:1788574133.411249:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574133.411251:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574133.411254:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574133.411263:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361005568/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574133.411268:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574133/real 1788574133]  req@ffff8dc020494700 x1875453361005056/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574158 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574133.411276:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574133.411285:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574133.411288:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574133.411296:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2479
00000100:00080000:2.0:1788574133.411299:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574133.411302:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574133.411306:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361005056/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574158 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1788574133.411308:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1788574133.411322:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1788574133.411323:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453361005696/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574133.411331:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788574133.411338:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788574133.411339:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361005056:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788574133.411345:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574133.411348:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574133.411352:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2479
00000100:00080000:2.0:1788574133.411354:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574133.411357:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574133.411359:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574133.411367:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361005824/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574133.411369:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361005184:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574133.411395:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574133.411406:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574133/real 1788574133]  req@ffff8dc020494380 x1875453361005184/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574158 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574133.411414:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453361005184/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574158 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574133.411422:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574133.411425:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574133.411427:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361005184:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574133.411431:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361005312:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574133.411444:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574133.411450:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574133/real 1788574133]  req@ffff8dc020494e00 x1875453361005312/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574158 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574133.411458:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453361005312/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574158 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574133.411468:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574133.411471:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574133.411473:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361005312:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574133.411476:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361005440:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574133.411486:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574133.411492:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574133/real 1788574133]  req@ffff8dc020497100 x1875453361005440/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574158 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574133.411499:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453361005440/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574158 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574133.411506:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574133.411508:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574133.411509:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361005440:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574133.411513:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361005568:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574133.411523:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574133.411529:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574133/real 1788574133]  req@ffff8dc020495500 x1875453361005568/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574158 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574133.411537:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361005568/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574158 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574133.411543:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574133.411544:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574133.411547:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361005568:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574133.411551:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361005696:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574133.411562:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574133.411567:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574133/real 1788574133]  req@ffff8dc020496a00 x1875453361005696/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574158 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574133.411574:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453361005696/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574158 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574133.411579:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574133.411581:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574133.411583:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361005696:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574133.411595:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361005824:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574133.411606:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574133.411612:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574133/real 1788574133]  req@ffff8dc020494700 x1875453361005824/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574158 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574133.411646:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361005824/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574158 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574133.411652:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574133.411655:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574133.411657:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361005824:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574133.795009:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574133.795009:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574133.795032:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574133.795048:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574133.795053:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574133.795136:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574134.434948:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574134.818948:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574134.818948:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574134.818977:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574134.818998:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574134.819010:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788574134.819017:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574135.459012:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574135.843018:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574135.843019:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574135.843029:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574135.843051:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574135.843063:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574135.843065:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574136.483018:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574136.866996:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574136.866999:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574136.867034:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574136.867036:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574136.867078:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788574136.867145:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574137.506992:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574137.890944:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574137.890948:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574137.890958:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574137.890970:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574137.890974:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574137.891035:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574138.531008:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574138.531009:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574138.531020:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788574138.531024:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574138.531034:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2484
00000100:00080000:0.0:1788574138.531046:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574138.531053:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574138.531091:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361005952/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574138.531127:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574138.531132:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574138.531134:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574138.531138:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2484
00000100:00080000:0.0:1788574138.531142:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574138.531147:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574138.531158:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574138.531173:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361006080/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574138.531176:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361005952:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788574138.531193:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574138.531197:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574138.531199:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574138.531205:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2484
00000100:00080000:0.0:1788574138.531209:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574138.531213:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574138.531219:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574138.531232:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361006208/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788574138.531235:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788574138.531248:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574138.531252:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574138.531255:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574138.531259:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2484
00000100:00080000:0.0:1788574138.531263:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574138.531268:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574138.531274:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574138.531275:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574138/real 1788574138]  req@ffff8dc006711880 x1875453361005952/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574163 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574138.531290:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361006336/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574138.531309:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788574138.531314:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361005952/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574163 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574138.531316:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574138.531320:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574138.531331:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2484
00000100:00080000:1.0:1788574138.531331:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574138.531336:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574138.531339:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788574138.531346:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574138.531347:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361005952:192.168.202.140@tcp:250:kworker.0
00000008:00100000:0.0:1788574138.531366:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574138.531369:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361006080:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574138.531386:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361006464/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788574138.531392:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574138.531404:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574138/real 1788574138]  req@ffff8dc006713100 x1875453361006080/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574163 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574138.531406:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574138.531417:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574138.531422:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1788574138.531425:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361006080/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574163 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574138.531431:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2484
00000100:00080000:1.0:1788574138.531438:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574138.531439:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574138.531443:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788574138.531449:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574138.531450:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361006080:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574138.531476:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361006208:192.168.202.140@tcp:8:kworker.0
00000008:00100000:0.0:1788574138.531490:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1788574138.531496:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574138.531508:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574138/real 1788574138]  req@ffff8dc006712300 x1875453361006208/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574163 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574138.531513:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361006592/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574138.531525:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361006208/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574163 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574138.531531:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574138.531537:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574138.531539:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574138.531543:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574138.531545:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2484
00000100:00080000:1.0:1788574138.531549:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788574138.531552:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788574138.531554:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361006208:192.168.202.140@tcp:8:kworker.0
00000100:00080000:0.0:1788574138.531563:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574138.531564:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361006336:192.168.202.140@tcp:8:kworker.0
00000008:00100000:0.0:1788574138.531573:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1788574138.531587:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574138.531591:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361006720/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574138.531600:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574138/real 1788574138]  req@ffff8dc006710e00 x1875453361006336/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574163 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574138.531619:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361006336/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574163 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574138.531626:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574138.531629:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574138.531660:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361006336:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574138.531673:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361006464:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574138.531686:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574138.531693:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574138/real 1788574138]  req@ffff8dc006713b80 x1875453361006464/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574163 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574138.531701:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361006464/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574163 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574138.531707:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574138.531709:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574138.531711:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361006464:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574138.531715:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361006592:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574138.531725:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574138.531730:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574138/real 1788574138]  req@ffff8dc006713800 x1875453361006592/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574163 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574138.531742:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361006592/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574163 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574138.531747:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574138.531749:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574138.531751:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361006592:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574138.531754:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361006720:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574138.531764:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574138.531770:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574138/real 1788574138]  req@ffff8dc006711880 x1875453361006720/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574163 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574138.531777:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361006720/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574163 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574138.531782:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574138.531783:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574138.531785:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361006720:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574138.914963:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574138.915032:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574138.915053:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574138.915063:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574138.915090:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574138.915123:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574139.554933:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574139.938959:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574139.938959:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574139.938965:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574139.938966:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574139.938993:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574139.939032:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574140.578955:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574140.963029:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574140.963029:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574140.963046:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574140.963046:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574140.963083:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574140.963144:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574141.603009:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574141.986986:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574141.986987:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574141.987002:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574141.987019:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574141.987032:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788574141.987043:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574142.626964:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574143.010942:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574143.010958:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574143.010965:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574143.010969:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574143.010989:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788574143.011054:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1788574143.650975:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788574143.650976:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574143.650986:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788574143.650990:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574143.650999:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2489
00000100:00080000:1.0:1788574143.651007:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574143.651013:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574143.651043:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361006848/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574143.651066:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574143.651068:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574143.651070:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574143.651072:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2489
00000100:00080000:1.0:1788574143.651074:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574143.651077:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574143.651084:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574143.651094:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361006976/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574143.651101:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574143.651104:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574143.651105:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574143.651108:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2489
00000100:00080000:1.0:1788574143.651110:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574143.651114:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574143.651115:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361006848:192.168.202.140@tcp:250:kworker.0
00000008:00100000:1.0:1788574143.651117:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574143.651128:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361007104/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574143.651136:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574143.651138:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574143.651140:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574143.651142:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2489
00000100:00080000:1.0:1788574143.651143:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574143.651146:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574143.651149:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574143.651160:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361007232/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574143.651166:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574143.651169:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574143.651170:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574143.651172:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2489
00000100:00080000:1.0:1788574143.651175:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1788574143.651179:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788574143.651184:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574143.651188:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574143.651196:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361007360/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574143.651203:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574143.651205:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574143.651207:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574143.651209:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2489
00000100:00080000:1.0:1788574143.651213:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574143.651215:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574143.651219:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574143.651224:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574143/real 1788574143]  req@ffff8dc005dc0700 x1875453361006848/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574168 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574143.651228:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361007488/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574143.651255:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574143.651258:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574143.651260:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574143.651263:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2489
00000100:00080000:1.0:1788574143.651265:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574143.651270:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574143.651272:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361006848/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574168 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1788574143.651273:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574143.651284:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361007616/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574143.651286:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574143.651295:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574143.651300:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361006848:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788574143.651323:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361006976:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574143.651351:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574143.651363:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574143/real 1788574143]  req@ffff8dc005dc1180 x1875453361006976/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574168 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574143.651372:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361006976/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574168 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574143.651379:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574143.651382:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574143.651384:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361006976:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574143.651401:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361007104:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574143.651415:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574143.651422:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574143/real 1788574143]  req@ffff8dc005dc3b80 x1875453361007104/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574168 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574143.651434:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361007104/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574168 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574143.651440:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574143.651442:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574143.651445:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361007104:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574143.651448:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361007232:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574143.651458:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574143.651464:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574143/real 1788574143]  req@ffff8dc005dc1500 x1875453361007232/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574168 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574143.651471:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361007232/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574168 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574143.651477:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574143.651479:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574143.651481:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361007232:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574143.651484:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361007360:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574143.651494:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574143.651500:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574143/real 1788574143]  req@ffff8dc005dc1c00 x1875453361007360/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574168 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574143.651508:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361007360/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574168 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574143.651518:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574143.651520:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574143.651522:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361007360:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574143.651525:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361007488:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574143.651535:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574143.651540:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574143/real 1788574143]  req@ffff8dc005dc3800 x1875453361007488/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574168 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574143.651547:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361007488/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574168 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574143.651552:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574143.651553:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574143.651555:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361007488:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574143.651559:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361007616:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574143.651568:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574143.651573:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574143/real 1788574143]  req@ffff8dc005dc2d80 x1875453361007616/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574168 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574143.651581:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361007616/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574168 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574143.651585:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574143.651587:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574143.651590:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361007616:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574144.034962:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574144.034963:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574144.034965:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574144.034973:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574144.035015:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788574144.035048:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574144.674950:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574145.058944:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574145.058946:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574145.058983:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574145.058997:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788574145.059000:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574145.059009:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574145.698971:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574146.082950:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574146.082954:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574146.082962:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574146.082965:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574146.082987:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788574146.083052:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574146.722917:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574147.106969:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574147.106973:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574147.106982:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574147.106999:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574147.107007:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574147.107021:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574147.746968:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574148.130955:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574148.130960:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574148.130985:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574148.130999:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574148.131013:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788574148.131068:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574148.770973:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788574148.770974:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574148.770983:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788574148.770987:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574148.770995:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2494
00000100:00080000:3.0:1788574148.771004:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574148.771011:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788574148.771049:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ce00 x1875453361007744/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574148.771076:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574148.771080:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574148.771082:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574148.771087:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2494
00000100:00080000:3.0:1788574148.771091:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574148.771097:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574148.771108:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574148.771124:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644dc00 x1875453361007872/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574148.771137:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788574148.771140:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361007744:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788574148.771143:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574148.771147:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574148.771166:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2494
00000100:00080000:3.0:1788574148.771169:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574148.771172:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574148.771177:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574148.771190:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c000 x1875453361008000/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574148.771198:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574148.771200:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574148.771202:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574148.771205:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2494
00000100:00080000:3.0:1788574148.771207:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574148.771210:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574148.771213:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574148.771221:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f800 x1875453361008128/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574148.771230:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1788574148.771231:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788574148.771237:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574148.771247:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574148.771253:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2494
00000100:00080000:3.0:1788574148.771257:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574148.771262:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574148.771268:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574148.771280:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574148/real 1788574148]  req@ffff8dc00644ce00 x1875453361007744/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574173 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574148.771294:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ca80 x1875453361008256/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574148.771306:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ce00 x1875453361007744/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574173 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574148.771307:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574148.771316:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574148.771319:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574148.771328:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2494
00000100:00080000:3.0:1788574148.771333:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574148.771334:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574148.771337:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:0.0:1788574148.771343:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000008:00100000:3.0:1788574148.771344:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574148.771352:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361007744:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788574148.771358:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ea00 x1875453361008384/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574148.771366:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574148.771368:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574148.771370:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574148.771372:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2494
00000100:00080000:3.0:1788574148.771374:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574148.771376:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574148.771379:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574148.771384:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361007872:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574148.771389:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d500 x1875453361008512/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1788574148.771420:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574148.771435:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574148/real 1788574148]  req@ffff8dc00644dc00 x1875453361007872/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574173 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574148.771449:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644dc00 x1875453361007872/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574173 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574148.771461:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574148.771465:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574148.771471:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361007872:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574148.771479:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361008000:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574148.771502:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574148.771514:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574148/real 1788574148]  req@ffff8dc00644c000 x1875453361008000/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574173 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574148.771527:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c000 x1875453361008000/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574173 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574148.771537:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574148.771540:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574148.771544:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361008000:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574148.771551:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361008128:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574148.771570:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574148.771582:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574148/real 1788574148]  req@ffff8dc00644f800 x1875453361008128/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574173 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574148.771594:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f800 x1875453361008128/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574173 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574148.771603:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574148.771607:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574148.771611:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361008128:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574148.771618:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361008256:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574148.771638:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574148.771649:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574148/real 1788574148]  req@ffff8dc00644ca80 x1875453361008256/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574173 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574148.771662:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ca80 x1875453361008256/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574173 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574148.771671:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574148.771674:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574148.771678:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361008256:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574148.771684:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361008384:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574148.771703:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574148.771713:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574148/real 1788574148]  req@ffff8dc00644ea00 x1875453361008384/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574173 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574148.771726:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ea00 x1875453361008384/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574173 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574148.771734:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574148.771738:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574148.771742:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361008384:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574148.771761:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361008512:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574148.771783:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574148.771794:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574148/real 1788574148]  req@ffff8dc00644d500 x1875453361008512/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574173 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574148.771814:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d500 x1875453361008512/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574173 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574148.771823:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574148.771826:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574148.771830:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361008512:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574149.154972:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574149.154975:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574149.154996:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574149.155095:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574149.155095:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574149.155102:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574149.794975:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574150.178948:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574150.178951:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574150.178966:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574150.178967:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574150.178999:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788574150.179053:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574150.818940:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574151.202991:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574151.202991:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574151.203008:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574151.203034:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574151.203035:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574151.203055:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574151.843050:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574152.226965:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574152.226966:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574152.226967:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788574152.227003:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574152.227003:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574152.227015:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574152.867016:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574153.250992:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574153.251044:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574153.251046:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574153.251046:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574153.251079:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574153.251141:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1788574153.890966:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788574153.890969:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788574153.890979:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788574153.890984:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574153.891009:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2499
00000100:00080000:3.0:1788574153.891018:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574153.891025:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788574153.891059:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c380 x1875453361008640/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574153.891082:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574153.891086:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574153.891087:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574153.891090:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2499
00000100:00080000:3.0:1788574153.891092:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574153.891095:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574153.891103:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574153.891112:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f480 x1875453361008768/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574153.891120:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574153.891122:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574153.891124:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574153.891126:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2499
00000100:00080000:3.0:1788574153.891128:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574153.891130:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574153.891133:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574153.891143:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361008640:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788574153.891144:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d180 x1875453361008896/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574153.891157:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574153.891159:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574153.891160:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574153.891162:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2499
00000100:00080000:3.0:1788574153.891164:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574153.891167:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574153.891170:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574153.891179:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e680 x1875453361009024/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574153.891186:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574153.891188:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574153.891189:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574153.891192:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2499
00000100:00080000:3.0:1788574153.891194:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574153.891196:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574153.891200:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574153.891207:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c700 x1875453361009152/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574153.891213:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574153.891216:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574153.891217:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574153.891220:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2499
00000100:00080000:3.0:1788574153.891222:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574153.891224:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574153.891227:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574153.891234:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e300 x1875453361009280/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574153.891241:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788574153.891244:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361008768:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788574153.891245:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574153.891249:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574153.891254:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2499
00000100:00080000:3.0:1788574153.891257:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574153.891259:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574153.891263:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574153.891272:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ed80 x1875453361009408/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574153.891284:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361008896:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574153.891302:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361009024:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574153.891317:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361009152:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574153.891329:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361009280:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574153.891341:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361009408:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574154.274934:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574154.274934:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574154.274956:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788574154.275004:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574154.275004:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574154.275005:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574154.915011:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574155.298980:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574155.298980:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574155.298993:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574155.299002:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574155.299020:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574155.299022:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574155.939094:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574156.323022:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574156.323022:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574156.323023:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574156.323062:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788574156.323109:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574156.323112:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574156.963237:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000400:00000100:0.0:1788574156.963258:0:2335:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.140:988
00000400:00000100:0.0:1788574156.963318:0:2335:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.140@tcp at host 192.168.202.140 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:0.0:1788574156.963336:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:0.0:1788574156.963380:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:0.0:1788574156.963393:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:0.0:1788574156.963405:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:0.0:1788574156.963417:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:1.0:1788574156.963418:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574153/real 1788574156]  req@ffff8dc00644c380 x1875453361008640/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574178 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:0.0:1788574156.963430:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:0.0:1788574156.963446:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:1.0:1788574156.963462:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453361008640/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574178 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574156.963479:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574156.963486:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574156.963491:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361008640:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788574156.963500:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574153/real 1788574156]  req@ffff8dc00644f480 x1875453361008768/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574178 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574156.963516:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453361008768/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574178 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574156.963536:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574156.963542:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574156.963545:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361008768:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574156.963576:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574153/real 1788574156]  req@ffff8dc00644d180 x1875453361008896/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574178 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574156.963592:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453361008896/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574178 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574156.963602:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574156.963607:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574156.963611:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361008896:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574156.963619:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574153/real 1788574156]  req@ffff8dc00644e680 x1875453361009024/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574178 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574156.963634:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453361009024/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574178 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574156.963645:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574156.963649:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574156.963652:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361009024:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574156.963660:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574153/real 1788574156]  req@ffff8dc00644c700 x1875453361009152/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574178 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574156.963673:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453361009152/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574178 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574156.963685:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574156.963689:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574156.963693:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361009152:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574156.963702:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574153/real 1788574156]  req@ffff8dc00644e300 x1875453361009280/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574178 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574156.963716:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453361009280/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574178 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574156.963726:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574156.963731:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574156.963734:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361009280:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574156.963742:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574153/real 1788574156]  req@ffff8dc00644ed80 x1875453361009408/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574178 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574156.963755:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ed80 x1875453361009408/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574178 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574156.963763:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574156.963767:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574156.963770:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361009408:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574157.347016:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574157.347063:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574157.347064:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574157.347071:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574157.347094:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574157.347110:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574157.987041:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574158.370966:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574158.370966:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574158.370966:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574158.370967:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574158.370996:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788574158.371066:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1788574159.010970:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574159.010979:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788574159.010983:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574159.010992:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2504
00000100:00100000:1.0:1788574159.010993:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788574159.011003:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574159.011011:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788574159.011044:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644fb80 x1875453361009536/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574159.011069:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574159.011072:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574159.011073:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574159.011077:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2504
00000100:00080000:3.0:1788574159.011080:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574159.011085:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574159.011097:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574159.011114:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361009536:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788574159.011123:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d880 x1875453361009664/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574159.011138:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574159.011142:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574159.011144:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574159.011149:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2504
00000100:00080000:3.0:1788574159.011154:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574159.011160:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574159.011167:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574159.011184:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f100 x1875453361009792/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788574159.011186:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788574159.011201:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574159.011205:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574159.011208:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574159.011213:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2504
00000100:00080000:3.0:1788574159.011218:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574159.011222:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574159.011230:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574159.011237:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574159/real 1788574159]  req@ffff8dc00644fb80 x1875453361009536/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574184 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574159.011245:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644df80 x1875453361009920/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574159.011260:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574159.011264:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:1.0:1788574159.011267:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644fb80 x1875453361009536/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574184 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574159.011268:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574159.011278:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2504
00000100:00080000:3.0:1788574159.011285:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574159.011289:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574159.011294:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1788574159.011306:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1788574159.011308:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ed80 x1875453361010048/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574159.011316:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788574159.011326:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788574159.011327:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361009536:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788574159.011334:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574159.011338:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574159.011344:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2504
00000100:00080000:3.0:1788574159.011353:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574159.011359:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574159.011364:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574159.011365:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361009664:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574159.011380:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e300 x1875453361010176/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574159.011391:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574159.011395:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574159.011397:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1788574159.011403:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788574159.011404:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2504
00000100:00080000:3.0:1788574159.011412:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574159.011417:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574159.011423:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574159.011428:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574159/real 1788574159]  req@ffff8dc00644d880 x1875453361009664/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574184 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574159.011439:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c700 x1875453361010304/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574159.011446:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d880 x1875453361009664/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574184 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574159.011465:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574159.011469:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574159.011473:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361009664:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574159.011481:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361009792:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574159.011521:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574159.011535:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574159/real 1788574159]  req@ffff8dc00644f100 x1875453361009792/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574184 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574159.011555:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f100 x1875453361009792/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574184 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574159.011566:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574159.011569:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574159.011572:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361009792:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574159.011578:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361009920:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574159.011602:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574159.011614:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574159/real 1788574159]  req@ffff8dc00644df80 x1875453361009920/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574184 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574159.011627:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644df80 x1875453361009920/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574184 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574159.011636:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574159.011640:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574159.011644:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361009920:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574159.011650:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361010048:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574159.011672:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574159.011684:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574159/real 1788574159]  req@ffff8dc00644ed80 x1875453361010048/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574184 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574159.011696:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ed80 x1875453361010048/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574184 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574159.011712:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574159.011715:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574159.011719:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361010048:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574159.011738:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361010176:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574159.011760:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574159.011773:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574159/real 1788574159]  req@ffff8dc00644e300 x1875453361010176/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574184 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574159.011786:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453361010176/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574184 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574159.011794:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574159.011798:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574159.011801:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361010176:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574159.011808:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361010304:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574159.011829:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574159.011908:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574159/real 1788574159]  req@ffff8dc00644c700 x1875453361010304/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574184 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574159.011923:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453361010304/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574184 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574159.011934:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574159.011938:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574159.011943:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361010304:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574159.394982:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574159.394982:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574159.394987:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574159.395012:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574159.395014:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574159.395027:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574160.035073:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574160.418942:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574160.418964:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574160.418969:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574160.418975:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574160.418997:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788574160.419023:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574161.058954:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574161.442948:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574161.442948:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574161.442950:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574161.442951:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574161.442977:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788574161.443040:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574162.082969:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574162.466971:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574162.466983:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574162.467000:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574162.467019:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574162.467021:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788574162.467036:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574163.107015:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574163.491019:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574163.491021:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574163.491030:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574163.491055:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574163.491078:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574163.491089:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574164.130944:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574164.131007:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574164.131016:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788574164.131021:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574164.131031:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2509
00000100:00080000:0.0:1788574164.131043:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574164.131051:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574164.131097:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361010432/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574164.131124:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574164.131127:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574164.131129:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574164.131141:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2509
00000100:00080000:0.0:1788574164.131146:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574164.131151:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574164.131163:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361010432:192.168.202.140@tcp:250:kworker.0
00000008:00100000:0.0:1788574164.131164:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574164.131185:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453361010560/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574164.131198:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574164.131201:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574164.131202:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574164.131206:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2509
00000100:00080000:0.0:1788574164.131210:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574164.131213:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574164.131218:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574164.131228:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361010688/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574164.131241:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1788574164.131243:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788574164.131244:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574164.131248:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574164.131252:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2509
00000100:00080000:0.0:1788574164.131254:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574164.131257:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574164.131267:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574164.131278:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361010816/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574164.131285:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574164.131288:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574164.131289:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574164.131293:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2509
00000100:00100000:1.0:1788574164.131297:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574164/real 1788574164]  req@ffff8dc006712a00 x1875453361010432/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574189 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574164.131303:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574164.131311:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574164.131318:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574164.131328:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361010944/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574164.131335:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788574164.131337:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361010432/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574189 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574164.131339:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574164.131342:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574164.131349:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2509
00000100:00080000:0.0:1788574164.131355:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574164.131362:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:1.0:1788574164.131366:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1788574164.131367:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1788574164.131376:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574164.131380:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361011072/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574164.131385:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361010432:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788574164.131397:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574164.131400:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574164.131402:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574164.131405:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2509
00000100:00080000:0.0:1788574164.131407:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574164.131410:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574164.131413:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574164.131417:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361010560:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574164.131423:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361011200/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788574164.131443:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574164.131456:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574164/real 1788574164]  req@ffff8dc006710380 x1875453361010560/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574189 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574164.131467:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453361010560/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574189 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574164.131475:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574164.131494:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574164.131496:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361010560:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574164.131501:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361010688:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574164.131523:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574164.131536:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574164/real 1788574164]  req@ffff8dc006712680 x1875453361010688/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574189 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574164.131550:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361010688/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574189 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574164.131560:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574164.131564:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574164.131567:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361010688:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574164.131575:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361010816:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574164.131597:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574164.131610:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574164/real 1788574164]  req@ffff8dc006713480 x1875453361010816/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574189 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574164.131623:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361010816/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574189 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574164.131634:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574164.131638:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574164.131642:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361010816:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574164.131649:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361010944:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574164.131669:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574164.131733:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574164/real 1788574164]  req@ffff8dc006711c00 x1875453361010944/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574189 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574164.131748:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361010944/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574189 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574164.131765:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574164.131768:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574164.131788:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361010944:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574164.131794:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361011072:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574164.131816:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574164.131829:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574164/real 1788574164]  req@ffff8dc006711500 x1875453361011072/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574189 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574164.131858:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361011072/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574189 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574164.131867:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574164.131871:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574164.131875:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361011072:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574164.131938:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361011200:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574164.131958:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574164.131971:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574164/real 1788574164]  req@ffff8dc006712a00 x1875453361011200/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574189 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574164.131984:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361011200/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574189 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574164.131992:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574164.131996:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574164.131999:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361011200:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574164.514989:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574164.515007:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574164.515012:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574164.515032:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574164.515048:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788574164.515098:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574165.155015:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574165.539002:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574165.539002:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574165.539002:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574165.539002:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574165.539039:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574165.539077:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574166.178933:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574166.562996:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574166.562996:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788574166.563034:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574166.563036:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574166.563039:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574166.563050:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574167.203019:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574167.586987:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574167.586987:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574167.587036:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574167.587046:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574167.587055:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574167.587064:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574168.226944:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574168.611024:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574168.611025:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574168.611041:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788574168.611073:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574168.611073:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574168.611097:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574169.250985:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788574169.250991:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574169.251000:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788574169.251005:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574169.251016:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2514
00000100:00080000:0.0:1788574169.251028:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574169.251036:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574169.251088:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361011328/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574169.251120:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574169.251123:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574169.251125:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574169.251128:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2514
00000100:00080000:0.0:1788574169.251130:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574169.251133:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574169.251143:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574169.251152:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361011456/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574169.251160:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574169.251162:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574169.251163:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574169.251166:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2514
00000100:00080000:0.0:1788574169.251169:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574169.251172:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574169.251175:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574169.251182:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361011584/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574169.251188:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574169.251191:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574169.251193:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574169.251196:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2514
00000100:00080000:0.0:1788574169.251199:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574169.251202:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574169.251205:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574169.251213:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361011328:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788574169.251216:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361011712/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574169.251242:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574169.251244:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574169.251245:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574169.251248:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2514
00000100:00080000:0.0:1788574169.251250:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574169.251253:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574169.251256:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574169.251264:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361011840/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574169.251271:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574169.251273:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574169.251275:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574169.251278:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2514
00000100:00080000:0.0:1788574169.251296:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574169.251299:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574169.251304:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1788574169.251312:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574169.251324:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361011968/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574169.251338:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574169.251343:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574169.251345:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574169.251353:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2514
00000100:00080000:0.0:1788574169.251358:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574169.251366:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574169.251368:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574169/real 1788574169]  req@ffff8dc006711880 x1875453361011328/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574194 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1788574169.251375:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574169.251398:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361012096/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574169.251407:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361011328/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574194 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574169.251428:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574169.251434:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574169.251440:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361011328:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788574169.251451:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361011456:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574169.251496:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574169.251522:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574169/real 1788574169]  req@ffff8dc006713800 x1875453361011456/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574194 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574169.251537:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361011456/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574194 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574169.251548:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574169.251552:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574169.251556:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361011456:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574169.251564:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361011584:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574169.251586:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574169.251598:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574169/real 1788574169]  req@ffff8dc006713b80 x1875453361011584/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574194 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574169.251612:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361011584/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574194 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574169.251622:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574169.251626:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574169.251629:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361011584:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574169.251666:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361011712:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574169.251688:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574169.251700:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574169/real 1788574169]  req@ffff8dc006710e00 x1875453361011712/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574194 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574169.251715:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361011712/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574194 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574169.251724:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574169.251726:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574169.251729:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361011712:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574169.251733:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361011840:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574169.251756:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574169.251765:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574169/real 1788574169]  req@ffff8dc006712300 x1875453361011840/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574194 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574169.251773:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361011840/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574194 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574169.251779:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574169.251781:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574169.251783:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361011840:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574169.251787:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361011968:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574169.251798:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574169.251804:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574169/real 1788574169]  req@ffff8dc006713100 x1875453361011968/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574194 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574169.251811:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361011968/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574194 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574169.251821:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574169.251823:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574169.251825:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361011968:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574169.251828:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361012096:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574169.251838:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574169.251844:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574169/real 1788574169]  req@ffff8dc006712a00 x1875453361012096/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574194 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574169.251851:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361012096/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574194 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574169.251856:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574169.251858:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574169.251860:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361012096:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574169.634983:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574169.634983:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574169.634989:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574169.634992:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574169.635040:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574169.635079:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574170.274984:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574170.659023:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574170.659033:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574170.659034:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574170.659034:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574170.659086:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788574170.659201:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574171.299003:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574171.682927:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574171.682958:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574171.682960:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574171.682974:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574171.682976:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574171.682990:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574172.322968:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574172.706995:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574172.707024:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574172.707032:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574172.707036:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574172.707066:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788574172.707153:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574173.346985:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574173.730988:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574173.730998:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574173.731004:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574173.731036:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574173.731046:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574173.731055:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00080000:2.0:1788574174.371012:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574174.371024:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:1.0:1788574174.371028:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788574174.371029:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574174.371043:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2520
00000100:00080000:2.0:1788574174.371056:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574174.371065:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574174.371114:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361012224/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574174.371144:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574174.371149:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574174.371151:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574174.371157:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2520
00000100:00080000:2.0:1788574174.371162:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574174.371167:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574174.371195:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574174.371204:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361012224:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788574174.371214:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361012352/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574174.371228:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574174.371233:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574174.371234:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574174.371238:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2520
00000100:00080000:2.0:1788574174.371241:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574174.371244:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574174.371250:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574174.371263:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361012480/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574174.371274:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574174.371278:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574174.371280:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574174.371284:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2520
00000100:00080000:2.0:1788574174.371290:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1788574174.371295:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788574174.371298:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574174.371317:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574174.371330:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453361012608/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574174.371337:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574174.371340:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574174.371341:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574174.371345:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2520
00000100:00080000:2.0:1788574174.371347:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574174.371351:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574174.371355:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574174.371364:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574174/real 1788574174]  req@ffff8dc020495880 x1875453361012224/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574199 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574174.371372:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453361012736/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574174.371396:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574174.371399:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574174.371400:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574174.371403:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2520
00000100:00080000:2.0:1788574174.371406:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574174.371411:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574174.371412:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361012224/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574199 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1788574174.371415:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574174.371429:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453361012864/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574174.371430:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574174.371440:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788574174.371445:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788574174.371448:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361012224:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788574174.371449:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574174.371453:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574174.371457:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2520
00000100:00080000:2.0:1788574174.371459:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574174.371462:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574174.371465:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574174.371472:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361012992/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574174.371487:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361012352:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574174.371510:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574174.371521:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574174/real 1788574174]  req@ffff8dc020494000 x1875453361012352/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574199 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574174.371530:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361012352/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574199 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574174.371539:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574174.371541:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574174.371544:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361012352:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574174.371549:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361012480:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574174.371562:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574174.371569:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574174/real 1788574174]  req@ffff8dc020495180 x1875453361012480/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574199 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574174.371577:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361012480/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574199 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574174.371588:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574174.371590:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574174.371593:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361012480:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574174.371596:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361012608:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574174.371607:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574174.371613:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574174/real 1788574174]  req@ffff8dc020497480 x1875453361012608/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574199 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574174.371621:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453361012608/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574199 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574174.371627:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574174.371630:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574174.371632:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361012608:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574174.371635:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361012736:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574174.371646:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574174.371652:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574174/real 1788574174]  req@ffff8dc020494a80 x1875453361012736/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574199 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574174.371659:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453361012736/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574199 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574174.371665:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574174.371667:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574174.371670:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361012736:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574174.371674:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361012864:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574174.371685:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574174.371691:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574174/real 1788574174]  req@ffff8dc020496d80 x1875453361012864/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574199 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574174.371698:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453361012864/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574199 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574174.371704:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574174.371706:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574174.371707:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361012864:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574174.371711:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361012992:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574174.371722:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574174.371727:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574174/real 1788574174]  req@ffff8dc020494700 x1875453361012992/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574199 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574174.371735:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361012992/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574199 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574174.371740:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574174.371742:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574174.371744:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361012992:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574174.754990:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574174.754999:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574174.755023:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788574174.755033:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574174.755046:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574174.755057:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574175.395008:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574175.779007:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574175.779013:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574175.779013:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574175.779018:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574175.779079:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788574175.779122:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574176.418947:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574176.803014:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574176.803014:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574176.803014:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574176.803015:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574176.803108:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574176.803129:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574177.443016:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574177.826985:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574177.826986:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574177.827007:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574177.827020:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574177.827050:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788574177.827077:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574178.466946:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574178.850994:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574178.850994:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574178.851031:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574178.851040:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574178.851063:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574178.851070:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574179.490995:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574179.491004:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788574179.491008:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1788574179.491016:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574179.491017:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2525
00000100:00080000:0.0:1788574179.491029:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574179.491038:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574179.491071:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361013120/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574179.491093:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574179.491096:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574179.491098:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574179.491100:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2525
00000100:00080000:0.0:1788574179.491103:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574179.491105:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574179.491113:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574179.491123:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361013248/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574179.491131:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574179.491133:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574179.491135:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574179.491137:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2525
00000100:00080000:0.0:1788574179.491140:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574179.491149:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574179.491150:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361013120:192.168.202.140@tcp:250:kworker.0
00000008:00100000:0.0:1788574179.491155:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574179.491166:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361013376/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574179.491172:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574179.491174:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574179.491175:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574179.491178:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2525
00000100:00080000:0.0:1788574179.491180:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574179.491184:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574179.491187:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574179.491194:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361013504/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574179.491199:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574179.491201:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574179.491202:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574179.491204:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2525
00000100:00080000:0.0:1788574179.491206:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574179.491210:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574179.491213:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574179.491219:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453361013632/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574179.491230:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574179.491232:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574179.491233:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574179.491236:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2525
00000100:00080000:0.0:1788574179.491245:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574179.491247:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574179.491250:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574179.491265:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361013760/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788574179.491267:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788574179.491280:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574179.491283:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574179.491285:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574179.491288:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2525
00000100:00080000:0.0:1788574179.491290:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574179.491292:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574179.491296:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574179.491304:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361013888/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574179.491354:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574179/real 1788574179]  req@ffff8dc006711500 x1875453361013120/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574204 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574179.491381:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361013120/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574204 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574179.491395:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574179.491408:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574179.491414:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361013120:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788574179.491446:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361013248:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574179.491475:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574179.491490:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574179/real 1788574179]  req@ffff8dc006711c00 x1875453361013248/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574204 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574179.491504:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361013248/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574204 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574179.491522:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574179.491526:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574179.491530:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361013248:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574179.491538:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361013376:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574179.491560:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574179.491571:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574179/real 1788574179]  req@ffff8dc006713480 x1875453361013376/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574204 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574179.491584:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361013376/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574204 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574179.491593:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574179.491597:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574179.491601:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361013376:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574179.491607:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361013504:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574179.491627:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574179.491638:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574179/real 1788574179]  req@ffff8dc006712680 x1875453361013504/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574204 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574179.491649:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361013504/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574204 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574179.491658:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574179.491662:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574179.491666:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361013504:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574179.491673:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361013632:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574179.491692:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574179.491705:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574179/real 1788574179]  req@ffff8dc006710380 x1875453361013632/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574204 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574179.491718:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453361013632/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574204 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574179.491729:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574179.491733:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574179.491737:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361013632:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574179.491744:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361013760:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574179.491767:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574179.491779:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574179/real 1788574179]  req@ffff8dc006712a00 x1875453361013760/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574204 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574179.491792:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361013760/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574204 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574179.491800:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574179.491804:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574179.491807:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361013760:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574179.491815:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361013888:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574179.491837:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574179.491849:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574179/real 1788574179]  req@ffff8dc006713100 x1875453361013888/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574204 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574179.491861:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361013888/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574204 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574179.491929:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574179.491933:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574179.491937:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361013888:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574179.874994:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574179.875002:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574179.875002:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574179.875045:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574179.875046:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788574179.875065:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574180.515027:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574180.899017:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574180.899027:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574180.899030:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574180.899037:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574180.899069:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574180.899119:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574181.538998:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574181.923006:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574181.923006:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574181.923009:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574181.923011:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574181.923066:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788574181.923124:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574182.563008:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574182.946961:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574182.946980:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574182.947025:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574182.947033:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574182.947068:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574182.947068:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574183.586974:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574183.970982:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574183.970991:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574183.970994:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574183.971001:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574183.971033:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788574183.971107:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1788574184.610995:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788574184.610998:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574184.611009:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788574184.611014:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574184.611026:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2530
00000100:00080000:1.0:1788574184.611039:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574184.611047:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574184.611092:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361014016/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574184.611119:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574184.611123:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574184.611124:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574184.611127:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2530
00000100:00080000:1.0:1788574184.611130:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574184.611133:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574184.611145:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574184.611159:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361014144/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574184.611165:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361014016:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574184.611171:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574184.611177:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574184.611178:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574184.611182:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2530
00000100:00080000:1.0:1788574184.611184:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574184.611187:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574184.611190:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574184.611198:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361014272/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574184.611204:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574184.611206:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574184.611208:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574184.611211:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2530
00000100:00080000:1.0:1788574184.611216:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574184.611219:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574184.611223:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574184.611233:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361014400/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574184.611238:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574184.611241:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574184.611243:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574184.611246:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2530
00000100:00080000:1.0:1788574184.611248:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574184.611253:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:0.0:1788574184.611261:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:1.0:1788574184.611261:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574184.611276:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361014528/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574184.611284:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574184.611288:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574184.611289:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574184.611293:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2530
00000100:00080000:1.0:1788574184.611295:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574184.611298:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574184.611303:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574184.611310:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574184/real 1788574184]  req@ffff8dc005dc0a80 x1875453361014016/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574209 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574184.611312:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361014656/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574184.611378:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574184.611381:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574184.611383:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788574184.611389:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361014016/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574209 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574184.611393:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2530
00000100:00080000:1.0:1788574184.611402:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574184.611422:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574184.611422:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:0.0:1788574184.611433:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000008:00100000:1.0:1788574184.611433:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574184.611443:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361014016:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788574184.611453:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361014784/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574184.611476:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361014144:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574184.611500:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574184.611510:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574184/real 1788574184]  req@ffff8dc005dc2d80 x1875453361014144/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574209 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574184.611528:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361014144/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574209 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574184.611536:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574184.611538:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574184.611541:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361014144:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574184.611545:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361014272:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574184.611561:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574184.611568:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574184/real 1788574184]  req@ffff8dc005dc3800 x1875453361014272/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574209 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574184.611576:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361014272/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574209 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574184.611599:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574184.611603:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574184.611607:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361014272:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574184.611614:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361014400:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574184.611634:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574184.611645:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574184/real 1788574184]  req@ffff8dc005dc1c00 x1875453361014400/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574209 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574184.611659:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361014400/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574209 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574184.611668:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574184.611672:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574184.611676:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361014400:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574184.611682:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361014528:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574184.611698:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574184.611707:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574184/real 1788574184]  req@ffff8dc005dc1500 x1875453361014528/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574209 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574184.611721:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361014528/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574209 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574184.611739:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574184.611743:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574184.611746:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361014528:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574184.611754:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361014656:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574184.611777:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574184.611790:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574184/real 1788574184]  req@ffff8dc005dc3b80 x1875453361014656/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574209 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574184.611804:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361014656/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574209 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574184.611813:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574184.611817:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574184.611820:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361014656:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574184.611825:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361014784:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574184.611841:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574184.611849:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574184/real 1788574184]  req@ffff8dc005dc1180 x1875453361014784/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574209 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574184.611857:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361014784/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574209 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574184.611886:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574184.611888:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574184.611891:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361014784:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574184.995000:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574184.995000:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574184.995009:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574184.995045:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574184.995068:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788574184.995092:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574185.634940:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574186.018982:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574186.018992:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574186.018993:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574186.018993:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574186.019026:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788574186.019099:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574186.658963:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574187.042967:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574187.042975:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788574187.042999:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574187.043004:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574187.043005:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574187.043059:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574187.682979:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574188.067001:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574188.067001:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574188.067001:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574188.067001:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574188.067042:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788574188.067102:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574188.707000:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574189.090972:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574189.091006:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574189.091010:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574189.091044:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574189.091064:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788574189.091092:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1788574189.730989:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574189.731001:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788574189.731006:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788574189.731008:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574189.731021:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2535
00000100:00080000:0.0:1788574189.731034:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574189.731043:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574189.731090:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361014912/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574189.731116:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574189.731120:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574189.731121:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574189.731124:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2535
00000100:00080000:0.0:1788574189.731127:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574189.731130:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574189.731142:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574189.731153:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361015040/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574189.731162:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574189.731166:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574189.731168:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1788574189.731168:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361014912:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788574189.731173:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2535
00000100:00080000:0.0:1788574189.731178:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574189.731182:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574189.731186:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574189.731194:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361015168/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574189.731200:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574189.731203:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574189.731204:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574189.731207:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2535
00000100:00080000:0.0:1788574189.731209:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574189.731211:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574189.731214:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574189.731222:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361015296/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574189.731227:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574189.731229:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574189.731231:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574189.731234:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2535
00000100:00080000:0.0:1788574189.731244:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574189.731247:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574189.731251:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1788574189.731257:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574189.731262:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361015424/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574189.731269:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574189.731272:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574189.731274:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574189.731277:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2535
00000100:00080000:0.0:1788574189.731279:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574189.731307:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574189.731311:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574189.731323:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361015552/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574189.731336:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574189.731340:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1788574189.731340:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574189/real 1788574189]  req@ffff8dc006712300 x1875453361014912/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574214 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574189.731343:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574189.731350:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2535
00000100:00080000:0.0:1788574189.731354:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574189.731357:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574189.731361:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574189.731370:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361015680/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574189.731387:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361014912/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574214 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574189.731402:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574189.731407:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574189.731412:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361014912:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788574189.731440:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361015040:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574189.731466:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574189.731480:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574189/real 1788574189]  req@ffff8dc006710e00 x1875453361015040/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574214 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574189.731495:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361015040/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574214 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574189.731507:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574189.731510:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574189.731514:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361015040:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574189.731521:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361015168:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574189.731543:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574189.731556:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574189/real 1788574189]  req@ffff8dc006713b80 x1875453361015168/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574214 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574189.731569:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361015168/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574214 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574189.731579:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574189.731583:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574189.731586:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361015168:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574189.731593:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361015296:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574189.731625:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574189.731638:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574189/real 1788574189]  req@ffff8dc006713800 x1875453361015296/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574214 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574189.731651:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361015296/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574214 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574189.731661:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574189.731665:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574189.731668:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361015296:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574189.731675:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361015424:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574189.731696:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574189.731708:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574189/real 1788574189]  req@ffff8dc006711880 x1875453361015424/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574214 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574189.731721:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361015424/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574214 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574189.731731:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574189.731734:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574189.731738:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361015424:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574189.731745:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361015552:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574189.731766:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574189.731779:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574189/real 1788574189]  req@ffff8dc006713100 x1875453361015552/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574214 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574189.731800:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361015552/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574214 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574189.731809:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574189.731812:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574189.731816:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361015552:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574189.731822:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361015680:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574189.731843:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574189.731854:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574189/real 1788574189]  req@ffff8dc006712a00 x1875453361015680/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574214 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574189.731893:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361015680/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574214 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574189.731903:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574189.731906:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574189.731910:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361015680:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574190.114989:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574190.115007:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574190.115009:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574190.115033:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574190.115038:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574190.115040:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574190.754970:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574191.138949:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574191.138955:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574191.138969:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574191.138984:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574191.138998:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574191.139004:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574191.778950:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574192.162996:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574192.163001:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574192.163019:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574192.163027:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574192.163055:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574192.163077:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574192.802975:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574193.186941:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574193.186992:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574193.186996:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574193.187004:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574193.187023:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574193.187034:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574193.826983:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574194.210992:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574194.210992:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574194.210994:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574194.211000:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574194.211050:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574194.211068:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574194.850944:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788574194.851016:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574194.851023:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788574194.851027:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574194.851039:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2540
00000100:00080000:2.0:1788574194.851051:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574194.851060:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574194.851099:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453361015808/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574194.851130:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574194.851134:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574194.851137:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574194.851143:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2540
00000100:00080000:2.0:1788574194.851149:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574194.851157:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574194.851166:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361015808:192.168.202.140@tcp:250:kworker.0
00000008:00100000:2.0:1788574194.851168:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574194.851190:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361015936/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574194.851202:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574194.851205:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574194.851208:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574194.851214:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2540
00000100:00080000:2.0:1788574194.851218:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574194.851222:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574194.851227:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788574194.851231:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574194.851242:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453361016064/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574194.851250:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574194.851252:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574194.851254:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574194.851257:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2540
00000100:00080000:2.0:1788574194.851260:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574194.851262:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574194.851266:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574194.851270:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574194/real 1788574194]  req@ffff8dc020496a00 x1875453361015808/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574219 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574194.851278:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453361016192/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574194.851288:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788574194.851291:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453361015808/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574219 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574194.851295:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574194.851301:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574194.851305:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574194.851310:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2540
00000100:00080000:0.0:1788574194.851313:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574194.851320:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361015808:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788574194.851320:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574194.851331:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574194.851337:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574194.851343:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361015936:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574194.851353:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453361016320/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574194.851362:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1788574194.851365:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788574194.851368:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574194.851371:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574194.851376:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2540
00000100:00100000:0.0:1788574194.851380:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574194/real 1788574194]  req@ffff8dc020495500 x1875453361015936/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574219 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574194.851380:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574194.851394:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574194.851395:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361015936/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574219 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1788574194.851402:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1788574194.851416:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1788574194.851418:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453361016448/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574194.851422:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574194.851430:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361015936:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788574194.851436:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788574194.851440:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361016064:192.168.202.140@tcp:8:kworker.0
00000100:00080000:2.0:1788574194.851441:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574194.851445:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574194.851449:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2540
00000100:00080000:2.0:1788574194.851452:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574194.851455:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574194.851459:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788574194.851464:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574194.851473:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361016576/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574194.851476:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574194/real 1788574194]  req@ffff8dc020497100 x1875453361016064/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574219 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574194.851502:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453361016064/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574219 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574194.851509:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574194.851512:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574194.851514:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361016064:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574194.851520:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361016192:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574194.851532:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574194.851539:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574194/real 1788574194]  req@ffff8dc020494e00 x1875453361016192/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574219 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574194.851547:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453361016192/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574219 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574194.851554:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574194.851556:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574194.851560:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361016192:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574194.851573:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361016320:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574194.851587:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574194.851599:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574194/real 1788574194]  req@ffff8dc020494380 x1875453361016320/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574219 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574194.851616:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453361016320/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574219 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574194.851626:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574194.851630:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574194.851634:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361016320:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574194.851641:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361016448:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574194.851661:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574194.851672:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574194/real 1788574194]  req@ffff8dc020496a00 x1875453361016448/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574219 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574194.851682:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453361016448/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574219 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574194.851688:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574194.851690:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574194.851692:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361016448:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574194.851696:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361016576:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574194.851706:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574194.851712:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574194/real 1788574194]  req@ffff8dc020494700 x1875453361016576/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574219 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574194.851719:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361016576/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574219 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574194.851724:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574194.851726:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574194.851727:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361016576:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574195.234945:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574195.234945:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574195.235000:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574195.235013:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574195.235038:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574195.235040:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574195.874984:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574196.258989:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574196.258990:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574196.259015:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574196.259021:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574196.259059:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574196.259107:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574196.898955:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574197.283002:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574197.283003:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574197.283004:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574197.283037:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574197.283064:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574197.283111:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574197.922995:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574198.306995:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574198.306995:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574198.307004:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574198.307009:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574198.307058:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788574198.307120:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574198.946935:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574199.330970:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574199.331012:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574199.331012:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574199.331028:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574199.331047:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574199.331098:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1788574199.970984:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788574199.970985:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574199.970993:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788574199.970997:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574199.971005:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2545
00000100:00080000:0.0:1788574199.971014:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574199.971020:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574199.971053:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453361016704/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574199.971076:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574199.971079:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574199.971080:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574199.971083:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2545
00000100:00080000:0.0:1788574199.971091:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574199.971095:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574199.971104:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574199.971115:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361016832/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574199.971125:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788574199.971131:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361016704:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788574199.971132:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574199.971140:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574199.971147:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2545
00000100:00080000:0.0:1788574199.971150:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574199.971152:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574199.971155:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574199.971164:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361016960/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574199.971170:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574199.971173:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574199.971174:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574199.971176:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2545
00000100:00080000:0.0:1788574199.971179:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574199.971181:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574199.971184:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574199.971190:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361017088/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574199.971201:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574199.971203:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574199.971204:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574199.971206:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2545
00000100:00080000:0.0:1788574199.971215:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574199.971217:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574199.971220:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574199.971227:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361017216/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788574199.971237:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788574199.971248:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574199.971251:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574199.971254:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574199.971257:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2545
00000100:00080000:0.0:1788574199.971260:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574199.971263:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574199.971269:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574199.971278:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361017344/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574199.971290:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574199.971293:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574199.971296:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1788574199.971304:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574199/real 1788574199]  req@ffff8dc006710380 x1875453361016704/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574224 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574199.971306:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2545
00000100:00080000:0.0:1788574199.971313:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574199.971324:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574199.971332:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574199.971344:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453361016704/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574224 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574199.971350:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361017472/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574199.971364:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574199.971373:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574199.971378:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361016704:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788574199.971409:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361016832:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574199.971431:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574199.971445:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574199/real 1788574199]  req@ffff8dc006712680 x1875453361016832/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574224 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574199.971459:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361016832/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574224 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574199.971471:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574199.971475:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574199.971480:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361016832:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574199.971488:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361016960:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574199.971507:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574199.971515:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574199/real 1788574199]  req@ffff8dc006713480 x1875453361016960/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574224 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574199.971524:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361016960/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574224 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574199.971531:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574199.971533:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574199.971536:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361016960:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574199.971540:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361017088:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574199.971552:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574199.971558:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574199/real 1788574199]  req@ffff8dc006711c00 x1875453361017088/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574224 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574199.971576:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361017088/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574224 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574199.971583:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574199.971585:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574199.971588:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361017088:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574199.971596:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361017216:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574199.971609:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574199.971616:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574199/real 1788574199]  req@ffff8dc006711500 x1875453361017216/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574224 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574199.971625:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361017216/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574224 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574199.971631:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574199.971633:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574199.971635:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361017216:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574199.971639:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361017344:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574199.971650:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574199.971656:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574199/real 1788574199]  req@ffff8dc006712a00 x1875453361017344/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574224 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574199.971664:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361017344/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574224 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574199.971669:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574199.971671:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574199.971673:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361017344:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574199.971677:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361017472:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574199.971687:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574199.971715:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574199/real 1788574199]  req@ffff8dc006713100 x1875453361017472/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574224 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574199.971728:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361017472/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574224 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574199.971745:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574199.971749:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574199.971753:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361017472:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574200.354962:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574200.354964:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574200.355002:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574200.355003:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574200.355026:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788574200.355124:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574200.994928:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574201.379003:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574201.379003:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574201.379014:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574201.379031:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574201.379076:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574201.379102:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574202.019011:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574202.402970:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574202.402971:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574202.402971:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574202.402972:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574202.403007:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788574202.403056:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574203.042948:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574203.426923:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574203.426954:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574203.426967:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574203.426968:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574203.426986:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574203.427044:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574204.066992:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574204.450984:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574204.450995:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574204.450999:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574204.451042:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574204.451043:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574204.451057:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00080000:2.0:1788574205.090959:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788574205.090963:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788574205.090968:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788574205.090973:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574205.090983:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2550
00000100:00080000:2.0:1788574205.090993:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574205.091001:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574205.091049:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453361017600/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574205.091070:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574205.091073:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574205.091075:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574205.091078:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2550
00000100:00080000:2.0:1788574205.091081:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574205.091085:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574205.091094:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574205.091104:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453361017728/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574205.091108:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361017600:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788574205.091118:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574205.091123:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574205.091126:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574205.091131:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2550
00000100:00080000:2.0:1788574205.091135:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574205.091139:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574205.091146:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574205.091159:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453361017856/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574205.091170:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574205.091172:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574205.091174:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1788574205.091179:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788574205.091179:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2550
00000100:00080000:2.0:1788574205.091186:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574205.091189:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574205.091194:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574205.091203:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361017984/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574205.091210:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574205.091212:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574205.091213:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574205.091216:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2550
00000100:00080000:2.0:1788574205.091218:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574205.091221:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574205.091225:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574205.091231:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574205/real 1788574205]  req@ffff8dc020496d80 x1875453361017600/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574230 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574205.091242:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361018112/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574205.091250:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574205.091254:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:1.0:1788574205.091255:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453361017600/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574230 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574205.091256:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574205.091263:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2550
00000100:00080000:2.0:1788574205.091267:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574205.091273:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574205.091278:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1788574205.091285:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1788574205.091287:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361018240/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574205.091294:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788574205.091297:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574205.091302:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1788574205.091303:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361017600:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788574205.091304:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574205.091311:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2550
00000100:00080000:2.0:1788574205.091314:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574205.091316:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574205.091319:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574205.091326:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361018368/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574205.091344:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361017728:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574205.091372:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574205.091384:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574205/real 1788574205]  req@ffff8dc020494a80 x1875453361017728/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574230 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574205.091393:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453361017728/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574230 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574205.091433:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574205.091436:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574205.091439:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361017728:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574205.091444:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361017856:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574205.091461:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574205.091470:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574205/real 1788574205]  req@ffff8dc020497480 x1875453361017856/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574230 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574205.091478:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453361017856/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574230 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574205.091484:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574205.091486:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574205.091489:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361017856:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574205.091492:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361017984:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574205.091503:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574205.091509:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574205/real 1788574205]  req@ffff8dc020495180 x1875453361017984/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574230 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574205.091516:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361017984/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574230 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574205.091522:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574205.091524:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574205.091527:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361017984:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574205.091530:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361018112:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574205.091540:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574205.091546:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574205/real 1788574205]  req@ffff8dc020494000 x1875453361018112/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574230 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574205.091553:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361018112/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574230 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574205.091560:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574205.091561:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574205.091564:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361018112:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574205.091568:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361018240:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574205.091578:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574205.091584:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574205/real 1788574205]  req@ffff8dc020495880 x1875453361018240/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574230 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574205.091590:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361018240/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574230 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574205.091595:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574205.091597:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574205.091600:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361018240:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574205.091604:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361018368:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574205.091626:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574205.091633:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574205/real 1788574205]  req@ffff8dc020494700 x1875453361018368/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574230 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574205.091640:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361018368/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574230 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574205.091646:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574205.091648:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574205.091650:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361018368:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574205.474956:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574205.474963:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574205.474966:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574205.474987:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574205.474990:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574205.474991:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574206.114997:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574206.498962:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574206.498974:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574206.499003:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574206.499007:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574206.499018:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574206.499036:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574207.138984:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574207.523032:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574207.523032:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574207.523038:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574207.523041:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574207.523076:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574207.523113:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574208.163025:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574208.546992:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574208.546993:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574208.547009:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574208.547042:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574208.547066:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788574208.547068:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574209.186984:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574209.570997:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574209.570997:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574209.570997:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574209.571000:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574209.571037:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574209.571074:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1788574210.211022:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788574210.211027:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788574210.211041:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788574210.211046:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574210.211057:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2555
00000100:00080000:2.0:1788574210.211070:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574210.211078:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574210.211146:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453361018496/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574210.211178:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574210.211182:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574210.211184:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574210.211189:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2555
00000100:00080000:2.0:1788574210.211194:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574210.211199:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574210.211211:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574210.211222:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361018496:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788574210.211226:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453361018624/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574210.211246:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574210.211248:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574210.211250:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574210.211253:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2555
00000100:00080000:2.0:1788574210.211256:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574210.211259:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574210.211263:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574210.211273:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453361018752/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574210.211280:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574210.211284:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574210.211285:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574210.211287:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2555
00000100:00080000:2.0:1788574210.211289:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574210.211291:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574210.211294:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574210.211301:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453361018880/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574210.211307:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574210.211310:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574210.211311:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1788574210.211317:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788574210.211317:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2555
00000100:00080000:2.0:1788574210.211323:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574210.211326:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574210.211329:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574210.211336:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361019008/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574210.211343:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574210.211347:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574210.211348:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574210.211351:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2555
00000100:00080000:2.0:1788574210.211353:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574210.211356:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574210.211358:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574210.211367:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361019136/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574210.211372:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574210.211375:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574210.211376:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1788574210.211380:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574210/real 1788574210]  req@ffff8dc020496a00 x1875453361018496/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574235 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574210.211382:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2555
00000100:00080000:2.0:1788574210.211387:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574210.211393:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574210.211400:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574210.211420:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361019264/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574210.211421:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453361018496/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574235 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574210.211445:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574210.211451:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574210.211457:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361018496:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788574210.211484:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361018624:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574210.211512:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574210.211527:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574210/real 1788574210]  req@ffff8dc020494380 x1875453361018624/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574235 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574210.211541:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453361018624/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574235 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574210.211554:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574210.211558:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574210.211561:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361018624:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574210.211568:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361018752:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574210.211592:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574210.211605:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574210/real 1788574210]  req@ffff8dc020494e00 x1875453361018752/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574235 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574210.211618:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453361018752/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574235 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574210.211634:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574210.211638:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574210.211642:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361018752:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574210.211649:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361018880:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574210.211669:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574210.211681:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574210/real 1788574210]  req@ffff8dc020497100 x1875453361018880/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574235 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574210.211694:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453361018880/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574235 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574210.211703:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574210.211707:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574210.211710:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361018880:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574210.211717:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361019008:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574210.211736:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574210.211747:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574210/real 1788574210]  req@ffff8dc020495500 x1875453361019008/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574235 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574210.211760:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361019008/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574235 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574210.211769:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574210.211773:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574210.211777:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361019008:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574210.211783:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361019136:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574210.211805:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574210.211817:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574210/real 1788574210]  req@ffff8dc020494700 x1875453361019136/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574235 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574210.211829:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361019136/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574235 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574210.211838:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574210.211841:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574210.211845:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361019136:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574210.211851:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361019264:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574210.211896:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574210.211909:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574210/real 1788574210]  req@ffff8dc020495880 x1875453361019264/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574235 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574210.211923:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361019264/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574235 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574210.211931:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574210.211935:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574210.211939:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361019264:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574210.595006:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574210.595006:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574210.595009:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574210.595048:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574210.595092:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788574210.595111:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574211.234962:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574211.619006:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574211.619007:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574211.619067:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788574211.619089:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574211.619098:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574211.619109:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574212.259012:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574212.642957:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574212.642979:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574212.642979:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574212.642979:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574212.643011:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788574212.643086:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574213.282967:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574213.666992:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574213.667006:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574213.667019:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574213.667050:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574213.667056:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788574213.667082:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574214.306999:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574214.690962:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574214.690974:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788574214.690992:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574214.691010:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574214.691015:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574214.691023:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574215.330968:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788574215.330984:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574215.330990:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788574215.330994:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574215.331004:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2560
00000100:00080000:3.0:1788574215.331016:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574215.331024:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788574215.331067:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e680 x1875453361019392/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574215.331091:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574215.331094:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574215.331096:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574215.331099:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2560
00000100:00080000:3.0:1788574215.331101:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574215.331104:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574215.331115:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574215.331125:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d180 x1875453361019520/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574215.331132:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361019392:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788574215.331136:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574215.331142:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574215.331144:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574215.331147:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2560
00000100:00080000:3.0:1788574215.331149:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574215.331151:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574215.331165:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574215.331176:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f480 x1875453361019648/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574215.331182:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574215.331185:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574215.331187:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574215.331189:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2560
00000100:00080000:3.0:1788574215.331192:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574215.331195:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574215.331198:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574215.331205:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c380 x1875453361019776/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574215.331212:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574215.331215:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574215.331216:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574215.331219:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2560
00000100:00080000:3.0:1788574215.331222:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574215.331228:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:1.0:1788574215.331230:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:3.0:1788574215.331235:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574215.331251:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d500 x1875453361019904/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574215.331262:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574215.331265:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574215.331268:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574215.331273:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2560
00000100:00080000:3.0:1788574215.331277:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574215.331282:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574215.331288:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574215.331302:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574215/real 1788574215]  req@ffff8dc00644e680 x1875453361019392/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574240 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574215.331304:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ea00 x1875453361020032/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574215.331344:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453361019392/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574240 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574215.331345:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574215.331355:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574215.331360:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574215.331370:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2560
00000100:00080000:1.0:1788574215.331371:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574215.331376:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574215.331381:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788574215.331384:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574215.331392:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574215.331393:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361019392:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788574215.331406:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ca80 x1875453361020160/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574215.331423:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361019520:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574215.331448:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574215.331462:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574215/real 1788574215]  req@ffff8dc00644d180 x1875453361019520/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574240 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574215.331477:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453361019520/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574240 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574215.331490:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574215.331495:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574215.331499:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361019520:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574215.331507:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361019648:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574215.331530:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574215.331544:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574215/real 1788574215]  req@ffff8dc00644f480 x1875453361019648/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574240 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574215.331556:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453361019648/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574240 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574215.331563:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574215.331565:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574215.331568:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361019648:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574215.331572:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361019776:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574215.331587:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574215.331594:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574215/real 1788574215]  req@ffff8dc00644c380 x1875453361019776/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574240 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574215.331603:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453361019776/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574240 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574215.331609:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574215.331611:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574215.331614:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361019776:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574215.331619:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361019904:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574215.331630:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574215.331636:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574215/real 1788574215]  req@ffff8dc00644d500 x1875453361019904/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574240 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574215.331644:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d500 x1875453361019904/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574240 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574215.331651:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574215.331653:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574215.331655:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361019904:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574215.331658:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361020032:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574215.331669:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574215.331676:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574215/real 1788574215]  req@ffff8dc00644ea00 x1875453361020032/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574240 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574215.331683:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ea00 x1875453361020032/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574240 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574215.331689:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574215.331691:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574215.331693:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361020032:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574215.331696:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361020160:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574215.331707:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574215.331714:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574215/real 1788574215]  req@ffff8dc00644ca80 x1875453361020160/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574240 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574215.331728:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ca80 x1875453361020160/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574240 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574215.331734:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574215.331736:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574215.331738:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361020160:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574215.714999:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574215.714999:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574215.715002:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788574215.715033:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574215.715036:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574215.715052:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574216.355038:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574216.738972:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574216.738972:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574216.738972:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574216.739007:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574216.739022:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788574216.739032:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574217.379032:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574217.763017:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574217.763030:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574217.763068:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574217.763074:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788574217.763088:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574217.763096:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574218.403010:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574218.786970:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574218.787014:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574218.787015:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574218.787015:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574218.787072:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788574218.787073:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574219.427039:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574219.810988:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574219.811020:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574219.811032:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788574219.811032:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574219.811059:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574219.811066:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574220.450956:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574220.450988:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574220.450996:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788574220.450999:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574220.451010:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2566
00000100:00080000:0.0:1788574220.451021:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574220.451029:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574220.451067:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361020288/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574220.451093:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574220.451097:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574220.451100:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574220.451104:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2566
00000100:00080000:0.0:1788574220.451117:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574220.451123:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574220.451132:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361020288:192.168.202.140@tcp:250:kworker.0
00000008:00100000:0.0:1788574220.451139:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574220.451154:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361020416/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574220.451164:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574220.451167:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574220.451168:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574220.451171:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2566
00000100:00080000:0.0:1788574220.451189:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574220.451191:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574220.451196:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574220.451205:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361020544/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574220.451212:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574220.451214:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574220.451215:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574220.451218:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2566
00000100:00080000:0.0:1788574220.451219:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574220.451222:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574220.451225:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574220.451235:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361020672/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574220.451244:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574220.451246:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574220.451248:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574220.451251:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2566
00000100:00100000:1.0:1788574220.451255:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361020416:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788574220.451256:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574220.451263:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574220.451270:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574220.451287:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361020800/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574220.451293:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361020544:192.168.202.140@tcp:8:kworker.0
00000100:00080000:0.0:1788574220.451307:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574220.451313:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574220.451315:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1788574220.451318:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361020672:192.168.202.140@tcp:8:kworker.0
00000100:00080000:0.0:1788574220.451322:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2566
00000100:00080000:0.0:1788574220.451327:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574220.451332:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574220.451337:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574220.451342:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361020800:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574220.451350:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361020928/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574220.451359:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574220.451362:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574220.451363:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574220.451368:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2566
00000100:00080000:0.0:1788574220.451371:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788574220.451375:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361020928:192.168.202.140@tcp:8:kworker.0
00000100:00080000:0.0:1788574220.451378:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574220.451386:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574220.451400:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361021056/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574220.451443:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361021056:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574220.834943:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574220.834943:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574220.834982:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574220.835004:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574220.835006:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788574220.835070:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574221.475129:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574221.859018:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574221.859019:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574221.859019:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574221.859045:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574221.859058:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788574221.859065:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574222.499027:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574222.882930:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574222.882953:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574222.882972:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574222.882989:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574222.882998:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788574222.883020:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574223.523203:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000400:00000100:1.0:1788574223.523280:0:2337:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.140:988
00000400:00000100:1.0:1788574223.523328:0:2337:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.140@tcp at host 192.168.202.140 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:1.0:1788574223.523357:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788574223.523396:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788574223.523413:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788574223.523427:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788574223.523435:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788574223.523448:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788574223.523461:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:0.0:1788574223.523463:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574220/real 1788574223]  req@ffff8dc006712300 x1875453361020800/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574245 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574223.523493:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361020800/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574245 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574223.523507:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574223.523513:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574223.523517:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361020800:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574223.523525:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574220/real 1788574223]  req@ffff8dc006713800 x1875453361020416/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574245 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574223.523539:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361020416/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574245 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574223.523549:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574223.523553:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574223.523556:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361020416:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574223.523563:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574220/real 1788574223]  req@ffff8dc006713b80 x1875453361020544/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574245 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574223.523581:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361020544/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574245 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574223.523590:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574223.523593:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574223.523596:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361020544:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574223.523603:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574220/real 1788574223]  req@ffff8dc006710e00 x1875453361020672/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574245 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574223.523614:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361020672/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574245 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574223.523622:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574223.523626:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574223.523629:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361020672:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574223.523636:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574220/real 1788574223]  req@ffff8dc006711880 x1875453361020288/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574245 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574223.523648:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361020288/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574245 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574223.523655:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574223.523659:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574223.523662:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361020288:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788574223.523698:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574220/real 1788574223]  req@ffff8dc006712a00 x1875453361021056/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574245 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574223.523712:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361021056/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574245 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574223.523722:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574223.523726:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574223.523729:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361021056:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574223.523737:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574220/real 1788574223]  req@ffff8dc006713100 x1875453361020928/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574245 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574223.523749:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361020928/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574245 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574223.523757:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574223.523761:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574223.523764:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361020928:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574223.906990:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574223.907016:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788574223.907034:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574223.907043:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574223.907056:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574223.907069:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574224.546969:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574224.930958:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574224.930980:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574224.930980:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574224.931011:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788574224.931036:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574224.931044:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574225.571018:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574225.571031:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788574225.571036:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1788574225.571037:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574225.571053:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2571
00000100:00080000:0.0:1788574225.571066:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574225.571075:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574225.571120:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361021184/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574225.571151:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574225.571155:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574225.571157:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574225.571163:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2571
00000100:00080000:0.0:1788574225.571168:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574225.571174:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574225.571185:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361021184:192.168.202.140@tcp:250:kworker.0
00000008:00100000:0.0:1788574225.571187:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574225.571203:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361021312/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574225.571235:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574225.571238:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574225.571240:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574225.571244:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2571
00000100:00080000:0.0:1788574225.571247:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574225.571250:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574225.571256:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574225.571266:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361021440/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574225.571274:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574225.571277:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574225.571278:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574225.571282:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2571
00000100:00080000:0.0:1788574225.571296:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574225.571300:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574225.571305:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1788574225.571313:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574225.571320:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361021568/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574225.571332:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574225.571336:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574225.571339:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574225.571343:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2571
00000100:00080000:0.0:1788574225.571353:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574225.571358:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574225.571363:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574225.571377:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361021696/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574225.571387:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574225/real 1788574225]  req@ffff8dc006713100 x1875453361021184/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574250 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574225.571390:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574225.571399:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574225.571403:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574225.571412:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2571
00000100:00080000:0.0:1788574225.571417:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574225.571422:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574225.571427:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574225.571429:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361021184/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574250 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574225.571444:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361021824/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574225.571446:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574225.571458:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788574225.571464:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788574225.571468:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361021184:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788574225.571471:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574225.571475:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574225.571483:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2571
00000100:00080000:0.0:1788574225.571489:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574225.571494:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574225.571499:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574225.571510:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361021312:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574225.571516:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361021952/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788574225.571554:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574225.571573:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574225/real 1788574225]  req@ffff8dc006712a00 x1875453361021312/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574250 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574225.571600:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361021312/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574250 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574225.571612:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574225.571616:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574225.571620:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361021312:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574225.571628:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361021440:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574225.571653:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574225.571667:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574225/real 1788574225]  req@ffff8dc006711880 x1875453361021440/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574250 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574225.571681:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361021440/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574250 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574225.571692:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574225.571696:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574225.571700:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361021440:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574225.571707:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361021568:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574225.571730:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574225.571742:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574225/real 1788574225]  req@ffff8dc006710e00 x1875453361021568/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574250 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574225.571755:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361021568/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574250 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574225.571765:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574225.571768:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574225.571772:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361021568:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574225.571779:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361021696:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574225.571803:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574225.571815:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574225/real 1788574225]  req@ffff8dc006713b80 x1875453361021696/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574250 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574225.571835:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361021696/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574250 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574225.571845:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574225.571849:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574225.571853:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361021696:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574225.571859:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361021824:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574225.571915:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574225.571928:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574225/real 1788574225]  req@ffff8dc006713800 x1875453361021824/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574250 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574225.571941:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361021824/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574250 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574225.571950:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574225.571953:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574225.571957:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361021824:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574225.571977:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361021952:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574225.571992:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574225.572000:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574225/real 1788574225]  req@ffff8dc006712300 x1875453361021952/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574250 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574225.572008:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361021952/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574250 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574225.572014:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574225.572017:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574225.572019:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361021952:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574225.954965:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574225.954972:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574225.954988:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574225.955034:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788574225.955062:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574225.955085:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574226.594996:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574226.979040:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574226.979041:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574226.979042:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574226.979042:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574226.979112:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788574226.979183:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574227.619015:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574228.002989:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574228.002996:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574228.002997:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574228.003006:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574228.003053:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574228.003136:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574228.642993:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574229.026980:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574229.026980:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574229.027042:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574229.027066:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788574229.027074:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574229.027085:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574229.667021:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574230.050988:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574230.050992:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574230.051004:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574230.051031:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574230.051065:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574230.051080:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574230.691008:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574230.691016:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788574230.691021:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574230.691030:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2576
00000100:00080000:1.0:1788574230.691043:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788574230.691046:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574230.691052:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574230.691094:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361022080/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574230.691119:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574230.691122:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574230.691124:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574230.691128:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2576
00000100:00080000:1.0:1788574230.691132:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574230.691137:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574230.691147:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574230.691161:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361022208/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574230.691169:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574230.691172:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574230.691174:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574230.691178:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2576
00000100:00080000:1.0:1788574230.691180:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574230.691182:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574230.691186:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574230.691196:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361022336/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574230.691204:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361022080:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574230.691208:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574230.691221:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574230.691228:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574230.691232:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2576
00000100:00080000:1.0:1788574230.691235:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574230.691237:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574230.691241:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574230.691249:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361022464/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574230.691255:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574230.691257:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574230.691259:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574230.691262:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2576
00000100:00080000:1.0:1788574230.691264:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574230.691266:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574230.691269:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574230.691276:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361022592/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574230.691281:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574230.691293:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574230.691295:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574230.691302:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2576
00000100:00080000:1.0:1788574230.691306:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574230.691309:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:2.0:1788574230.691315:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:1.0:1788574230.691316:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574230.691340:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361022720/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574230.691352:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574230.691356:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574230.691359:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574230.691367:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2576
00000100:00080000:1.0:1788574230.691375:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574230.691381:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574230.691388:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574230/real 1788574230]  req@ffff8dc005dc0700 x1875453361022080/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574255 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1788574230.691391:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574230.691409:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361022848/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574230.691429:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361022080/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574255 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574230.691444:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574230.691449:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574230.691454:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361022080:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788574230.691466:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361022208:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574230.691500:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574230.691519:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574230/real 1788574230]  req@ffff8dc005dc1180 x1875453361022208/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574255 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574230.691536:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361022208/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574255 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574230.691560:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574230.691565:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574230.691573:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361022208:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574230.691617:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361022336:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574230.691638:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574230.691651:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574230/real 1788574230]  req@ffff8dc005dc3b80 x1875453361022336/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574255 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574230.691663:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361022336/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574255 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574230.691692:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574230.691696:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574230.691700:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361022336:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574230.691707:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361022464:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574230.691730:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574230.691743:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574230/real 1788574230]  req@ffff8dc005dc1500 x1875453361022464/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574255 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574230.691756:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361022464/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574255 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574230.691765:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574230.691767:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574230.691769:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361022464:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574230.691775:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361022592:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574230.691790:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574230.691798:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574230/real 1788574230]  req@ffff8dc005dc1c00 x1875453361022592/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574255 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574230.691806:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361022592/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574255 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574230.691812:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574230.691814:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574230.691817:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361022592:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574230.691822:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361022720:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574230.691834:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574230.691840:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574230/real 1788574230]  req@ffff8dc005dc3800 x1875453361022720/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574255 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574230.691847:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361022720/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574255 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574230.691852:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574230.691854:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574230.691856:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361022720:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574230.691859:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361022848:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574230.691933:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574230.691950:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574230/real 1788574230]  req@ffff8dc005dc2d80 x1875453361022848/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574255 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574230.691974:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361022848/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574255 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574230.691984:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574230.691988:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574230.691992:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361022848:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574231.075026:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574231.075027:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574231.075032:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574231.075036:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574231.075070:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788574231.075136:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574231.714971:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574232.098989:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574232.098995:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574232.099017:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574232.099038:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574232.099057:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574232.099074:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574232.738934:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574233.123030:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574233.123030:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574233.123031:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574233.123036:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574233.123086:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788574233.123160:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574233.762997:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574234.146977:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574234.146984:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574234.146988:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574234.146989:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574234.147038:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574234.147086:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574234.786979:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574235.171011:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574235.171011:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574235.171036:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574235.171047:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574235.171074:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788574235.171112:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1788574235.810978:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788574235.810981:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574235.810990:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788574235.810993:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574235.811001:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2581
00000100:00080000:1.0:1788574235.811011:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574235.811017:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574235.811051:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361022976/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574235.811074:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574235.811077:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574235.811078:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574235.811081:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2581
00000100:00080000:1.0:1788574235.811083:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574235.811086:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574235.811093:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574235.811102:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361023104/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574235.811110:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574235.811112:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574235.811114:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574235.811117:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2581
00000100:00080000:1.0:1788574235.811119:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574235.811122:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574235.811126:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574235.811133:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361023232/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574235.811140:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574235.811142:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574235.811144:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574235.811146:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2581
00000100:00080000:1.0:1788574235.811148:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574235.811150:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574235.811154:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574235.811164:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361023360/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574235.811164:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361022976:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574235.811189:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574235.811191:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574235.811192:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574235.811195:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2581
00000100:00080000:1.0:1788574235.811196:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574235.811199:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574235.811202:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574235.811213:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361023488/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574235.811218:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574235.811220:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574235.811222:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574235.811225:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2581
00000100:00080000:1.0:1788574235.811228:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574235.811231:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574235.811234:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574235.811241:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361023616/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574235.811246:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574235.811248:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574235.811250:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574235.811252:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2581
00000100:00080000:1.0:1788574235.811256:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574235.811259:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574235.811262:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574235.811271:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361023744/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788574235.811282:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574235.811340:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574235/real 1788574235]  req@ffff8dc005dc0a80 x1875453361022976/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574260 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574235.811373:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361022976/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574260 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574235.811387:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574235.811392:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574235.811397:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361022976:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788574235.811407:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361023104:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574235.811433:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574235.811447:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574235/real 1788574235]  req@ffff8dc005dc2d80 x1875453361023104/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574260 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574235.811461:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361023104/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574260 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574235.811481:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574235.811486:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574235.811491:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361023104:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574235.811499:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361023232:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574235.811525:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574235.811537:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574235/real 1788574235]  req@ffff8dc005dc3800 x1875453361023232/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574260 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574235.811550:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361023232/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574260 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574235.811561:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574235.811565:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574235.811569:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361023232:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574235.811601:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361023360:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574235.811621:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574235.811632:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574235/real 1788574235]  req@ffff8dc005dc1c00 x1875453361023360/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574260 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574235.811645:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361023360/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574260 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574235.811656:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574235.811660:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574235.811664:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361023360:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574235.811671:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361023488:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574235.811689:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574235.811701:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574235/real 1788574235]  req@ffff8dc005dc1500 x1875453361023488/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574260 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574235.811714:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361023488/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574260 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574235.811724:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574235.811728:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574235.811732:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361023488:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574235.811739:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361023616:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574235.811757:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574235.811796:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574235/real 1788574235]  req@ffff8dc005dc3b80 x1875453361023616/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574260 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574235.811812:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361023616/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574260 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574235.811822:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574235.811826:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574235.811830:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361023616:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574235.811837:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361023744:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574235.811859:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574235.811910:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574235/real 1788574235]  req@ffff8dc005dc1180 x1875453361023744/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574260 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574235.811924:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361023744/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574260 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574235.811935:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574235.811939:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574235.811943:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361023744:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574236.195043:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574236.195044:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574236.195044:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574236.195072:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574236.195110:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574236.195116:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574236.834970:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574237.218973:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574237.218982:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574237.219001:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574237.219001:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574237.219042:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574237.219082:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574237.858958:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574238.242932:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574238.242949:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574238.242989:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574238.243009:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574238.243011:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788574238.243035:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574238.882982:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574239.266976:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574239.266976:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574239.266976:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574239.267022:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574239.267028:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574239.267060:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574239.906981:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574240.290939:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574240.290942:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574240.290991:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574240.291000:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788574240.291011:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574240.291030:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574240.930938:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788574240.930993:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574240.931002:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788574240.931007:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574240.931018:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2586
00000100:00080000:2.0:1788574240.931031:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574240.931038:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574240.931083:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361023872/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574240.931114:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574240.931117:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574240.931119:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574240.931122:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2586
00000100:00080000:2.0:1788574240.931124:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574240.931126:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574240.931137:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574240.931146:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361024000/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574240.931160:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574240.931163:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574240.931166:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1788574240.931172:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361023872:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788574240.931173:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2586
00000100:00080000:2.0:1788574240.931179:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574240.931188:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574240.931194:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574240.931201:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453361024128/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574240.931207:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574240.931210:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574240.931212:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574240.931215:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2586
00000100:00080000:2.0:1788574240.931217:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574240.931219:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574240.931222:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574240.931228:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453361024256/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574240.931233:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574240.931235:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574240.931237:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574240.931240:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2586
00000100:00080000:2.0:1788574240.931245:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574240.931248:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574240.931252:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574240.931262:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453361024384/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574240.931268:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574240.931271:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574240.931276:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1788574240.931281:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788574240.931286:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2586
00000100:00080000:2.0:1788574240.931292:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574240.931294:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574240.931297:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574240.931315:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361024512/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574240.931321:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574240.931325:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574240.931326:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574240.931330:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2586
00000100:00080000:2.0:1788574240.931333:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574240.931337:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574240.931344:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574240.931346:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574240/real 1788574240]  req@ffff8dc020494000 x1875453361023872/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574265 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574240.931354:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361024640/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574240.931419:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361023872/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574265 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574240.931434:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574240.931439:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574240.931444:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361023872:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788574240.931470:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361024000:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574240.931496:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574240.931517:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574240/real 1788574240]  req@ffff8dc020495180 x1875453361024000/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574265 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574240.931532:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361024000/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574265 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574240.931543:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574240.931547:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574240.931550:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361024000:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574240.931558:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361024128:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574240.931580:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574240.931592:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574240/real 1788574240]  req@ffff8dc020497480 x1875453361024128/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574265 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574240.931604:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453361024128/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574265 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574240.931626:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574240.931630:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574240.931634:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361024128:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574240.931642:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361024256:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574240.931665:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574240.931678:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574240/real 1788574240]  req@ffff8dc020494a80 x1875453361024256/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574265 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574240.931705:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453361024256/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574265 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574240.931716:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574240.931719:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574240.931722:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361024256:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574240.931729:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361024384:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574240.931753:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574240.931767:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574240/real 1788574240]  req@ffff8dc020496d80 x1875453361024384/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574265 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574240.931781:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453361024384/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574265 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574240.931791:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574240.931795:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574240.931799:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361024384:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574240.931806:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361024512:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574240.931828:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574240.931840:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574240/real 1788574240]  req@ffff8dc020495880 x1875453361024512/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574265 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574240.931853:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361024512/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574265 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574240.931861:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574240.931889:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574240.931893:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361024512:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574240.931900:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361024640:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574240.931924:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574240.931936:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574240/real 1788574240]  req@ffff8dc020494700 x1875453361024640/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574265 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574240.931948:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361024640/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574265 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574240.931956:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574240.931960:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574240.931963:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361024640:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574241.314971:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574241.314976:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574241.314986:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574241.315012:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574241.315026:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574241.315072:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574241.954931:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574242.338938:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574242.338947:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574242.338997:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788574242.339030:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574242.339031:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574242.339042:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574242.978974:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574243.362964:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574243.362969:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574243.362981:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574243.363000:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574243.363010:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788574243.363036:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574244.003030:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574244.387024:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574244.387024:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574244.387042:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788574244.387070:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574244.387075:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574244.387079:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574245.027003:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574245.410930:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574245.410967:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574245.410973:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574245.411002:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574245.411008:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574245.411032:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574246.050988:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574246.050990:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574246.051000:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788574246.051003:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574246.051019:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2591
00000100:00080000:0.0:1788574246.051028:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574246.051034:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574246.051067:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361024768/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574246.051087:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574246.051090:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574246.051091:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574246.051094:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2591
00000100:00080000:0.0:1788574246.051096:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574246.051099:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574246.051107:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574246.051114:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361024896/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574246.051122:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574246.051124:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574246.051126:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574246.051129:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2591
00000100:00080000:0.0:1788574246.051134:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574246.051136:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574246.051140:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574246.051146:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361025024/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574246.051154:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574246.051158:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574246.051159:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574246.051162:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2591
00000100:00080000:0.0:1788574246.051165:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574246.051174:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574246.051177:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361024768:192.168.202.140@tcp:250:kworker.0
00000008:00100000:0.0:1788574246.051179:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574246.051191:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361025152/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574246.051197:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574246.051199:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574246.051201:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574246.051204:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2591
00000100:00080000:0.0:1788574246.051206:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574246.051210:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574246.051213:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574246.051223:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453361025280/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574246.051228:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574246.051231:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574246.051232:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574246.051235:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2591
00000100:00080000:0.0:1788574246.051237:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574246.051240:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574246.051243:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574246.051252:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361025408/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574246.051257:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574246.051259:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574246.051260:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574246.051262:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2591
00000100:00080000:0.0:1788574246.051272:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574246.051274:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574246.051277:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574246.051290:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361025536/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788574246.051294:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574246.051366:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574246/real 1788574246]  req@ffff8dc006711500 x1875453361024768/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574271 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574246.051392:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361024768/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574271 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574246.051405:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574246.051410:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574246.051415:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361024768:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788574246.051425:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361024896:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574246.051454:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574246.051470:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574246/real 1788574246]  req@ffff8dc006711c00 x1875453361024896/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574271 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574246.051482:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361024896/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574271 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574246.051493:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574246.051496:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574246.051500:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361024896:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574246.051532:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361025024:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574246.051555:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574246.051569:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574246/real 1788574246]  req@ffff8dc006713480 x1875453361025024/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574271 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574246.051582:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361025024/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574271 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574246.051590:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574246.051592:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574246.051595:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361025024:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574246.051600:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361025152:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574246.051641:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574246.051650:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574246/real 1788574246]  req@ffff8dc006712680 x1875453361025152/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574271 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574246.051659:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361025152/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574271 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574246.051665:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574246.051668:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574246.051670:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361025152:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574246.051675:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361025280:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574246.051687:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574246.051695:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574246/real 1788574246]  req@ffff8dc006710380 x1875453361025280/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574271 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574246.051703:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453361025280/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574271 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574246.051709:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574246.051711:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574246.051713:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361025280:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574246.051717:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361025408:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574246.051729:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574246.051735:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574246/real 1788574246]  req@ffff8dc006712300 x1875453361025408/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574271 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574246.051743:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361025408/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574271 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574246.051748:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574246.051750:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574246.051751:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361025408:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574246.051756:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361025536:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574246.051766:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574246.051772:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574246/real 1788574246]  req@ffff8dc006713800 x1875453361025536/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574271 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574246.051779:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361025536/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574271 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574246.051785:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574246.051788:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574246.051790:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361025536:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574246.435015:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574246.435015:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574246.435015:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574246.435015:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574246.435075:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788574246.435122:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574247.075011:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574247.458940:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574247.458983:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574247.459000:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574247.459009:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574247.459014:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574247.459042:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574248.098933:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574248.482973:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574248.482977:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574248.482981:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574248.483004:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574248.483007:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574248.483039:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574249.123009:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574249.506972:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574249.506972:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574249.506972:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574249.507017:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574249.507044:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574249.507101:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574250.146983:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574250.531025:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574250.531037:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574250.531065:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574250.531078:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574250.531088:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574250.531096:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574251.170999:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788574251.171005:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574251.171017:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788574251.171024:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574251.171037:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2596
00000100:00080000:0.0:1788574251.171052:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574251.171061:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574251.171113:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361025664/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574251.171147:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574251.171151:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574251.171153:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574251.171158:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2596
00000100:00080000:0.0:1788574251.171163:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574251.171169:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574251.171182:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574251.171191:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361025664:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788574251.171202:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361025792/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574251.171223:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574251.171227:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574251.171229:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574251.171235:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2596
00000100:00080000:0.0:1788574251.171239:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574251.171244:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574251.171250:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574251.171263:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361025920/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574251.171273:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574251.171277:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574251.171281:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1788574251.171283:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788574251.171288:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2596
00000100:00080000:0.0:1788574251.171294:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574251.171298:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574251.171304:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574251.171318:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361026048/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574251.171329:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574251.171332:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574251.171334:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574251.171340:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2596
00000100:00080000:0.0:1788574251.171345:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788574251.171347:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574251/real 1788574251]  req@ffff8dc006713b80 x1875453361025664/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574276 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574251.171353:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574251.171363:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574251.171380:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361026176/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574251.171381:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361025664/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574276 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574251.171412:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574251.171415:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574251.171417:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574251.171424:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574251.171425:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788574251.171436:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2596
00000100:00100000:1.0:1788574251.171437:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361025664:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788574251.171443:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574251.171450:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574251.171456:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574251.171470:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361026304/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574251.171482:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788574251.171483:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361025792:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788574251.171490:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574251.171495:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574251.171500:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2596
00000100:00080000:0.0:1788574251.171505:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574251.171510:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574251.171517:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1788574251.171521:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574251.171557:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574251/real 1788574251]  req@ffff8dc006710e00 x1875453361025792/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574276 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574251.171567:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361026432/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574251.171579:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361025792/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574276 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574251.171609:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574251.171614:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574251.171618:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361025792:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574251.171627:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361025920:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574251.171652:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574251.171664:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574251/real 1788574251]  req@ffff8dc006711880 x1875453361025920/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574276 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574251.171677:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361025920/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574276 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574251.171687:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574251.171690:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574251.171693:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361025920:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574251.171700:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361026048:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574251.171722:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574251.171734:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574251/real 1788574251]  req@ffff8dc006712a00 x1875453361026048/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574276 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574251.171747:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361026048/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574276 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574251.171757:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574251.171760:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574251.171763:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361026048:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574251.171770:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361026176:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574251.171790:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574251.171803:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574251/real 1788574251]  req@ffff8dc006713100 x1875453361026176/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574276 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574251.171815:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361026176/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574276 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574251.171825:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574251.171828:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574251.171832:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361026176:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574251.171848:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361026304:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574251.171891:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574251.171904:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574251/real 1788574251]  req@ffff8dc006713800 x1875453361026304/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574276 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574251.171917:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361026304/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574276 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574251.171933:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574251.171937:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574251.171941:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361026304:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574251.171947:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361026432:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574251.171967:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574251.171979:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574251/real 1788574251]  req@ffff8dc006712300 x1875453361026432/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574276 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574251.171991:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361026432/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574276 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574251.172000:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574251.172003:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574251.172007:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361026432:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574251.554978:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574251.554993:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574251.555017:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574251.555051:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574251.555074:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574251.555075:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574252.194946:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574252.578968:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574252.578968:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574252.579008:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574252.579009:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574252.579050:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574252.579106:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574253.218985:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574253.602981:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574253.602981:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574253.602984:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574253.602987:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574253.603017:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574253.603066:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574254.242925:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574254.627005:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574254.627006:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574254.627011:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574254.627020:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574254.627058:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574254.627079:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574255.267016:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574255.650987:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574255.650988:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574255.650988:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574255.650988:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574255.651019:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574255.651078:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1788574256.290994:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788574256.290998:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574256.291008:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788574256.291013:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574256.291024:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2601
00000100:00080000:0.0:1788574256.291036:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574256.291044:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574256.291098:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453361026560/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574256.291126:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574256.291129:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574256.291132:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574256.291136:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2601
00000100:00080000:0.0:1788574256.291139:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574256.291144:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574256.291155:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574256.291169:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361026688/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574256.291172:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361026560:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788574256.291189:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574256.291193:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574256.291195:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574256.291199:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2601
00000100:00080000:0.0:1788574256.291202:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574256.291206:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574256.291211:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574256.291222:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361026816/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574256.291230:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574256.291233:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574256.291235:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574256.291238:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2601
00000100:00080000:0.0:1788574256.291241:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574256.291244:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574256.291249:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1788574256.291252:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574256.291258:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361026944/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574256.291266:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574256.291269:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574256.291270:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574256.291274:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2601
00000100:00080000:0.0:1788574256.291279:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574256.291282:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574256.291287:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574256.291297:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361027072/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574256.291304:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574256/real 1788574256]  req@ffff8dc006710380 x1875453361026560/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574281 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574256.291306:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574256.291310:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574256.291312:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574256.291316:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2601
00000100:00080000:0.0:1788574256.291319:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574256.291322:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574256.291325:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453361026560/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574281 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1788574256.291327:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574256.291338:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361027200/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574256.291338:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574256.291342:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574256.291346:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361026560:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788574256.291347:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574256.291351:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574256.291352:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574256.291355:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2601
00000100:00080000:0.0:1788574256.291358:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574256.291361:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574256.291365:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574256.291374:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361026688:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574256.291375:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361027328/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788574256.291398:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574256.291417:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574256/real 1788574256]  req@ffff8dc006712680 x1875453361026688/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574281 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574256.291430:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361026688/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574281 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574256.291442:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574256.291445:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574256.291447:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361026688:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574256.291464:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361026816:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574256.291486:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574256.291499:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574256/real 1788574256]  req@ffff8dc006713480 x1875453361026816/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574281 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574256.291513:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361026816/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574281 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574256.291523:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574256.291526:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574256.291529:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361026816:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574256.291536:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361026944:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574256.291556:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574256.291565:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574256/real 1788574256]  req@ffff8dc006711c00 x1875453361026944/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574281 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574256.291573:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361026944/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574281 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574256.291580:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574256.291582:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574256.291585:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361026944:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574256.291589:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361027072:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574256.291601:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574256.291607:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574256/real 1788574256]  req@ffff8dc006711500 x1875453361027072/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574281 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574256.291636:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361027072/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574281 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574256.291643:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574256.291645:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574256.291647:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361027072:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574256.291652:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361027200:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574256.291666:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574256.291673:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574256/real 1788574256]  req@ffff8dc006712300 x1875453361027200/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574281 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574256.291681:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361027200/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574281 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574256.291687:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574256.291689:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574256.291691:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361027200:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574256.291705:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361027328:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574256.291715:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574256.291721:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574256/real 1788574256]  req@ffff8dc006713800 x1875453361027328/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574281 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574256.291728:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361027328/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574281 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574256.291733:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574256.291735:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574256.291738:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361027328:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574256.675037:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574256.675037:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574256.675067:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574256.675084:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574256.675100:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788574256.675120:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574257.314980:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574257.698961:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574257.698963:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574257.698970:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574257.698970:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574257.699002:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574257.699035:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574258.339056:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574258.723022:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574258.723022:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574258.723027:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574258.723076:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574258.723109:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574258.723113:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574259.362988:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574259.746982:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574259.746985:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574259.746996:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574259.746998:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574259.747029:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574259.747031:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574260.386999:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574260.771001:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574260.771001:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574260.771001:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574260.771053:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574260.771075:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788574260.771108:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1788574261.410994:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574261.411005:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:1.0:1788574261.411010:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574261.411011:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574261.411025:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2607
00000100:00080000:0.0:1788574261.411040:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574261.411048:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574261.411103:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361027456/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574261.411130:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574261.411133:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574261.411134:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574261.411138:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2607
00000100:00080000:0.0:1788574261.411140:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574261.411143:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574261.411155:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574261.411173:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361027584/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574261.411180:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361027456:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788574261.411206:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574261.411210:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574261.411213:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574261.411221:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2607
00000100:00080000:0.0:1788574261.411227:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574261.411232:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574261.411240:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574261.411260:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361027712/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574261.411269:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574261.411277:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574261.411279:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1788574261.411279:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788574261.411292:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2607
00000100:00080000:0.0:1788574261.411297:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574261.411303:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574261.411310:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574261.411327:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361027840/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574261.411339:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788574261.411343:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574261/real 1788574261]  req@ffff8dc006713100 x1875453361027456/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574286 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574261.411345:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574261.411349:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574261.411363:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2607
00000100:00080000:0.0:1788574261.411391:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574261.411400:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574261.411401:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361027456/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574286 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1788574261.411409:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1788574261.411414:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574261.411422:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574261.411431:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361027968/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574261.411432:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361027456:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788574261.411455:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574261.411461:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574261.411464:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574261.411473:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2607
00000100:00100000:1.0:1788574261.411475:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361027584:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788574261.411485:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574261.411494:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574261.411501:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1788574261.411507:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574261.411520:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361028096/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574261.411527:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574261/real 1788574261]  req@ffff8dc006712a00 x1875453361027584/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574286 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574261.411544:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574261.411555:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574261.411561:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574261.411573:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2607
00000100:00080000:0.0:1788574261.411577:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788574261.411579:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361027584/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574286 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574261.411591:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574261.411594:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574261.411596:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361027584:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574261.411604:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361027712:192.168.202.140@tcp:8:kworker.0
00000100:00080000:0.0:1788574261.411608:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574261.411616:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574261.411632:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361028224/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788574261.411637:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574261.411662:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574261/real 1788574261]  req@ffff8dc006711880 x1875453361027712/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574286 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574261.411673:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361027712/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574286 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574261.411679:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574261.411682:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574261.411684:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361027712:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574261.411688:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361027840:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574261.411700:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574261.411707:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574261/real 1788574261]  req@ffff8dc006710e00 x1875453361027840/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574286 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574261.411714:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361027840/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574286 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574261.411725:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574261.411727:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574261.411733:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361027840:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574261.411737:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361027968:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574261.411749:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574261.411755:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574261/real 1788574261]  req@ffff8dc006713b80 x1875453361027968/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574286 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574261.411762:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361027968/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574286 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574261.411768:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574261.411770:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574261.411772:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361027968:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574261.411786:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361028096:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574261.411797:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574261.411803:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574261/real 1788574261]  req@ffff8dc006713100 x1875453361028096/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574286 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574261.411811:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361028096/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574286 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574261.411816:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574261.411818:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574261.411820:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361028096:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574261.411825:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361028224:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574261.411834:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574261.411840:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574261/real 1788574261]  req@ffff8dc006713800 x1875453361028224/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574286 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574261.411847:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361028224/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574286 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574261.411852:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574261.411854:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574261.411856:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361028224:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574261.794984:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574261.795019:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574261.795030:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574261.795124:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574261.795156:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574261.795156:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574262.434995:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574262.818973:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574262.818986:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574262.818993:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788574262.819004:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574262.819012:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574262.819017:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574263.458946:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574263.842969:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574263.842974:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574263.842975:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574263.842978:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574263.843012:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574263.843043:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574264.482969:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574264.866942:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574264.866943:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574264.866969:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574264.866985:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788574264.866990:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574264.867006:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574265.506995:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574265.890980:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574265.890980:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574265.890983:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574265.890988:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574265.891019:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574265.891054:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1788574266.530965:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574266.530973:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788574266.530977:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574266.530986:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2612
00000100:00100000:0.0:1788574266.530991:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574266.530995:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574266.531005:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574266.531045:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361028352/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574266.531071:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574266.531075:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574266.531077:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574266.531081:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2612
00000100:00080000:1.0:1788574266.531086:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574266.531091:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574266.531104:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574266.531113:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361028352:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788574266.531124:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361028480/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574266.531143:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574266.531147:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574266.531150:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574266.531156:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2612
00000100:00080000:1.0:1788574266.531173:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574266.531180:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:0.0:1788574266.531186:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:1.0:1788574266.531190:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574266.531205:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361028608/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574266.531215:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574266.531220:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574266.531223:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574266.531227:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2612
00000100:00100000:0.0:1788574266.531233:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574266/real 1788574266]  req@ffff8dc005dc0700 x1875453361028352/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574291 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574266.531244:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574266.531252:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574266.531258:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574266.531259:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361028352/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574291 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574266.531274:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1788574266.531275:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361028736/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574266.531282:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574266.531304:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361028352:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574266.531305:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574266.531312:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574266.531314:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574266.531318:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2612
00000100:00080000:1.0:1788574266.531322:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574266.531325:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574266.531331:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574266.531333:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361028480:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574266.531351:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361028864/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1788574266.531364:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788574266.531367:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574266.531373:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574266.531375:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788574266.531379:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574266/real 1788574266]  req@ffff8dc005dc1180 x1875453361028480/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574291 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574266.531395:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2612
00000100:00100000:0.0:1788574266.531397:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361028480/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574291 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574266.531401:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574266.531408:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:0.0:1788574266.531411:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:1.0:1788574266.531414:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1788574266.531417:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574266.531422:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361028480:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574266.531427:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361028608:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574266.531435:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361028992/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574266.531444:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1788574266.531447:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788574266.531449:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574266.531452:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574266.531457:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2612
00000100:00080000:1.0:1788574266.531460:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574266.531466:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574266.531467:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574266/real 1788574266]  req@ffff8dc005dc3b80 x1875453361028608/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574291 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1788574266.531469:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574266.531482:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361029120/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574266.531492:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361028608/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574291 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574266.531505:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574266.531510:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574266.531513:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361028608:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574266.531521:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361028736:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574266.531542:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574266.531552:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574266/real 1788574266]  req@ffff8dc005dc1500 x1875453361028736/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574291 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574266.531561:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361028736/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574291 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574266.531567:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574266.531569:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574266.531572:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361028736:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574266.531584:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361028864:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574266.531598:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574266.531606:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574266/real 1788574266]  req@ffff8dc005dc1c00 x1875453361028864/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574291 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574266.531614:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361028864/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574291 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574266.531620:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574266.531622:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574266.531624:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361028864:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574266.531629:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361028992:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574266.531649:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574266.531662:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574266/real 1788574266]  req@ffff8dc005dc3800 x1875453361028992/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574291 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574266.531677:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361028992/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574291 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574266.531698:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574266.531703:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574266.531707:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361028992:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574266.531715:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361029120:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574266.531741:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574266.531752:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574266/real 1788574266]  req@ffff8dc005dc2d80 x1875453361029120/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574291 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574266.531760:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361029120/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574291 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574266.531770:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574266.531772:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574266.531774:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361029120:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574266.914952:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574266.914954:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574266.914955:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574266.914985:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574266.915005:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788574266.915073:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574267.554956:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574267.938934:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574267.938953:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574267.938960:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574267.938970:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574267.938985:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574267.939030:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574268.578954:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574268.962971:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574268.962982:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574268.963013:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574268.963016:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574268.963029:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788574268.963144:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574269.602935:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574269.986980:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574269.986982:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574269.986990:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574269.987013:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574269.987013:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574269.987024:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574270.626968:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574271.010962:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574271.010964:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574271.010969:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574271.010998:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574271.011001:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788574271.011007:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1788574271.650991:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574271.651004:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:1.0:1788574271.651008:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574271.651010:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574271.651029:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2617
00000100:00080000:0.0:1788574271.651044:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574271.651053:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574271.651107:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361029248/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574271.651146:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574271.651150:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574271.651153:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574271.651160:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2617
00000100:00080000:0.0:1788574271.651165:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574271.651171:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574271.651185:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361029248:192.168.202.140@tcp:250:kworker.0
00000008:00100000:0.0:1788574271.651186:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574271.651228:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361029376/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574271.651243:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574271.651247:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574271.651249:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574271.651254:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2617
00000100:00080000:0.0:1788574271.651259:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574271.651265:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:1.0:1788574271.651270:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:0.0:1788574271.651281:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574271.651302:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361029504/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574271.651313:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574271/real 1788574271]  req@ffff8dc006712300 x1875453361029248/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574296 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574271.651317:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574271.651335:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574271.651341:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574271.651352:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2617
00000100:00100000:1.0:1788574271.651353:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361029248/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574296 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574271.651363:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574271.651368:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574271.651376:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:1.0:1788574271.651379:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574271.651387:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361029248:192.168.202.140@tcp:250:kworker.0
00000008:00100000:0.0:1788574271.651390:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574271.651416:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361029376:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574271.651417:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361029632/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574271.651440:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1788574271.651449:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788574271.651458:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574271.651462:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1788574271.651468:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574271/real 1788574271]  req@ffff8dc006711500 x1875453361029376/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574296 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574271.651472:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2617
00000100:00080000:0.0:1788574271.651479:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574271.651492:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574271.651507:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361029376/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574296 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1788574271.651508:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1788574271.651529:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574271.651533:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574271.651535:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361029376:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574271.651543:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361029504:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574271.651548:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361029760/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788574271.651562:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788574271.651563:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574271.651570:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574271.651573:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1788574271.651574:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574271/real 1788574271]  req@ffff8dc006711c00 x1875453361029504/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574296 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574271.651591:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2617
00000100:00100000:1.0:1788574271.651595:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361029504/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574296 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574271.651602:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574271.651606:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574271.651613:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788574271.651614:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574271.651621:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361029504:192.168.202.140@tcp:8:kworker.0
00000008:00100000:0.0:1788574271.651628:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574271.651636:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361029632:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574271.651649:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453361029888/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788574271.651658:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574271.651673:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574271/real 1788574271]  req@ffff8dc006713480 x1875453361029632/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574296 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574271.651678:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574271.651689:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1788574271.651690:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361029632/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574296 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574271.651692:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574271.651700:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574271.651707:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788574271.651721:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2617
00000100:00100000:1.0:1788574271.651721:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361029632:192.168.202.140@tcp:8:kworker.0
00000100:00080000:0.0:1788574271.651741:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788574271.651741:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361029760:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788574271.651751:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574271.651763:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1788574271.651770:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574271.651782:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574271/real 1788574271]  req@ffff8dc006712680 x1875453361029760/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574296 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574271.651788:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361030016/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574271.651809:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361029760/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574296 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574271.651826:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574271.651831:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574271.651833:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361029760:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574271.651847:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361029888:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574271.651861:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574271.651889:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574271/real 1788574271]  req@ffff8dc006710380 x1875453361029888/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574296 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574271.651898:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453361029888/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574296 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574271.651904:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574271.651906:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574271.651908:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361029888:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574271.651912:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361030016:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574271.651923:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574271.651930:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574271/real 1788574271]  req@ffff8dc006711c00 x1875453361030016/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574296 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574271.651940:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361030016/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574296 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574271.651948:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574271.651952:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574271.651955:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361030016:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574272.034985:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574272.034985:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574272.034985:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574272.034995:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574272.035014:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574272.035056:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574272.674979:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574273.058987:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574273.058987:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574273.058988:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574273.058988:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574273.059024:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574273.059101:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574273.698960:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574274.082970:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574274.082972:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574274.082976:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574274.082985:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574274.083017:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574274.083038:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574274.722957:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574275.106959:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574275.106960:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574275.106965:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574275.107014:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574275.107015:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574275.107030:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574275.746986:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574276.130985:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574276.130985:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574276.131015:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574276.131104:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788574276.131172:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574276.131174:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00080000:0.0:1788574276.770963:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788574276.770963:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574276.770971:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788574276.770975:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574276.770983:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2622
00000100:00080000:0.0:1788574276.770992:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574276.770999:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574276.771032:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361030144/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574276.771062:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574276.771066:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574276.771068:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574276.771073:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2622
00000100:00080000:0.0:1788574276.771077:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574276.771081:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574276.771091:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574276.771103:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361030144:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788574276.771107:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361030272/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574276.771117:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574276.771119:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574276.771121:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574276.771124:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2622
00000100:00080000:0.0:1788574276.771126:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574276.771141:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574276.771146:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574276.771156:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361030400/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574276.771163:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574276.771165:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574276.771167:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574276.771169:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2622
00000800:00000100:1.0:1788574276.771177:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788574276.771178:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574276.771183:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574276.771186:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574276.771195:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361030528/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574276.771201:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574276.771205:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574276.771207:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574276.771212:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2622
00000100:00080000:0.0:1788574276.771216:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574276.771220:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574276.771226:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574276.771233:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574276/real 1788574276]  req@ffff8dc006711500 x1875453361030144/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574301 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574276.771241:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361030656/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574276.771257:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574276.771261:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574276.771263:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1788574276.771263:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361030144/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574301 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574276.771271:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2622
00000100:00080000:0.0:1788574276.771277:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574276.771282:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:1.0:1788574276.771283:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1788574276.771286:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1788574276.771289:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574276.771294:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361030144:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788574276.771299:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361030784/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574276.771307:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574276.771309:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574276.771310:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574276.771312:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2622
00000100:00080000:0.0:1788574276.771315:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574276.771320:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574276.771320:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361030272:192.168.202.140@tcp:38:kworker.0
00000008:00100000:0.0:1788574276.771327:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574276.771337:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361030912/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788574276.771351:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574276.771364:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574276/real 1788574276]  req@ffff8dc006712300 x1875453361030272/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574301 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574276.771373:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361030272/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574301 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574276.771381:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574276.771383:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574276.771385:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361030272:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574276.771390:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361030400:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574276.771403:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574276.771410:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574276/real 1788574276]  req@ffff8dc006713800 x1875453361030400/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574301 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574276.771418:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361030400/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574301 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574276.771424:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574276.771427:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574276.771429:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361030400:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574276.771432:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361030528:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574276.771453:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574276.771460:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574276/real 1788574276]  req@ffff8dc006713100 x1875453361030528/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574301 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574276.771468:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361030528/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574301 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574276.771474:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574276.771476:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574276.771478:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361030528:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574276.771481:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361030656:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574276.771492:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574276.771498:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574276/real 1788574276]  req@ffff8dc006713b80 x1875453361030656/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574301 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574276.771505:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361030656/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574301 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574276.771515:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574276.771517:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574276.771519:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361030656:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574276.771522:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361030784:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574276.771532:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574276.771538:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574276/real 1788574276]  req@ffff8dc006710e00 x1875453361030784/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574301 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574276.771545:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361030784/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574301 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574276.771550:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574276.771552:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574276.771554:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361030784:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574276.771566:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361030912:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574276.771576:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574276.771582:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574276/real 1788574276]  req@ffff8dc006711880 x1875453361030912/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574301 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574276.771589:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361030912/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574301 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574276.771594:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574276.771596:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574276.771599:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361030912:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574277.154941:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574277.154948:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574277.154966:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574277.154981:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574277.154991:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574277.155038:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574277.794968:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574278.178976:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574278.178976:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574278.178977:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574278.178977:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574278.179009:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788574278.179081:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574278.818946:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574279.202952:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574279.202952:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574279.202953:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574279.202978:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574279.202999:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574279.203031:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574279.842976:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574280.226969:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574280.226969:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574280.226969:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574280.226972:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574280.227013:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788574280.227070:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574280.866964:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574281.250930:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574281.250953:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574281.250956:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574281.250960:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574281.250984:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574281.251019:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574281.890995:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574281.891027:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574281.891039:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788574281.891045:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574281.891071:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2627
00000100:00080000:1.0:1788574281.891085:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574281.891095:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574281.891147:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361031040/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574281.891181:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574281.891184:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574281.891186:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574281.891189:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2627
00000100:00080000:1.0:1788574281.891192:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574281.891195:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574281.891213:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574281.891228:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361031168/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574281.891236:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361031040:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574281.891267:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574281.891269:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574281.891270:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574281.891274:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2627
00000100:00080000:1.0:1788574281.891276:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574281.891278:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574281.891283:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574281.891292:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361031296/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574281.891299:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574281.891302:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574281.891304:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574281.891307:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2627
00000100:00080000:1.0:1788574281.891318:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574281.891321:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574281.891323:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788574281.891328:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574281.891334:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361031424/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574281.891345:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574281.891349:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574281.891350:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574281.891354:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2627
00000100:00080000:1.0:1788574281.891357:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574281.891360:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574281.891365:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574281.891370:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574281/real 1788574281]  req@ffff8dc005dc0a80 x1875453361031040/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574306 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574281.891379:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361031552/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574281.891397:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788574281.891404:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361031040/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574306 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574281.891418:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574281.891427:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574281.891431:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574281.891437:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2627
00000100:00080000:0.0:1788574281.891443:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788574281.891443:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574281.891454:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574281.891455:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361031040:192.168.202.140@tcp:250:kworker.0
00000008:00100000:1.0:1788574281.891470:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574281.891495:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361031168:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574281.891496:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361031680/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574281.891518:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1788574281.891527:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788574281.891528:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574281.891534:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574281.891541:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2627
00000100:00080000:1.0:1788574281.891547:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574281.891553:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574281.891560:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574281.891569:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574281/real 1788574281]  req@ffff8dc005dc2d80 x1875453361031168/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574306 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574281.891578:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361031808/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574281.891598:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361031168/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574306 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574281.891625:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574281.891628:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574281.891638:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361031168:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574281.891645:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361031296:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574281.891673:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574281.891687:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574281/real 1788574281]  req@ffff8dc005dc3800 x1875453361031296/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574306 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574281.891699:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361031296/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574306 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574281.891708:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574281.891712:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574281.891715:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361031296:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574281.891722:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361031424:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574281.891754:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574281.891767:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574281/real 1788574281]  req@ffff8dc005dc1c00 x1875453361031424/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574306 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574281.891780:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361031424/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574306 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574281.891790:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574281.891793:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574281.891797:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361031424:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574281.891802:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361031552:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574281.891817:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574281.891825:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574281/real 1788574281]  req@ffff8dc005dc1500 x1875453361031552/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574306 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574281.891833:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361031552/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574306 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574281.891839:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574281.891841:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574281.891843:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361031552:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574281.891857:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361031680:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574281.891889:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574281.891897:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574281/real 1788574281]  req@ffff8dc005dc3b80 x1875453361031680/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574306 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574281.891904:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361031680/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574306 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574281.891910:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574281.891912:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574281.891914:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361031680:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574281.891918:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361031808:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574281.891929:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574281.891936:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574281/real 1788574281]  req@ffff8dc005dc1180 x1875453361031808/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574306 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574281.891943:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361031808/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574306 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574281.891949:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574281.891950:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574281.891952:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361031808:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574282.274969:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574282.274974:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574282.274974:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574282.274997:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574282.275041:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788574282.275097:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574282.915026:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574283.298982:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574283.298982:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574283.298982:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574283.299130:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574283.299145:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574283.299193:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574283.938922:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574284.322993:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574284.322993:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574284.322999:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574284.323040:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574284.323078:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574284.323125:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574284.962963:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574285.347009:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574285.347020:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574285.347024:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574285.347036:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574285.347059:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574285.347114:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574285.986974:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574286.370957:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574286.370957:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574286.370973:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574286.371007:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574286.371020:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788574286.371056:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1788574287.011022:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788574287.011027:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788574287.011032:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788574287.011037:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574287.011047:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2632
00000100:00080000:2.0:1788574287.011058:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574287.011067:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574287.011107:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361031936/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574287.011136:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574287.011140:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574287.011142:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574287.011147:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2632
00000100:00080000:2.0:1788574287.011151:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574287.011157:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574287.011166:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574287.011180:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361031936:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788574287.011181:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453361032064/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574287.011195:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574287.011198:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574287.011200:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574287.011203:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2632
00000100:00080000:2.0:1788574287.011206:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574287.011209:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574287.011213:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574287.011222:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453361032192/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574287.011229:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574287.011233:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574287.011235:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574287.011238:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2632
00000100:00080000:2.0:1788574287.011242:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574287.011245:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574287.011250:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574287.011261:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453361032320/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574287.011271:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574287.011273:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:0.0:1788574287.011277:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361032064:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788574287.011277:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574287.011286:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2632
00000100:00080000:2.0:1788574287.011289:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574287.011291:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574287.011295:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574287.011306:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453361032448/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574287.011312:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361032192:192.168.202.140@tcp:8:kworker.0
00000100:00080000:2.0:1788574287.011316:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574287.011319:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574287.011321:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574287.011325:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2632
00000100:00080000:2.0:1788574287.011328:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574287.011331:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574287.011335:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574287.011342:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361032320:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574287.011346:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361032576/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574287.011356:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574287.011359:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574287.011360:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574287.011363:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2632
00000100:00080000:2.0:1788574287.011367:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574287.011369:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574287.011373:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574287.011383:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361032448:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574287.011384:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361032704/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574287.011429:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361032576:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574287.011443:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361032704:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574287.394993:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574287.394993:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574287.394995:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574287.395006:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574287.395032:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574287.395064:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574288.035119:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574288.418941:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574288.418941:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574288.418972:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574288.419164:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574288.419180:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574288.419245:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574289.058961:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574289.442991:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574289.442995:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574289.442998:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574289.443025:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574289.443030:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574289.443044:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574290.082962:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000400:00000100:1.0:1788574290.083102:0:2336:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.140:988
00000400:00000100:1.0:1788574290.083136:0:2336:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.140@tcp at host 192.168.202.140 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:1.0:1788574290.083150:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788574290.083179:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788574290.083186:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788574290.083193:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788574290.083200:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788574290.083206:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:0.0:1788574290.083211:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574287/real 1788574290]  req@ffff8dc020494380 x1875453361032320/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574312 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:1.0:1788574290.083216:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:0.0:1788574290.083238:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453361032320/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574312 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574290.083248:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574290.083256:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574290.083260:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361032320:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574290.083265:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574287/real 1788574290]  req@ffff8dc020496a00 x1875453361032448/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574312 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574290.083273:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453361032448/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574312 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574290.083279:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574290.083281:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574290.083292:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361032448:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574290.083302:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574287/real 1788574290]  req@ffff8dc020497100 x1875453361032064/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574312 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574290.083315:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453361032064/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574312 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574290.083326:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574290.083330:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574290.083333:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361032064:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574290.083344:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574287/real 1788574290]  req@ffff8dc020494e00 x1875453361032192/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574312 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574290.083357:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453361032192/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574312 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574290.083366:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574290.083370:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574290.083373:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361032192:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574290.083380:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574287/real 1788574290]  req@ffff8dc020495500 x1875453361031936/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574312 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574290.083394:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361031936/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574312 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574290.083401:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574290.083405:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574290.083408:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361031936:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788574290.083439:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574287/real 1788574290]  req@ffff8dc020494700 x1875453361032576/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574312 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574290.083454:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361032576/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574312 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574290.083463:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574290.083467:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574290.083471:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361032576:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574290.083478:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574287/real 1788574290]  req@ffff8dc020495880 x1875453361032704/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574312 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574290.083490:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361032704/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574312 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574290.083498:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574290.083501:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574290.083505:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361032704:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574290.466970:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574290.467001:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574290.467023:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574290.467035:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788574290.467045:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574290.467081:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574291.107003:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574291.491012:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574291.491013:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574291.491051:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574291.491058:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574291.491097:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788574291.491132:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574292.130964:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788574292.130964:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574292.130973:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788574292.130978:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574292.130985:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2637
00000100:00080000:2.0:1788574292.130995:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574292.131002:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574292.131032:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453361032832/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574292.131053:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574292.131056:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574292.131057:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574292.131060:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2637
00000100:00080000:2.0:1788574292.131063:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574292.131067:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574292.131075:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574292.131084:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453361032960/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574292.131089:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361032832:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788574292.131097:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574292.131100:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574292.131101:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574292.131104:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2637
00000100:00080000:2.0:1788574292.131107:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574292.131110:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574292.131114:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574292.131124:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453361033088/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574292.131133:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574292.131137:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574292.131140:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574292.131144:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2637
00000100:00080000:2.0:1788574292.131148:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1788574292.131151:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788574292.131157:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574292.131164:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574292.131179:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361033216/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574292.131188:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574292/real 1788574292]  req@ffff8dc020496d80 x1875453361032832/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574317 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574292.131194:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574292.131205:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574292.131209:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574292.131219:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2637
00000100:00080000:2.0:1788574292.131225:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788574292.131232:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453361032832/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574317 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574292.131233:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574292.131242:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574292.131257:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361033344/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574292.131260:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574292.131269:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788574292.131276:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788574292.131277:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361032832:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788574292.131285:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574292.131289:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574292.131295:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2637
00000100:00080000:2.0:1788574292.131300:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574292.131305:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574292.131311:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574292.131312:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361032960:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574292.131331:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453361033472/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574292.131345:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1788574292.131348:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788574292.131351:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574292.131355:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574292.131361:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2637
00000100:00080000:2.0:1788574292.131366:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574292.131373:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574292.131374:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574292/real 1788574292]  req@ffff8dc020494a80 x1875453361032960/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574317 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1788574292.131383:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574292.131394:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453361032960/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574317 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574292.131401:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361033600/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574292.131415:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574292.131422:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574292.131427:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361032960:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574292.131436:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361033088:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574292.131460:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574292.131472:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574292/real 1788574292]  req@ffff8dc020497480 x1875453361033088/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574317 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574292.131484:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453361033088/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574317 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574292.131498:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574292.131502:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574292.131505:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361033088:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574292.131511:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361033216:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574292.131530:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574292.131541:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574292/real 1788574292]  req@ffff8dc020495180 x1875453361033216/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574317 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574292.131554:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361033216/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574317 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574292.131563:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574292.131567:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574292.131570:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361033216:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574292.131576:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361033344:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574292.131597:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574292.131609:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574292/real 1788574292]  req@ffff8dc020494000 x1875453361033344/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574317 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574292.131640:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361033344/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574317 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574292.131650:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574292.131654:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574292.131658:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361033344:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574292.131678:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361033472:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574292.131699:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574292.131712:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574292/real 1788574292]  req@ffff8dc020496d80 x1875453361033472/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574317 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574292.131722:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453361033472/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574317 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574292.131730:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574292.131733:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574292.131736:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361033472:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574292.131742:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361033600:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574292.131759:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574292.131769:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574292/real 1788574292]  req@ffff8dc020495880 x1875453361033600/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574317 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574292.131780:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361033600/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574317 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574292.131788:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574292.131791:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574292.131793:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361033600:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574292.514977:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574292.514977:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574292.514985:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574292.515009:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574292.515022:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788574292.515039:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574293.154946:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574293.538983:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574293.538984:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574293.538989:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574293.539017:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574293.539021:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574293.539022:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574294.178966:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574294.562962:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574294.562962:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574294.562966:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788574294.562993:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574294.562999:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574294.562999:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574295.202929:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574295.586982:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574295.586982:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574295.586982:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574295.587013:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574295.587015:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574295.587017:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574296.226933:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574296.610941:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574296.610952:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574296.610958:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574296.610959:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574296.610985:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788574296.611017:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1788574297.250978:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788574297.250986:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574297.250990:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788574297.250997:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574297.251019:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2642
00000100:00080000:0.0:1788574297.251030:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574297.251037:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574297.251072:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361033728/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574297.251096:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574297.251099:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574297.251100:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574297.251103:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2642
00000100:00080000:0.0:1788574297.251110:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574297.251113:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574297.251121:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574297.251132:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361033856/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574297.251140:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574297.251143:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574297.251145:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574297.251150:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2642
00000100:00100000:1.0:1788574297.251153:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361033728:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788574297.251154:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574297.251162:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574297.251166:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574297.251174:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361033984/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574297.251185:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574297.251189:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574297.251191:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574297.251195:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2642
00000100:00080000:0.0:1788574297.251208:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1788574297.251214:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788574297.251216:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574297.251223:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574297.251238:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361034112/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574297.251246:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574297.251248:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574297.251250:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1788574297.251254:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574297/real 1788574297]  req@ffff8dc006712a00 x1875453361033728/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574322 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574297.251257:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2642
00000100:00080000:0.0:1788574297.251265:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574297.251270:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574297.251275:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574297.251277:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361033728/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574322 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574297.251287:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1788574297.251288:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361034240/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574297.251296:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574297.251300:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788574297.251301:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574297.251304:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1788574297.251306:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361033728:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788574297.251311:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2642
00000100:00080000:0.0:1788574297.251315:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788574297.251317:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361033856:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788574297.251323:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574297.251330:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1788574297.251341:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574297.251347:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361034368/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574297.251353:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574297/real 1788574297]  req@ffff8dc006711880 x1875453361033856/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574322 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574297.251373:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788574297.251376:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361033856/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574322 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574297.251378:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574297.251382:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574297.251391:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2642
00000100:00080000:1.0:1788574297.251392:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574297.251396:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574297.251398:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788574297.251403:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574297.251404:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361033856:192.168.202.140@tcp:38:kworker.0
00000008:00100000:0.0:1788574297.251414:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574297.251427:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361034496/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574297.251432:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361033984:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574297.251448:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574297.251462:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574297/real 1788574297]  req@ffff8dc006710e00 x1875453361033984/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574322 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574297.251482:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361033984/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574322 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574297.251489:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574297.251492:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574297.251494:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361033984:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574297.251498:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361034112:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574297.251509:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574297.251516:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574297/real 1788574297]  req@ffff8dc006713b80 x1875453361034112/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574322 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574297.251524:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361034112/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574322 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574297.251533:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574297.251536:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574297.251539:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361034112:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574297.251546:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361034240:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574297.251566:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574297.251579:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574297/real 1788574297]  req@ffff8dc006713100 x1875453361034240/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574322 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574297.251591:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361034240/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574322 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574297.251601:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574297.251605:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574297.251608:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361034240:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574297.251614:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361034368:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574297.251632:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574297.251643:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574297/real 1788574297]  req@ffff8dc006713800 x1875453361034368/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574322 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574297.251654:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361034368/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574322 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574297.251662:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574297.251665:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574297.251669:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361034368:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574297.251684:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361034496:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574297.251701:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574297.251711:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574297/real 1788574297]  req@ffff8dc006712300 x1875453361034496/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574322 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574297.251723:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361034496/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574322 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574297.251737:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574297.251740:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574297.251743:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361034496:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574297.634965:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574297.634968:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574297.634968:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574297.634985:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574297.635012:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574297.635039:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574298.274960:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574298.658968:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574298.659005:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574298.659008:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574298.659009:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574298.659041:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788574298.659125:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574299.298983:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574299.682957:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574299.682966:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574299.682988:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574299.682989:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574299.682990:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574299.683015:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574300.322942:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574300.706943:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574300.706943:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574300.706943:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574300.706952:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574300.706988:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788574300.707038:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574301.346984:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574301.730963:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574301.730969:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574301.730971:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574301.730972:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574301.731006:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574301.731031:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574302.370978:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788574302.370986:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574302.370991:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788574302.370995:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574302.371003:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2648
00000100:00080000:3.0:1788574302.371011:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574302.371018:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788574302.371047:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f800 x1875453361034624/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574302.371067:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574302.371070:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574302.371071:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574302.371074:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2648
00000100:00080000:3.0:1788574302.371076:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574302.371079:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574302.371088:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574302.371098:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361034624:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788574302.371099:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c000 x1875453361034752/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574302.371112:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574302.371114:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574302.371116:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574302.371118:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2648
00000100:00080000:3.0:1788574302.371121:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574302.371123:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574302.371127:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574302.371138:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644dc00 x1875453361034880/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574302.371149:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574302.371152:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574302.371153:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574302.371156:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2648
00000100:00080000:3.0:1788574302.371158:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574302.371162:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:1.0:1788574302.371166:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:3.0:1788574302.371168:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574302.371179:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ce00 x1875453361035008/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574302.371185:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574302.371187:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574302.371189:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574302.371191:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2648
00000100:00080000:3.0:1788574302.371194:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574302.371197:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574302.371200:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574302.371204:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574302/real 1788574302]  req@ffff8dc00644f800 x1875453361034624/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574327 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574302.371212:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ca80 x1875453361035136/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574302.371224:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f800 x1875453361034624/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574327 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574302.371233:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574302.371236:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574302.371238:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361034624:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788574302.371257:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361034752:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788574302.371271:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1788574302.371277:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788574302.371277:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574302.371281:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574302.371288:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2648
00000100:00100000:1.0:1788574302.371292:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574302/real 1788574302]  req@ffff8dc00644c000 x1875453361034752/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574327 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574302.371296:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574302.371306:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574302.371309:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c000 x1875453361034752/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574327 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1788574302.371314:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1788574302.371318:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574302.371322:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574302.371324:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361034752:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574302.371330:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361034880:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574302.371336:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ea00 x1875453361035264/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788574302.371347:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788574302.371349:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574302.371353:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574302.371355:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1788574302.371357:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574302/real 1788574302]  req@ffff8dc00644dc00 x1875453361034880/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574327 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574302.371361:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2648
00000100:00080000:3.0:1788574302.371368:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574302.371374:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574302.371376:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644dc00 x1875453361034880/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574327 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1788574302.371379:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1788574302.371389:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574302.371392:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574302.371396:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d500 x1875453361035392/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574302.371397:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361034880:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574302.371407:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361035008:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574302.371425:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574302.371432:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574302/real 1788574302]  req@ffff8dc00644ce00 x1875453361035008/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574327 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574302.371439:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ce00 x1875453361035008/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574327 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574302.371450:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574302.371452:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574302.371465:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361035008:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574302.371486:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361035136:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574302.371512:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574302.371525:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574302/real 1788574302]  req@ffff8dc00644ca80 x1875453361035136/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574327 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574302.371538:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ca80 x1875453361035136/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574327 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574302.371549:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574302.371553:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574302.371557:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361035136:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574302.371565:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361035264:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574302.371587:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574302.371612:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574302/real 1788574302]  req@ffff8dc00644ea00 x1875453361035264/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574327 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574302.371628:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ea00 x1875453361035264/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574327 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574302.371636:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574302.371640:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574302.371645:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361035264:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574302.371653:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361035392:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574302.371676:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574302.371695:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574302/real 1788574302]  req@ffff8dc00644d500 x1875453361035392/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574327 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574302.371708:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d500 x1875453361035392/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574327 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574302.371715:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574302.371718:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574302.371721:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361035392:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574302.754991:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574302.754991:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574302.754991:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574302.754991:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574302.755025:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788574302.755094:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574303.395027:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574303.778989:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574303.778995:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574303.778999:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574303.779003:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574303.779021:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574303.779029:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574304.418973:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574304.802990:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574304.802990:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574304.802990:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574304.802990:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574304.803026:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788574304.803063:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574305.443010:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574305.826968:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574305.826983:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574305.827002:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574305.827003:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574305.827008:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574305.827022:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574306.466974:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574306.850999:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574306.850999:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574306.850999:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574306.851036:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574306.851038:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574306.851040:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574307.490969:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574307.490979:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574307.490984:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788574307.490988:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574307.490996:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2653
00000100:00080000:0.0:1788574307.491006:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574307.491012:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574307.491042:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361035520/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574307.491063:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574307.491067:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574307.491069:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574307.491073:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2653
00000100:00080000:0.0:1788574307.491077:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574307.491083:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574307.491094:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574307.491106:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361035520:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788574307.491112:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361035648/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574307.491124:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574307.491127:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574307.491128:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574307.491131:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2653
00000100:00080000:0.0:1788574307.491134:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574307.491137:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574307.491142:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574307.491152:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453361035776/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574307.491158:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574307.491161:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574307.491162:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574307.491164:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2653
00000100:00080000:0.0:1788574307.491167:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574307.491169:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574307.491174:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1788574307.491174:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574307.491197:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361035904/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574307.491203:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574307.491206:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574307.491208:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574307.491211:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2653
00000100:00080000:0.0:1788574307.491214:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574307.491218:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574307.491224:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574307.491224:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574307/real 1788574307]  req@ffff8dc006711500 x1875453361035520/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574332 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574307.491236:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361036032/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574307.491256:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574307.491264:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574307.491266:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574307.491269:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2653
00000100:00080000:0.0:1788574307.491272:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574307.491275:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574307.491278:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574307.491281:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361035520/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574332 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574307.491288:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361036160/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574307.491306:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574307.491307:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574307.491312:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574307.491315:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574307.491318:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788574307.491320:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2653
00000100:00080000:0.0:1788574307.491322:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574307.491324:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574307.491327:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574307.491333:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361036288/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574307.491341:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361035520:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788574307.491369:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361035648:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574307.491394:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574307.491408:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574307/real 1788574307]  req@ffff8dc006711c00 x1875453361035648/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574332 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574307.491421:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361035648/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574332 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574307.491431:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574307.491435:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574307.491439:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361035648:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574307.491445:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361035776:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574307.491464:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574307.491475:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574307/real 1788574307]  req@ffff8dc006710380 x1875453361035776/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574332 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574307.491487:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453361035776/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574332 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574307.491502:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574307.491506:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574307.491509:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361035776:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574307.491515:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361035904:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574307.491534:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574307.491544:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574307/real 1788574307]  req@ffff8dc006712680 x1875453361035904/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574332 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574307.491557:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361035904/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574332 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574307.491567:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574307.491571:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574307.491574:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361035904:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574307.491581:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361036032:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574307.491613:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574307.491626:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574307/real 1788574307]  req@ffff8dc006713480 x1875453361036032/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574332 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574307.491639:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361036032/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574332 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574307.491648:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574307.491651:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574307.491655:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361036032:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574307.491661:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361036160:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574307.491688:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574307.491699:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574307/real 1788574307]  req@ffff8dc006712300 x1875453361036160/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574332 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574307.491710:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361036160/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574332 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574307.491718:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574307.491722:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574307.491725:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361036160:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574307.491731:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361036288:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574307.491749:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574307.491767:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574307/real 1788574307]  req@ffff8dc006713800 x1875453361036288/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574332 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574307.491779:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361036288/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574332 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574307.491787:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574307.491790:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574307.491793:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361036288:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574307.874959:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574307.874965:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574307.874970:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574307.874981:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574307.875000:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574307.875039:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574308.515012:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574308.898989:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574308.898989:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574308.898989:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574308.898989:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574308.899019:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574308.899057:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574309.539007:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574309.922936:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574309.922970:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574309.922975:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574309.922983:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574309.922991:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574309.923031:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574310.562989:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574310.946941:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574310.946970:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574310.946972:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574310.946978:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574310.946998:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574310.947036:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574311.586998:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574311.971023:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574311.971041:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574311.971042:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574311.971047:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574311.971079:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574311.971147:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574312.610944:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574312.611006:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574312.611014:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788574312.611018:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574312.611028:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2658
00000100:00080000:1.0:1788574312.611038:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574312.611046:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574312.611080:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361036416/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574312.611112:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574312.611116:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574312.611117:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574312.611121:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2658
00000100:00080000:1.0:1788574312.611124:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574312.611127:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574312.611136:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574312.611151:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361036544/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574312.611152:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361036416:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574312.611167:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574312.611170:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574312.611171:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574312.611175:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2658
00000100:00080000:1.0:1788574312.611178:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574312.611180:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574312.611184:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574312.611193:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361036672/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574312.611200:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574312.611202:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574312.611204:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574312.611206:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2658
00000100:00080000:1.0:1788574312.611209:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574312.611211:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574312.611214:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788574312.611217:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574312.611225:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361036800/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574312.611233:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574312.611236:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574312.611237:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574312.611240:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2658
00000100:00080000:1.0:1788574312.611242:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574312.611245:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574312.611249:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574312.611257:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574312/real 1788574312]  req@ffff8dc005dc0700 x1875453361036416/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574337 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574312.611259:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361036928/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574312.611284:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574312.611287:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574312.611289:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788574312.611292:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361036416/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574337 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574312.611296:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2658
00000100:00080000:1.0:1788574312.611300:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574312.611307:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:0.0:1788574312.611309:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:1.0:1788574312.611311:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1788574312.611315:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574312.611320:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361036416:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788574312.611324:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361037056/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574312.611336:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574312.611340:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:0.0:1788574312.611343:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361036544:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788574312.611344:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574312.611353:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2658
00000100:00080000:1.0:1788574312.611359:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574312.611364:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:0.0:1788574312.611367:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:1.0:1788574312.611373:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574312.611385:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574312/real 1788574312]  req@ffff8dc005dc1180 x1875453361036544/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574337 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574312.611392:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361037184/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574312.611409:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361036544/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574337 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574312.611423:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574312.611428:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574312.611432:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361036544:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574312.611437:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361036672:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574312.611454:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574312.611465:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574312/real 1788574312]  req@ffff8dc005dc3b80 x1875453361036672/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574337 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574312.611477:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361036672/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574337 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574312.611486:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574312.611489:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574312.611493:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361036672:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574312.611500:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361036800:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574312.611520:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574312.611528:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574312/real 1788574312]  req@ffff8dc005dc1500 x1875453361036800/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574337 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574312.611537:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361036800/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574337 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574312.611543:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574312.611545:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574312.611547:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361036800:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574312.611551:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361036928:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574312.611563:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574312.611569:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574312/real 1788574312]  req@ffff8dc005dc1c00 x1875453361036928/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574337 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574312.611576:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361036928/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574337 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574312.611582:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574312.611583:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574312.611585:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361036928:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574312.611591:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361037056:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574312.611609:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574312.611620:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574312/real 1788574312]  req@ffff8dc005dc3800 x1875453361037056/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574337 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574312.611633:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361037056/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574337 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574312.611642:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574312.611645:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574312.611649:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361037056:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574312.611668:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361037184:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574312.611689:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574312.611698:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574312/real 1788574312]  req@ffff8dc005dc2d80 x1875453361037184/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574337 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574312.611706:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361037184/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574337 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574312.611712:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574312.611714:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574312.611716:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361037184:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574312.994983:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574312.994987:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574312.994999:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574312.995017:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574312.995025:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574312.995040:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574313.635013:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574314.018959:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574314.018959:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574314.018974:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574314.019003:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574314.019016:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574314.019035:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574314.658941:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574315.042967:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574315.042968:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574315.042968:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574315.042968:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574315.043015:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574315.043067:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574315.683022:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574316.066964:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574316.066977:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574316.067018:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574316.067019:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574316.067031:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574316.067091:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574316.707036:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574317.091032:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574317.091032:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574317.091049:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574317.091073:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574317.091087:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574317.091097:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574317.730988:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574317.730990:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574317.731001:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788574317.731006:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574317.731035:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2663
00000100:00080000:1.0:1788574317.731049:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574317.731059:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574317.731109:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361037312/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574317.731142:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574317.731147:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574317.731149:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574317.731153:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2663
00000100:00080000:1.0:1788574317.731158:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574317.731163:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574317.731177:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574317.731183:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361037312:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788574317.731197:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361037440/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574317.731211:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574317.731215:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574317.731217:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574317.731222:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2663
00000100:00080000:1.0:1788574317.731226:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574317.731231:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574317.731238:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574317.731253:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361037568/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574317.731265:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574317.731269:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000800:00000100:0.0:1788574317.731274:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788574317.731274:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574317.731283:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2663
00000100:00080000:1.0:1788574317.731288:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574317.731294:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574317.731300:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574317.731313:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361037696/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574317.731324:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788574317.731327:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574317/real 1788574317]  req@ffff8dc005dc0a80 x1875453361037312/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574342 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574317.731330:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574317.731335:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574317.731346:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2663
00000100:00080000:1.0:1788574317.731351:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788574317.731354:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361037312/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574342 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574317.731359:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574317.731370:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1788574317.731372:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574317.731379:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574317.731383:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361037312:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788574317.731389:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361037824/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574317.731401:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574317.731406:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574317.731409:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788574317.731410:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361037440:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788574317.731420:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2663
00000100:00080000:1.0:1788574317.731426:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574317.731431:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:0.0:1788574317.731437:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:1.0:1788574317.731438:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574317.731450:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574317/real 1788574317]  req@ffff8dc005dc2d80 x1875453361037440/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574342 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574317.731458:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361037952/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574317.731466:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361037440/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574342 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574317.731480:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574317.731483:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574317.731488:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574317.731490:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788574317.731493:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788574317.731496:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361037440:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788574317.731503:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2663
00000100:00100000:0.0:1788574317.731506:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361037568:192.168.202.140@tcp:8:kworker.0
00000100:00080000:1.0:1788574317.731510:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574317.731517:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574317.731524:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788574317.731527:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574317.731538:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574317/real 1788574317]  req@ffff8dc005dc3800 x1875453361037568/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574342 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574317.731543:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361038080/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574317.731555:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361037568/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574342 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574317.731567:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574317.731570:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574317.731573:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361037568:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574317.731577:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361037696:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574317.731590:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574317.731596:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574317/real 1788574317]  req@ffff8dc005dc1c00 x1875453361037696/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574342 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574317.731604:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361037696/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574342 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574317.731615:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574317.731617:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574317.731620:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361037696:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574317.731623:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361037824:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574317.731634:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574317.731640:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574317/real 1788574317]  req@ffff8dc005dc1500 x1875453361037824/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574342 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574317.731647:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361037824/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574342 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574317.731653:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574317.731655:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574317.731657:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361037824:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574317.731667:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361037952:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574317.731678:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574317.731684:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574317/real 1788574317]  req@ffff8dc005dc3b80 x1875453361037952/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574342 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574317.731690:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361037952/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574342 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574317.731695:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574317.731697:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574317.731700:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361037952:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574317.731704:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361038080:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574317.731714:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574317.731720:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574317/real 1788574317]  req@ffff8dc005dc1180 x1875453361038080/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574342 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574317.731727:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361038080/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574342 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574317.731732:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574317.731734:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574317.731736:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361038080:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574318.115001:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574318.115004:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574318.115065:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574318.115191:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574318.115191:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574318.115192:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574318.754973:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574319.138969:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574319.138977:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574319.138990:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574319.139010:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574319.139046:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574319.139109:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574319.778958:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574320.162926:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574320.162931:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574320.162983:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574320.163026:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574320.163064:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788574320.163126:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574320.803084:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574321.187020:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574321.187020:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574321.187021:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574321.187070:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574321.187076:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574321.187077:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574321.826969:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574322.210933:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574322.211018:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574322.211021:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574322.211022:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574322.211071:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574322.211113:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574322.851024:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574322.851025:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574322.851037:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788574322.851043:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574322.851054:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2668
00000100:00080000:0.0:1788574322.851075:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574322.851085:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574322.851129:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361038208/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574322.851157:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574322.851160:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574322.851161:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574322.851165:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2668
00000100:00080000:0.0:1788574322.851168:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574322.851171:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574322.851182:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574322.851195:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361038208:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788574322.851196:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361038336/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574322.851212:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574322.851214:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574322.851216:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574322.851219:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2668
00000100:00080000:0.0:1788574322.851221:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574322.851224:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574322.851228:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574322.851236:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361038464/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574322.851243:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574322.851245:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574322.851247:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574322.851249:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2668
00000100:00080000:0.0:1788574322.851273:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574322.851277:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574322.851280:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1788574322.851286:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574322.851291:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361038592/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574322.851299:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574322.851301:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574322.851303:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574322.851306:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2668
00000100:00080000:0.0:1788574322.851309:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574322.851312:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574322.851315:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574322.851323:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361038720/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574322.851329:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574322.851332:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574322.851334:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574322.851337:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2668
00000100:00080000:0.0:1788574322.851341:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788574322.851342:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574322/real 1788574322]  req@ffff8dc006713100 x1875453361038208/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574347 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574322.851346:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574322.851353:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574322.851365:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361038848/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574322.851374:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361038208/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574347 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574322.851380:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574322.851386:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574322.851390:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574322.851396:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2668
00000100:00080000:0.0:1788574322.851401:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574322.851404:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574322.851407:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1788574322.851407:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574322.851418:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574322.851419:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361038976/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574322.851434:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361038208:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788574322.851465:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361038336:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574322.851486:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574322.851497:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574322/real 1788574322]  req@ffff8dc006713b80 x1875453361038336/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574347 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574322.851506:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361038336/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574347 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574322.851515:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574322.851517:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574322.851519:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361038336:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574322.851524:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361038464:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574322.851537:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574322.851544:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574322/real 1788574322]  req@ffff8dc006710e00 x1875453361038464/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574347 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574322.851552:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361038464/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574347 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574322.851570:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574322.851573:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574322.851575:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361038464:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574322.851579:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361038592:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574322.851592:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574322.851599:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574322/real 1788574322]  req@ffff8dc006711880 x1875453361038592/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574347 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574322.851607:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361038592/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574347 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574322.851618:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574322.851621:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574322.851623:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361038592:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574322.851627:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361038720:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574322.851639:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574322.851646:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574322/real 1788574322]  req@ffff8dc006712a00 x1875453361038720/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574347 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574322.851654:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361038720/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574347 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574322.851660:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574322.851663:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574322.851666:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361038720:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574322.851670:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361038848:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574322.851687:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574322.851694:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574322/real 1788574322]  req@ffff8dc006713800 x1875453361038848/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574347 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574322.851701:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361038848/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574347 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574322.851707:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574322.851710:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574322.851714:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361038848:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574322.851720:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361038976:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574322.851741:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574322.851753:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574322/real 1788574322]  req@ffff8dc006712300 x1875453361038976/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574347 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574322.851767:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361038976/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574347 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574322.851773:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574322.851775:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574322.851778:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361038976:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574323.234957:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574323.234957:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574323.234966:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574323.234967:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574323.234993:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574323.235040:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574323.874977:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574324.259035:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574324.259036:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574324.259095:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574324.259121:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574324.259137:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574324.259151:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574324.899020:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574325.282929:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574325.282940:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574325.282944:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574325.282961:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574325.282987:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574325.282991:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574325.922953:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574326.307059:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574326.307059:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574326.307060:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574326.307060:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574326.307153:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574326.307182:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574326.947052:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574327.330992:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574327.330993:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574327.330993:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574327.330994:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574327.331050:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574327.331095:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574327.970991:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574327.971017:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574327.971022:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788574327.971026:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574327.971034:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2673
00000100:00080000:0.0:1788574327.971053:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574327.971062:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574327.971100:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361039104/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574327.971140:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574327.971145:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574327.971147:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574327.971151:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2673
00000100:00080000:0.0:1788574327.971163:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574327.971169:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574327.971180:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574327.971187:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361039104:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788574327.971199:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361039232/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574327.971212:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574327.971215:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574327.971218:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574327.971221:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2673
00000100:00080000:0.0:1788574327.971225:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574327.971229:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574327.971235:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574327.971258:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453361039360/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788574327.971267:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788574327.971275:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574327.971279:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574327.971281:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574327.971286:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2673
00000100:00080000:0.0:1788574327.971290:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574327.971295:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574327.971302:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574327.971317:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574327/real 1788574327]  req@ffff8dc006713480 x1875453361039104/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574352 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574327.971320:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361039488/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574327.971344:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788574327.971348:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361039104/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574352 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574327.971350:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574327.971355:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574327.971361:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574327.971365:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2673
00000100:00080000:1.0:1788574327.971368:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574327.971374:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361039104:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788574327.971375:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574327.971384:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574327.971390:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574327.971396:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361039232:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574327.971405:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361039616/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788574327.971418:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788574327.971419:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574327.971425:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574327.971427:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1788574327.971433:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574327/real 1788574327]  req@ffff8dc006712680 x1875453361039232/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574352 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574327.971434:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2673
00000100:00080000:0.0:1788574327.971441:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574327.971450:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574327.971458:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574327.971458:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361039232/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574352 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574327.971474:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1788574327.971475:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361039744/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574327.971481:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574327.971491:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361039232:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788574327.971497:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788574327.971503:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361039360:192.168.202.140@tcp:8:kworker.0
00000100:00080000:0.0:1788574327.971504:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574327.971510:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574327.971517:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2673
00000100:00080000:0.0:1788574327.971522:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574327.971526:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574327.971531:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1788574327.971536:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574327.971548:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361039872/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574327.971550:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574327/real 1788574327]  req@ffff8dc006710380 x1875453361039360/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574352 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574327.971583:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453361039360/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574352 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574327.971590:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574327.971593:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574327.971596:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361039360:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574327.971601:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361039488:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574327.971620:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574327.971630:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574327/real 1788574327]  req@ffff8dc006711c00 x1875453361039488/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574352 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574327.971644:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361039488/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574352 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574327.971654:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574327.971657:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574327.971661:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361039488:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574327.971674:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361039616:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574327.971691:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574327.971709:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574327/real 1788574327]  req@ffff8dc006711500 x1875453361039616/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574352 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574327.971723:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361039616/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574352 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574327.971729:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574327.971731:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574327.971733:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361039616:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574327.971737:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361039744:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574327.971750:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574327.971756:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574327/real 1788574327]  req@ffff8dc006713480 x1875453361039744/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574352 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574327.971763:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361039744/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574352 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574327.971768:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574327.971770:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574327.971772:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361039744:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574327.971775:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361039872:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574327.971784:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574327.971790:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574327/real 1788574327]  req@ffff8dc006712300 x1875453361039872/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574352 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574327.971797:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361039872/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574352 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574327.971807:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574327.971809:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574327.971811:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361039872:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574328.354974:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574328.354985:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574328.355017:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574328.355107:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574328.355140:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574328.355141:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574328.994949:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574329.378980:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574329.378990:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574329.379006:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574329.379013:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574329.379051:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574329.379089:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574330.019027:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574330.403033:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574330.403037:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574330.403064:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574330.403081:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574330.403098:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574330.403099:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574331.042976:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574331.426977:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574331.426977:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574331.426977:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574331.427081:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574331.427090:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574331.427123:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574332.066960:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574332.450954:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574332.450954:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574332.450959:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574332.450970:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574332.450986:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574332.451028:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1788574333.090968:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788574333.090972:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574333.090979:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788574333.090983:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574333.090991:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2678
00000100:00080000:0.0:1788574333.091000:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574333.091006:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574333.091037:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361040000/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574333.091059:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574333.091062:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574333.091064:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574333.091066:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2678
00000100:00080000:0.0:1788574333.091069:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574333.091072:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574333.091080:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574333.091088:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361040128/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574333.091095:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574333.091098:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574333.091100:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574333.091102:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2678
00000100:00080000:0.0:1788574333.091104:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574333.091106:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574333.091109:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574333.091119:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361040256/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574333.091119:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361040000:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788574333.091133:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574333.091135:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574333.091136:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574333.091138:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2678
00000100:00080000:0.0:1788574333.091140:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574333.091142:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574333.091145:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574333.091153:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361040384/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574333.091159:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574333.091185:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574333.091186:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574333.091189:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2678
00000100:00080000:0.0:1788574333.091194:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574333.091197:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574333.091201:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1788574333.091207:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574333.091213:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361040512/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574333.091225:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574333.091229:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574333.091231:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574333.091236:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2678
00000100:00080000:0.0:1788574333.091240:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574333.091244:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574333.091250:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574333.091263:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361040640/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574333.091267:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574333/real 1788574333]  req@ffff8dc006713800 x1875453361040000/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574358 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574333.091276:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788574333.091297:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361040000/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574358 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574333.091300:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574333.091305:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574333.091315:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2678
00000100:00080000:1.0:1788574333.091319:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574333.091321:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574333.091328:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788574333.091330:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574333.091338:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574333.091338:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361040000:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788574333.091353:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361040768/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574333.091353:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361040128:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574333.091393:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574333.091410:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574333/real 1788574333]  req@ffff8dc006712a00 x1875453361040128/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574358 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574333.091425:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361040128/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574358 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574333.091444:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574333.091447:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574333.091451:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361040128:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574333.091477:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361040256:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574333.091499:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574333.091512:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574333/real 1788574333]  req@ffff8dc006711880 x1875453361040256/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574358 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574333.091525:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361040256/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574358 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574333.091534:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574333.091538:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574333.091541:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361040256:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574333.091548:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361040384:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574333.091568:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574333.091579:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574333/real 1788574333]  req@ffff8dc006710e00 x1875453361040384/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574358 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574333.091591:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361040384/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574358 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574333.091608:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574333.091611:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574333.091615:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361040384:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574333.091621:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361040512:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574333.091642:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574333.091654:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574333/real 1788574333]  req@ffff8dc006713b80 x1875453361040512/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574358 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574333.091667:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361040512/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574358 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574333.091676:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574333.091679:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574333.091683:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361040512:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574333.091690:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361040640:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574333.091718:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574333.091731:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574333/real 1788574333]  req@ffff8dc006713100 x1875453361040640/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574358 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574333.091743:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361040640/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574358 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574333.091752:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574333.091756:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574333.091760:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361040640:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574333.091766:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361040768:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574333.091786:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574333.091798:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574333/real 1788574333]  req@ffff8dc006712300 x1875453361040768/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574358 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574333.091810:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361040768/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574358 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574333.091819:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574333.091822:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574333.091825:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361040768:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574333.474951:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574333.474951:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574333.474952:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574333.474978:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574333.475001:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574333.475047:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574334.114949:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574334.498969:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574334.499005:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574334.499011:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788574334.499042:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574334.499052:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574334.499053:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574335.139006:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574335.523025:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574335.523034:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574335.523059:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574335.523061:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574335.523068:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574335.523105:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574336.163029:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574336.546969:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574336.546970:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574336.546971:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574336.547008:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574336.547008:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788574336.547034:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574337.186923:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574337.570968:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574337.570968:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574337.570969:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574337.570993:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574337.570998:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574337.571001:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574338.211025:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788574338.211025:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574338.211039:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788574338.211045:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574338.211058:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2683
00000100:00080000:3.0:1788574338.211074:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574338.211086:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788574338.211134:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c380 x1875453361040896/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574338.211174:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574338.211179:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574338.211183:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574338.211192:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2683
00000100:00080000:3.0:1788574338.211198:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574338.211205:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574338.211232:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361040896:192.168.202.140@tcp:250:kworker.0
00000008:00100000:3.0:1788574338.211240:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574338.211272:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f480 x1875453361041024/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574338.211296:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574338.211301:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574338.211304:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574338.211310:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2683
00000800:00000100:2.0:1788574338.211315:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788574338.211325:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574338.211335:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574338.211342:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574338.211366:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574338/real 1788574338]  req@ffff8dc00644c380 x1875453361040896/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574363 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574338.211382:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453361040896/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574363 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574338.211390:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574338.211394:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574338.211397:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361040896:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788574338.211418:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361041024:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574338.211439:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574338.211450:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d180 x1875453361041152/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574338.211454:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574338/real 1788574338]  req@ffff8dc00644f480 x1875453361041024/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574363 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574338.211524:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453361041024/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574363 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574338.211528:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574338.211543:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574338.211545:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574338.211548:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574338.211552:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574338.211562:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361041024:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788574338.211564:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2683
00000100:00080000:3.0:1788574338.211578:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1788574338.211584:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361041152:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574338.211601:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574338.211609:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574338/real 1788574338]  req@ffff8dc00644d180 x1875453361041152/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574363 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574338.211624:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453361041152/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574363 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574338.211633:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574338.211637:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574338.211640:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361041152:192.168.202.140@tcp:8:kworker.0
00000100:00080000:3.0:1788574338.211726:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574338.211736:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574338.211756:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e680 x1875453361041280/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574338.211822:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574338.211828:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574338.211831:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574338.211841:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2683
00000100:00080000:3.0:1788574338.211849:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1788574338.211859:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361041280:192.168.202.140@tcp:8:kworker.0
00000100:00080000:3.0:1788574338.211866:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574338.211920:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788574338.211921:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574338.211952:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574338/real 1788574338]  req@ffff8dc00644e680 x1875453361041280/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574363 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574338.211953:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c700 x1875453361041408/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574338.212023:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453361041280/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574363 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574338.212026:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574338.212034:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574338.212036:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574338.212040:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788574338.212042:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788574338.212045:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361041280:192.168.202.140@tcp:8:kworker.0
00000100:00080000:3.0:1788574338.212057:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2683
00000100:00100000:2.0:1788574338.212065:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361041408:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788574338.212065:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574338.212077:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574338.212085:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788574338.212093:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574338.212103:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574338/real 1788574338]  req@ffff8dc00644c700 x1875453361041408/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574363 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574338.212113:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e300 x1875453361041536/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574338.212118:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453361041408/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574363 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574338.212170:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574338.212171:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574338.212184:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788574338.212190:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:2.0:1788574338.212191:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361041408:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788574338.212198:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788574338.212205:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361041536:192.168.202.140@tcp:8:kworker.0
00000100:00080000:3.0:1788574338.212209:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2683
00000100:00080000:3.0:1788574338.212232:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574338.212241:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574338.212250:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788574338.212254:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574338.212282:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ed80 x1875453361041664/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574338.212283:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574338/real 1788574338]  req@ffff8dc00644e300 x1875453361041536/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574363 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574338.212337:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453361041536/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574363 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574338.212357:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574338.212361:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574338.212365:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361041536:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574338.212377:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361041664:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574338.212393:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574338.212401:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574338/real 1788574338]  req@ffff8dc00644ed80 x1875453361041664/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574363 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574338.212408:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ed80 x1875453361041664/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574363 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574338.212414:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574338.212416:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574338.212418:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361041664:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574338.595007:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574338.595029:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574338.595029:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574338.595063:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574338.595090:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788574338.595108:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574339.234951:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574339.618967:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574339.619028:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574339.619028:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574339.619030:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574339.619046:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574339.619074:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574340.259021:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574340.642984:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574340.643005:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574340.643027:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574340.643055:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574340.643073:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574340.643097:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574341.282962:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574341.666980:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574341.666980:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574341.666980:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574341.666980:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574341.667011:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574341.667052:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574342.306977:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574342.690967:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574342.690967:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574342.690999:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574342.691006:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574342.691020:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574342.691026:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1788574343.331016:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574343.331024:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788574343.331028:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574343.331037:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2688
00000100:00080000:1.0:1788574343.331047:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574343.331055:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788574343.331090:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574343.331111:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361041792/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574343.331143:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574343.331150:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574343.331151:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574343.331155:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2688
00000100:00080000:1.0:1788574343.331158:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574343.331162:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574343.331171:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574343.331185:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361041920/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574343.331191:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361041792:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574343.331196:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574343.331199:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574343.331201:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574343.331204:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2688
00000100:00080000:1.0:1788574343.331206:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574343.331209:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574343.331213:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574343.331220:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361042048/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574343.331227:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574343.331229:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574343.331231:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574343.331233:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2688
00000100:00080000:1.0:1788574343.331236:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574343.331238:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574343.331240:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574343.331247:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361042176/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574343.331253:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574343.331256:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574343.331258:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:2.0:1788574343.331273:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788574343.331277:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2688
00000100:00080000:1.0:1788574343.331281:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574343.331289:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574343.331296:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574343.331309:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361042304/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574343.331321:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574343/real 1788574343]  req@ffff8dc005dc0700 x1875453361041792/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574368 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574343.331329:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574343.331337:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574343.331340:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574343.331355:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2688
00000100:00100000:2.0:1788574343.331355:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361041792/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574368 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574343.331361:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574343.331368:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:2.0:1788574343.331372:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:1.0:1788574343.331374:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1788574343.331378:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574343.331383:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361041792:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788574343.331388:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361042432/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574343.331396:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574343.331399:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574343.331400:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574343.331403:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2688
00000100:00080000:1.0:1788574343.331406:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574343.331408:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574343.331412:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361041920:192.168.202.140@tcp:38:kworker.0
00000008:00100000:1.0:1788574343.331417:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574343.331429:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361042560/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788574343.331450:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574343.331467:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574343/real 1788574343]  req@ffff8dc005dc1180 x1875453361041920/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574368 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574343.331479:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361041920/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574368 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574343.331490:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574343.331494:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574343.331497:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361041920:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574343.331504:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361042048:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574343.331528:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574343.331538:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574343/real 1788574343]  req@ffff8dc005dc3b80 x1875453361042048/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574368 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574343.331546:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361042048/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574368 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574343.331553:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574343.331555:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574343.331557:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361042048:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574343.331562:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361042176:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574343.331575:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574343.331581:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574343/real 1788574343]  req@ffff8dc005dc1500 x1875453361042176/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574368 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574343.331588:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361042176/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574368 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574343.331594:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574343.331596:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574343.331598:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361042176:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574343.331601:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361042304:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574343.331611:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574343.331618:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574343/real 1788574343]  req@ffff8dc005dc1c00 x1875453361042304/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574368 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574343.331625:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361042304/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574368 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574343.331631:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574343.331632:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574343.331634:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361042304:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574343.331638:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361042432:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574343.331649:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574343.331655:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574343/real 1788574343]  req@ffff8dc005dc3800 x1875453361042432/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574368 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574343.331662:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361042432/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574368 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574343.331672:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574343.331673:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574343.331675:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361042432:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574343.331688:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361042560:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574343.331698:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574343.331704:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574343/real 1788574343]  req@ffff8dc005dc2d80 x1875453361042560/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574368 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574343.331711:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361042560/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574368 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574343.331716:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574343.331718:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574343.331720:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361042560:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574343.714977:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574343.714977:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574343.714990:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574343.715009:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574343.715013:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574343.715019:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574344.354979:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574344.738947:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574344.738974:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574344.738976:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574344.738992:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574344.738993:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574344.739004:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574345.379018:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574345.763015:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574345.763018:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574345.763018:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574345.763061:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574345.763063:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574345.763081:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574346.403055:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574346.787019:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574346.787020:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574346.787020:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574346.787053:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574346.787072:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574346.787073:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574347.426943:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574347.810979:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574347.810979:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574347.811005:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574347.811106:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574347.811114:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574347.811121:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574348.450971:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788574348.450980:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574348.450986:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788574348.450990:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574348.450999:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2694
00000100:00080000:2.0:1788574348.451008:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574348.451015:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574348.451051:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361042688/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574348.451083:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574348.451087:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574348.451088:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574348.451092:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2694
00000100:00080000:2.0:1788574348.451096:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574348.451100:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574348.451109:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574348.451116:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361042688:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788574348.451123:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361042816/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574348.451133:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574348.451135:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574348.451136:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574348.451139:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2694
00000100:00080000:2.0:1788574348.451142:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574348.451144:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574348.451147:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574348.451162:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453361042944/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574348.451173:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574348.451175:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574348.451176:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574348.451179:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2694
00000100:00080000:2.0:1788574348.451182:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574348.451185:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574348.451188:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1788574348.451196:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574348.451198:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453361043072/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574348.451206:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574348.451209:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574348.451210:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574348.451213:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2694
00000100:00080000:2.0:1788574348.451216:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574348.451218:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574348.451221:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574348.451228:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453361043200/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574348.451234:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574348.451237:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574348.451238:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574348.451242:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2694
00000100:00100000:1.0:1788574348.451246:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574348/real 1788574348]  req@ffff8dc020494700 x1875453361042688/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574373 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574348.451247:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574348.451254:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574348.451261:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574348.451271:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453361043328/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574348.451275:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361042688/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574373 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574348.451284:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574348.451291:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574348.451291:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574348.451297:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574348.451298:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574348.451304:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361042688:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788574348.451321:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2694
00000100:00080000:2.0:1788574348.451328:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574348.451333:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574348.451339:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574348.451343:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361042816:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574348.451358:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361043456/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788574348.451368:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574348.451383:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574348/real 1788574348]  req@ffff8dc020495500 x1875453361042816/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574373 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574348.451392:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361042816/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574373 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574348.451400:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574348.451402:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574348.451405:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361042816:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574348.451409:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361042944:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574348.451423:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574348.451430:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574348/real 1788574348]  req@ffff8dc020494e00 x1875453361042944/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574373 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574348.451437:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453361042944/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574373 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574348.451443:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574348.451445:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574348.451447:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361042944:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574348.451451:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361043072:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574348.451461:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574348.451467:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574348/real 1788574348]  req@ffff8dc020497100 x1875453361043072/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574373 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574348.451474:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453361043072/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574373 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574348.451480:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574348.451482:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574348.451484:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361043072:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574348.451487:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361043200:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574348.451498:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574348.451504:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574348/real 1788574348]  req@ffff8dc020496a00 x1875453361043200/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574373 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574348.451515:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453361043200/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574373 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574348.451521:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574348.451523:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574348.451525:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361043200:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574348.451528:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361043328:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574348.451538:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574348.451544:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574348/real 1788574348]  req@ffff8dc020494380 x1875453361043328/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574373 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574348.451551:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453361043328/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574373 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574348.451556:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574348.451558:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574348.451559:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361043328:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574348.451571:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361043456:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574348.451581:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574348.451587:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574348/real 1788574348]  req@ffff8dc020494700 x1875453361043456/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574373 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574348.451594:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361043456/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574373 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574348.451604:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574348.451606:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574348.451609:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361043456:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574348.834953:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574348.834994:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574348.835047:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574348.835060:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574348.835080:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574348.835152:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574349.474934:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574349.858974:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574349.858974:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574349.858975:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574349.859000:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574349.859007:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574349.859018:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574350.498981:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574350.883053:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574350.883054:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574350.883054:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574350.883244:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574350.883259:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574350.883273:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574351.522924:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574351.906979:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574351.906986:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574351.907010:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574351.907040:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574351.907047:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574351.907052:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574352.547063:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574352.930972:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574352.930984:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574352.931012:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574352.931020:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574352.931055:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574352.931089:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1788574353.571003:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574353.571011:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788574353.571014:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574353.571024:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2699
00000100:00100000:0.0:1788574353.571027:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574353.571035:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574353.571044:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574353.571076:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361043584/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574353.571097:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574353.571099:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574353.571101:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574353.571104:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2699
00000100:00080000:1.0:1788574353.571106:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574353.571114:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574353.571124:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574353.571137:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361043712/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574353.571142:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361043584:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574353.571145:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574353.571153:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574353.571156:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574353.571160:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2699
00000100:00080000:1.0:1788574353.571162:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574353.571165:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574353.571168:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574353.571177:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361043840/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574353.571183:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574353.571186:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574353.571188:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574353.571190:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2699
00000100:00080000:1.0:1788574353.571192:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574353.571194:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574353.571197:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574353.571204:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361043968/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574353.571211:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574353.571213:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574353.571215:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574353.571218:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2699
00000100:00080000:1.0:1788574353.571221:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574353.571223:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574353.571226:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574353.571239:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361044096/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574353.571246:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574353.571249:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574353.571250:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574353.571252:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2699
00000100:00080000:1.0:1788574353.571254:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574353.571257:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574353.571260:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574353.571264:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361043712:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574353.571271:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361044224/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574353.571279:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574353.571287:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574353.571289:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574353.571296:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2699
00000100:00080000:1.0:1788574353.571299:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574353.571301:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574353.571304:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574353.571314:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361043840:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574353.571316:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361044352/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574353.571353:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361043968:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574353.571408:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361044096:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574353.571445:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361044224:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574353.571471:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361044352:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574353.954988:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574353.954989:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574353.955002:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574353.955023:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574353.955027:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574353.955053:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574354.594962:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574354.978961:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574354.978992:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788574354.979002:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574354.979015:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574354.979081:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574354.979086:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574355.619038:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574356.002991:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574356.002991:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574356.002992:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574356.003016:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574356.003051:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574356.003074:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574356.642976:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000400:00000100:3.0:1788574356.643127:0:2334:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.140:988
00000400:00000100:3.0:1788574356.643165:0:2334:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.140@tcp at host 192.168.202.140 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:3.0:1788574356.643180:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788574356.643219:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788574356.643229:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788574356.643240:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788574356.643252:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788574356.643265:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:2.0:1788574356.643273:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574353/real 1788574356]  req@ffff8dc005dc2d80 x1875453361043712/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574378 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:3.0:1788574356.643280:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:2.0:1788574356.643314:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361043712/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574378 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574356.643327:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574356.643333:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574356.643343:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361043712:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574356.643352:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574353/real 1788574356]  req@ffff8dc005dc3800 x1875453361043840/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574378 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574356.643373:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361043840/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574378 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574356.643382:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574356.643417:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574356.643421:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361043840:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574356.643429:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574353/real 1788574356]  req@ffff8dc005dc1c00 x1875453361043968/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574378 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574356.643443:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361043968/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574378 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574356.643451:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574356.643454:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574356.643457:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361043968:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574356.643464:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574353/real 1788574356]  req@ffff8dc005dc1500 x1875453361044096/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574378 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574356.643474:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361044096/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574378 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574356.643481:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574356.643485:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574356.643488:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361044096:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574356.643494:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574353/real 1788574356]  req@ffff8dc005dc0a80 x1875453361043584/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574378 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574356.643507:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361043584/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574378 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574356.643520:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574356.643524:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574356.643527:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361043584:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788574356.643558:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574353/real 1788574356]  req@ffff8dc005dc3b80 x1875453361044224/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574378 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574356.643573:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361044224/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574378 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574356.643581:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574356.643585:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574356.643589:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361044224:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574356.643596:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574353/real 1788574356]  req@ffff8dc005dc1180 x1875453361044352/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574378 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574356.643609:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361044352/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574378 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574356.643634:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574356.643637:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574356.643641:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361044352:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574357.026979:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574357.026979:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574357.027006:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788574357.027018:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574357.027035:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574357.027037:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574357.666984:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574358.050981:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574358.050981:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574358.050981:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574358.050982:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574358.051016:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574358.051053:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574358.690943:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574358.690955:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574358.690963:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788574358.690976:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574358.690986:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2704
00000100:00080000:1.0:1788574358.690997:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574358.691005:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574358.691039:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361044480/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574358.691066:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574358.691074:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574358.691077:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574358.691081:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2704
00000100:00080000:1.0:1788574358.691085:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574358.691091:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574358.691101:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574358.691108:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361044480:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788574358.691119:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361044608/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574358.691138:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574358.691142:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574358.691144:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574358.691148:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2704
00000100:00080000:1.0:1788574358.691152:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574358.691156:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574358.691162:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574358.691175:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361044736/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788574358.691180:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788574358.691196:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574358.691200:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574358.691202:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574358.691207:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2704
00000100:00080000:1.0:1788574358.691211:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574358.691216:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574358.691221:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574358.691227:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574358/real 1788574358]  req@ffff8dc005dc0700 x1875453361044480/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574383 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574358.691240:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361044864/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574358.691252:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788574358.691252:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361044480/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574383 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574358.691261:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574358.691265:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574358.691276:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2704
00000100:00080000:1.0:1788574358.691280:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574358.691285:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574358.691289:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1788574358.691296:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1788574358.691303:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361044992/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574358.691307:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574358.691316:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361044480:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574358.691320:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574358.691326:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574358.691328:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574358.691334:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2704
00000100:00080000:1.0:1788574358.691338:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574358.691342:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574358.691348:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361044608:192.168.202.140@tcp:38:kworker.0
00000008:00100000:1.0:1788574358.691365:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788574358.691381:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574358.691385:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361045120/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574358.691398:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574358/real 1788574358]  req@ffff8dc005dc1180 x1875453361044608/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574383 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574358.691399:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574358.691420:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574358.691424:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574358.691431:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2704
00000100:00100000:2.0:1788574358.691433:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361044608/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574383 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574358.691437:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574358.691446:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:2.0:1788574358.691453:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:1.0:1788574358.691454:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1788574358.691464:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574358.691473:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361044608:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574358.691474:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361045248/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574358.691487:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361044736:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574358.691526:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574358.691541:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574358/real 1788574358]  req@ffff8dc005dc3b80 x1875453361044736/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574383 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574358.691554:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361044736/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574383 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574358.691563:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574358.691566:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574358.691570:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361044736:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574358.691577:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361044864:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574358.691598:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574358.691610:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574358/real 1788574358]  req@ffff8dc005dc0a80 x1875453361044864/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574383 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574358.691621:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361044864/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574383 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574358.691629:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574358.691632:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574358.691635:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361044864:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574358.691641:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361044992:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574358.691662:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574358.691673:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574358/real 1788574358]  req@ffff8dc005dc1500 x1875453361044992/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574383 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574358.691690:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361044992/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574383 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574358.691699:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574358.691703:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574358.691706:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361044992:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574358.691724:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361045120:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574358.691745:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574358.691757:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574358/real 1788574358]  req@ffff8dc005dc1c00 x1875453361045120/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574383 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574358.691768:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361045120/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574383 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574358.691778:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574358.691781:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574358.691785:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361045120:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574358.691790:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361045248:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574358.691807:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574358.691818:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574358/real 1788574358]  req@ffff8dc005dc3800 x1875453361045248/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574383 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574358.691829:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361045248/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574383 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574358.691842:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574358.691846:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574358.691849:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361045248:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574359.074965:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574359.074998:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574359.075027:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574359.075029:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574359.075038:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574359.075043:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574359.714959:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574360.098971:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574360.098971:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574360.098976:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574360.099018:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574360.099026:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574360.099042:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574360.738945:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574361.122965:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574361.122968:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574361.122970:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574361.122998:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574361.123017:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574361.123022:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574361.762991:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574362.147004:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574362.147004:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574362.147031:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574362.147049:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574362.147050:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574362.147075:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574362.786976:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574363.171041:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574363.171059:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574363.171062:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574363.171083:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574363.171091:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574363.171109:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574363.810985:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574363.811006:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574363.811022:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788574363.811027:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574363.811042:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2709
00000100:00080000:1.0:1788574363.811055:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574363.811063:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574363.811109:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361045376/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574363.811140:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574363.811143:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574363.811145:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574363.811148:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2709
00000100:00080000:1.0:1788574363.811151:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574363.811153:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574363.811164:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574363.811178:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361045504/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574363.811192:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574363.811196:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:2.0:1788574363.811196:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361045376:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574363.811200:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574363.811205:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2709
00000100:00080000:1.0:1788574363.811208:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574363.811213:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574363.811217:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574363.811228:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361045632/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574363.811235:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574363.811238:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574363.811240:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574363.811242:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2709
00000100:00080000:1.0:1788574363.811244:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574363.811247:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574363.811250:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574363.811259:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361045760/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574363.811265:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574363.811268:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574363.811269:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574363.811273:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2709
00000100:00080000:1.0:1788574363.811278:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574363.811281:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574363.811285:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788574363.811291:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574363.811297:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361045888/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574363.811306:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574363.811310:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574363.811312:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574363.811316:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2709
00000100:00080000:1.0:1788574363.811325:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574363.811327:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574363.811332:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574363.811341:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361046016/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574363.811350:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788574363.811352:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574363/real 1788574363]  req@ffff8dc005dc2d80 x1875453361045376/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574388 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574363.811365:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574363.811373:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574363.811383:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2709
00000100:00080000:1.0:1788574363.811387:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574363.811390:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574363.811394:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574363.811401:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361045376/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574388 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574363.811407:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361046144/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574363.811451:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574363.811472:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574363.811479:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361045376:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788574363.811507:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361045504:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574363.811533:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574363.811547:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574363/real 1788574363]  req@ffff8dc005dc3800 x1875453361045504/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574388 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574363.811566:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361045504/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574388 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574363.811577:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574363.811580:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574363.811584:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361045504:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574363.811591:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361045632:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574363.811610:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574363.811621:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574363/real 1788574363]  req@ffff8dc005dc1c00 x1875453361045632/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574388 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574363.811633:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361045632/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574388 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574363.811642:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574363.811645:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574363.811648:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361045632:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574363.811655:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361045760:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574363.811674:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574363.811685:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574363/real 1788574363]  req@ffff8dc005dc1500 x1875453361045760/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574388 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574363.811696:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361045760/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574388 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574363.811711:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574363.811715:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574363.811718:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361045760:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574363.811724:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361045888:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574363.811742:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574363.811752:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574363/real 1788574363]  req@ffff8dc005dc0a80 x1875453361045888/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574388 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574363.811764:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361045888/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574388 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574363.811773:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574363.811776:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574363.811780:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361045888:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574363.811787:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361046016:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574363.811805:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574363.811815:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574363/real 1788574363]  req@ffff8dc005dc3b80 x1875453361046016/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574388 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574363.811826:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361046016/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574388 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574363.811834:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574363.811837:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574363.811842:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361046016:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574363.811848:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361046144:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574363.811899:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574363.811913:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574363/real 1788574363]  req@ffff8dc005dc1180 x1875453361046144/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574388 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574363.811926:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361046144/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574388 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574363.811934:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574363.811937:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574363.811941:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361046144:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574364.194983:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574364.195001:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574364.195007:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574364.195064:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574364.195065:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574364.195075:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574364.834988:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574365.218995:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574365.218995:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574365.219033:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574365.219039:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574365.219058:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574365.219092:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574365.858990:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574366.242934:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574366.242945:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574366.242950:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574366.242974:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574366.242974:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574366.243028:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574366.883001:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574367.266978:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574367.266978:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574367.266978:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574367.266982:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574367.267011:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574367.267042:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574367.907046:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574368.291015:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574368.291016:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574368.291047:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574368.291075:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574368.292369:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574368.292398:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574368.930935:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788574368.931013:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574368.931023:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788574368.931028:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574368.931037:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2714
00000100:00080000:2.0:1788574368.931048:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574368.931055:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574368.931093:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361046272/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574368.931131:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574368.931135:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574368.931137:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574368.931141:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2714
00000100:00080000:2.0:1788574368.931146:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574368.931150:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574368.931161:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574368.931166:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361046272:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788574368.931179:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453361046400/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574368.931190:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574368.931194:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574368.931196:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574368.931200:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2714
00000100:00080000:2.0:1788574368.931204:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574368.931209:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574368.931214:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1788574368.931222:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574368.931229:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361046528/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574368.931240:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574368.931243:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574368.931245:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574368.931249:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2714
00000100:00080000:2.0:1788574368.931254:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574368.931259:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574368.931261:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574368/real 1788574368]  req@ffff8dc020495880 x1875453361046272/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574393 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1788574368.931265:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574368.931283:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361046656/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574368.931285:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361046272/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574393 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574368.931309:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574368.931314:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574368.931314:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574368.931316:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574368.931324:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788574368.931325:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2714
00000100:00080000:2.0:1788574368.931332:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788574368.931335:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361046272:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788574368.931351:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574368.931362:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574368.931366:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361046400:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574368.931379:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453361046784/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788574368.931392:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788574368.931392:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574368.931398:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574368.931401:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1788574368.931405:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574368/real 1788574368]  req@ffff8dc020496d80 x1875453361046400/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574393 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574368.931408:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2714
00000100:00080000:2.0:1788574368.931416:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788574368.931422:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453361046400/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574393 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574368.931425:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574368.931436:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1788574368.931449:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574368.931453:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574368.931455:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361046400:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574368.931460:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361046528:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574368.931468:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453361046912/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788574368.931478:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574368.931487:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574368/real 1788574368]  req@ffff8dc020494000 x1875453361046528/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574393 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574368.931495:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788574368.931501:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361046528/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574393 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574368.931502:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574368.931507:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574368.931531:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2714
00000100:00080000:2.0:1788574368.931535:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574368.931539:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574368.931550:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1788574368.931553:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574368.931560:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574368.931569:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361046528:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574368.931569:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361047040/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574368.931585:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361046656:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574368.931613:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574368.931628:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574368/real 1788574368]  req@ffff8dc020495180 x1875453361046656/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574393 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574368.931650:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361046656/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574393 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574368.931657:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574368.931659:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574368.931662:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361046656:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574368.931674:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361046784:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574368.931690:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574368.931698:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574368/real 1788574368]  req@ffff8dc020497480 x1875453361046784/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574393 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574368.931705:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453361046784/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574393 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574368.931711:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574368.931713:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574368.931715:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361046784:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574368.931719:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361046912:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574368.931729:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574368.931735:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574368/real 1788574368]  req@ffff8dc020494a80 x1875453361046912/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574393 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574368.931743:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453361046912/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574393 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574368.931747:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574368.931749:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574368.931751:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361046912:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574368.931755:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361047040:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574368.931772:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574368.931784:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574368/real 1788574368]  req@ffff8dc020495880 x1875453361047040/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574393 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574368.931797:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361047040/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574393 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574368.931806:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574368.931809:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574368.931813:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361047040:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574369.314975:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574369.314975:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574369.314988:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574369.315021:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574369.315024:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574369.315025:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574369.954997:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574370.338967:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574370.338968:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574370.339055:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574370.339071:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574370.339077:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574370.339157:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574370.978955:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574371.362981:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574371.362983:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574371.362984:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574371.363006:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574371.363017:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574371.363032:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574372.002974:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574372.387031:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574372.387031:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574372.387032:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574372.387045:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574372.387066:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574372.387072:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574373.026949:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574373.410974:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574373.410974:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574373.410981:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574373.411007:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574373.411008:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574373.411009:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00080000:0.0:1788574374.050984:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574374.050992:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788574374.050996:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574374.051004:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2719
00000100:00080000:0.0:1788574374.051014:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574374.051021:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574374.051051:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361047168/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574374.051062:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574374.051073:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574374.051077:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574374.051079:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574374.051082:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2719
00000100:00080000:0.0:1788574374.051085:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574374.051089:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574374.051098:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574374.051107:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361047168:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788574374.051120:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361047296/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574374.051133:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574374.051137:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574374.051139:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574374.051143:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2719
00000100:00080000:0.0:1788574374.051147:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574374.051152:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574374.051158:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574374.051173:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361047424/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788574374.051185:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788574374.051186:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574374.051192:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574374.051194:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574374.051200:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2719
00000100:00080000:0.0:1788574374.051212:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574374.051217:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574374.051224:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574374.051233:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574374/real 1788574374]  req@ffff8dc006713480 x1875453361047168/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574399 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574374.051240:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453361047552/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574374.051263:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574374.051267:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:2.0:1788574374.051270:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361047168/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574399 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574374.051271:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574374.051280:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2719
00000100:00080000:0.0:1788574374.051287:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574374.051291:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574374.051294:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:2.0:1788574374.051301:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000008:00100000:0.0:1788574374.051302:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574374.051309:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361047168:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788574374.051318:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361047680/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574374.051329:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574374.051332:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574374.051335:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788574374.051338:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361047296:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788574374.051343:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2719
00000100:00080000:0.0:1788574374.051348:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574374.051353:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574374.051358:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574374.051374:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361047808/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788574374.051374:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788574374.051388:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574374.051392:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:2.0:1788574374.051395:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574374/real 1788574374]  req@ffff8dc006711500 x1875453361047296/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574399 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574374.051396:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574374.051404:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2719
00000100:00080000:0.0:1788574374.051412:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574374.051418:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574374.051423:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361047296/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574399 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1788574374.051426:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1788574374.051443:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1788574374.051445:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361047936/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574374.051451:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574374.051462:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361047296:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574374.051474:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361047424:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574374.051503:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574374.051520:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574374/real 1788574374]  req@ffff8dc006711c00 x1875453361047424/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574399 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574374.051534:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361047424/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574399 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574374.051545:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574374.051549:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574374.051553:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361047424:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574374.051574:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361047552:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574374.051600:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574374.051613:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574374/real 1788574374]  req@ffff8dc006710380 x1875453361047552/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574399 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574374.051624:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453361047552/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574399 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574374.051632:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574374.051637:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574374.051641:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361047552:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574374.051649:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361047680:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574374.051677:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574374.051694:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574374/real 1788574374]  req@ffff8dc006712680 x1875453361047680/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574399 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574374.051706:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361047680/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574399 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574374.051712:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574374.051714:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574374.051717:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361047680:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574374.051730:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361047808:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574374.051744:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574374.051752:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574374/real 1788574374]  req@ffff8dc006713480 x1875453361047808/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574399 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574374.051764:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361047808/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574399 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574374.051770:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574374.051772:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574374.051774:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361047808:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574374.051777:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361047936:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574374.051787:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574374.051792:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574374/real 1788574374]  req@ffff8dc006712300 x1875453361047936/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574399 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574374.051799:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361047936/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574399 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574374.051804:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574374.051806:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574374.051808:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361047936:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574374.434987:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574374.434987:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574374.434994:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574374.435035:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574374.435054:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788574374.435057:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574375.074968:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574375.459000:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574375.459000:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574375.459003:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574375.459013:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574375.459060:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574375.459121:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574376.098955:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574376.482935:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574376.482935:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574376.482978:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574376.482984:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574376.482989:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574376.483015:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574377.122971:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574377.506960:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574377.506960:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574377.506965:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574377.507003:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574377.507006:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574377.507081:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574378.146943:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574378.530938:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574378.530945:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574378.530971:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574378.531033:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574378.531059:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574378.531104:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00080000:2.0:1788574379.170966:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788574379.170971:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788574379.170975:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788574379.170980:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574379.170989:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2724
00000100:00080000:2.0:1788574379.170999:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574379.171005:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574379.171037:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361048064/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574379.171059:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574379.171062:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574379.171063:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574379.171066:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2724
00000100:00080000:2.0:1788574379.171068:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574379.171070:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574379.171079:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574379.171087:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453361048192/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574379.171095:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788574379.171099:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361048064:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788574379.171100:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574379.171103:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574379.171110:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2724
00000100:00080000:2.0:1788574379.171112:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574379.171114:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574379.171118:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574379.171126:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453361048320/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574379.171132:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574379.171135:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574379.171136:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574379.171138:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2724
00000100:00080000:2.0:1788574379.171140:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574379.171142:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574379.171145:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574379.171151:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453361048448/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574379.171157:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574379.171159:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574379.171160:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574379.171162:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2724
00000800:00000100:1.0:1788574379.171167:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788574379.171168:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574379.171173:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574379.171177:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574379.171186:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453361048576/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574379.171192:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574379.171194:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574379.171195:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574379.171198:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2724
00000100:00080000:2.0:1788574379.171200:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574379.171203:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574379.171206:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574379.171215:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574379/real 1788574379]  req@ffff8dc020494700 x1875453361048064/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574404 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574379.171216:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361048704/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574379.171249:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574379.171252:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574379.171253:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574379.171257:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2724
00000100:00080000:2.0:1788574379.171259:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788574379.171263:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361048064/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574404 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574379.171265:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574379.171277:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1788574379.171278:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574379.171285:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574379.171289:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361048064:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788574379.171296:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361048832/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574379.171314:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361048192:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574379.171341:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574379.171355:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574379/real 1788574379]  req@ffff8dc020494380 x1875453361048192/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574404 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574379.171368:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453361048192/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574404 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574379.171375:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574379.171377:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574379.171380:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361048192:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574379.171384:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361048320:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574379.171399:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574379.171406:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574379/real 1788574379]  req@ffff8dc020496a00 x1875453361048320/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574404 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574379.171414:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453361048320/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574404 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574379.171424:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574379.171426:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574379.171428:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361048320:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574379.171432:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361048448:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574379.171442:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574379.171448:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574379/real 1788574379]  req@ffff8dc020497100 x1875453361048448/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574404 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574379.171455:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453361048448/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574404 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574379.171461:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574379.171463:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574379.171464:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361048448:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574379.171468:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361048576:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574379.171479:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574379.171485:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574379/real 1788574379]  req@ffff8dc020494e00 x1875453361048576/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574404 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574379.171492:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453361048576/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574404 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574379.171497:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574379.171499:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574379.171502:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361048576:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574379.171505:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361048704:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574379.171515:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574379.171521:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574379/real 1788574379]  req@ffff8dc020495500 x1875453361048704/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574404 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574379.171528:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361048704/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574404 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574379.171533:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574379.171535:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574379.171536:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361048704:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574379.171540:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361048832:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574379.171560:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574379.171572:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574379/real 1788574379]  req@ffff8dc020495880 x1875453361048832/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574404 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574379.171585:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361048832/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574404 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574379.171593:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574379.171597:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574379.171600:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361048832:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574379.554961:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574379.554963:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574379.554986:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574379.554990:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574379.555077:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574379.555126:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574380.194960:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574380.578968:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574380.578968:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574380.578975:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574380.578978:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574380.579002:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574380.579045:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574381.219000:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574381.602959:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574381.602959:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574381.602971:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574381.602987:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574381.603001:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574381.603030:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574382.242956:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574382.626988:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574382.626988:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574382.626988:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574382.626995:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574382.627016:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574382.627061:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574383.267033:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574383.650960:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574383.650995:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574383.650997:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574383.651028:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574383.651051:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574383.651090:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1788574384.291019:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788574384.291026:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788574384.291031:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788574384.291038:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574384.291052:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2729
00000100:00080000:3.0:1788574384.291064:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574384.291072:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788574384.291116:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644df80 x1875453361048960/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574384.291144:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574384.291147:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574384.291148:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574384.291152:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2729
00000100:00080000:3.0:1788574384.291155:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574384.291159:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574384.291171:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574384.291187:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f100 x1875453361049088/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574384.291199:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788574384.291202:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361048960:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788574384.291205:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574384.291210:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574384.291217:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2729
00000100:00080000:3.0:1788574384.291221:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574384.291226:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574384.291240:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574384.291259:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d880 x1875453361049216/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574384.291270:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574384.291274:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574384.291277:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574384.291281:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2729
00000100:00080000:3.0:1788574384.291287:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574384.291291:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574384.291297:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1788574384.291299:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574384.291316:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644fb80 x1875453361049344/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574384.291328:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574384.291332:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574384.291334:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574384.291339:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2729
00000100:00080000:3.0:1788574384.291344:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574384.291349:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574384.291355:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574384.291359:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574384/real 1788574384]  req@ffff8dc00644df80 x1875453361048960/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574409 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574384.291373:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ed80 x1875453361049472/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574384.291386:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788574384.291388:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644df80 x1875453361048960/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574409 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574384.291394:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574384.291400:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574384.291410:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574384.291411:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2729
00000100:00080000:1.0:1788574384.291419:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788574384.291420:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788574384.291428:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361048960:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788574384.291430:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574384.291440:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574384.291457:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e300 x1875453361049600/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574384.291477:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788574384.291480:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361049088:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788574384.291484:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574384.291490:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574384.291496:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2729
00000100:00080000:3.0:1788574384.291501:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574384.291507:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574384.291513:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1788574384.291515:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574384.291532:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c700 x1875453361049728/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574384.291536:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574384/real 1788574384]  req@ffff8dc00644f100 x1875453361049088/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574409 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574384.291565:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f100 x1875453361049088/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574409 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574384.291577:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574384.291582:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574384.291596:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361049088:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574384.291605:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361049216:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574384.291628:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574384.291641:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574384/real 1788574384]  req@ffff8dc00644d880 x1875453361049216/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574409 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574384.291655:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d880 x1875453361049216/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574409 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574384.291665:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574384.291683:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574384.291688:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361049216:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574384.291696:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361049344:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574384.291716:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574384.291729:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574384/real 1788574384]  req@ffff8dc00644fb80 x1875453361049344/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574409 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574384.291742:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644fb80 x1875453361049344/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574409 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574384.291752:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574384.291755:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574384.291758:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361049344:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574384.291763:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361049472:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574384.291779:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574384.291787:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574384/real 1788574384]  req@ffff8dc00644ed80 x1875453361049472/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574409 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574384.291800:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ed80 x1875453361049472/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574409 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574384.291807:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574384.291809:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574384.291811:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361049472:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574384.291824:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361049600:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574384.291835:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574384.291841:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574384/real 1788574384]  req@ffff8dc00644e300 x1875453361049600/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574409 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574384.291850:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453361049600/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574409 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574384.291858:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574384.291861:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574384.291890:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361049600:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574384.291897:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361049728:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574384.291918:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574384.291929:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574384/real 1788574384]  req@ffff8dc00644c700 x1875453361049728/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574409 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574384.291941:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453361049728/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574409 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574384.291952:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574384.291954:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574384.291956:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361049728:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574384.674973:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574384.674973:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574384.674974:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574384.675004:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574384.675005:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574384.675007:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574385.314947:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574385.698938:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574385.698943:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574385.698952:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574385.698958:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574385.698980:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574385.699011:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574386.339017:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574386.723010:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574386.723010:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574386.723010:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574386.723010:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574386.723050:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574386.723104:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574387.362971:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574387.746928:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574387.746966:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574387.747005:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574387.747010:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574387.747055:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574387.747057:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574388.386979:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574388.771015:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574388.771015:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574388.771016:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574388.771027:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574388.771065:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574388.771122:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574389.410945:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788574389.410953:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574389.410960:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788574389.410965:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574389.410975:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2735
00000100:00080000:3.0:1788574389.410986:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574389.410994:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788574389.411031:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e680 x1875453361049856/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574389.411065:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574389.411069:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574389.411071:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574389.411076:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2735
00000100:00080000:3.0:1788574389.411080:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574389.411085:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574389.411094:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574389.411100:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361049856:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788574389.411111:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d180 x1875453361049984/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574389.411123:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574389.411128:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574389.411130:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574389.411134:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2735
00000100:00080000:3.0:1788574389.411138:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574389.411142:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574389.411148:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1788574389.411154:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574389.411165:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f480 x1875453361050112/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574389.411175:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574389.411179:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574389.411181:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574389.411186:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2735
00000100:00080000:3.0:1788574389.411190:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788574389.411191:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574389/real 1788574389]  req@ffff8dc00644e680 x1875453361049856/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574414 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574389.411199:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574389.411207:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574389.411220:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c380 x1875453361050240/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574389.411221:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453361049856/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574414 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574389.411254:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574389.411256:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574389.411262:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574389.411265:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788574389.411266:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574389.411273:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2735
00000100:00100000:1.0:1788574389.411279:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361049856:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788574389.411280:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574389.411289:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574389.411294:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574389.411308:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d500 x1875453361050368/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574389.411310:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361049984:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788574389.411327:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574389.411331:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574389.411334:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574389.411340:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2735
00000100:00080000:3.0:1788574389.411344:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1788574389.411348:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788574389.411353:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574389.411359:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574389.411370:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574389/real 1788574389]  req@ffff8dc00644d180 x1875453361049984/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574414 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574389.411383:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ea00 x1875453361050496/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574389.411404:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453361049984/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574414 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574389.411410:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574389.411419:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574389.411422:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574389.411430:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574389.411430:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2735
00000100:00080000:3.0:1788574389.411435:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574389.411439:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788574389.411443:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574389.411449:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361049984:192.168.202.140@tcp:38:kworker.0
00000008:00100000:3.0:1788574389.411452:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574389.411461:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361050112:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574389.411469:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ca80 x1875453361050624/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788574389.411503:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574389.411514:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574389/real 1788574389]  req@ffff8dc00644f480 x1875453361050112/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574414 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574389.411523:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453361050112/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574414 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574389.411529:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574389.411532:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574389.411534:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361050112:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574389.411538:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361050240:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574389.411558:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574389.411566:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574389/real 1788574389]  req@ffff8dc00644c380 x1875453361050240/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574414 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574389.411573:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453361050240/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574414 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574389.411583:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574389.411586:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574389.411588:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361050240:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574389.411600:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361050368:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574389.411617:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574389.411628:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574389/real 1788574389]  req@ffff8dc00644d500 x1875453361050368/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574414 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574389.411641:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d500 x1875453361050368/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574414 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574389.411651:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574389.411664:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574389.411668:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361050368:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574389.411675:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361050496:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574389.411691:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574389.411700:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574389/real 1788574389]  req@ffff8dc00644ea00 x1875453361050496/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574414 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574389.411708:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ea00 x1875453361050496/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574414 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574389.411713:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574389.411715:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574389.411741:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361050496:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574389.411746:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361050624:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574389.411760:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574389.411768:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574389/real 1788574389]  req@ffff8dc00644ca80 x1875453361050624/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574414 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574389.411776:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ca80 x1875453361050624/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574414 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574389.411782:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574389.411784:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574389.411786:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361050624:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574389.794960:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574389.794965:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574389.794982:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574389.794993:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574389.795005:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788574389.795010:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574390.434943:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574390.818961:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574390.818963:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574390.818967:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574390.818988:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574390.819068:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574390.819107:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574391.458955:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574391.842967:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574391.842967:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574391.842968:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574391.843023:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788574391.843032:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574391.843044:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574392.482941:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574392.866953:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574392.866953:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574392.866953:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574392.866964:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574392.866984:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574392.867021:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574393.506952:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574393.890967:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574393.890967:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574393.890968:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788574393.891006:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574393.891020:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574393.891022:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574394.530988:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574394.531020:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574394.531026:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788574394.531029:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574394.531039:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2740
00000100:00080000:0.0:1788574394.531050:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574394.531057:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574394.531094:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361050752/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574394.531124:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574394.531128:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574394.531130:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574394.531135:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2740
00000100:00080000:0.0:1788574394.531139:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574394.531144:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574394.531154:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574394.531168:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361050752:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788574394.531172:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361050880/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574394.531194:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574394.531198:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574394.531200:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574394.531205:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2740
00000100:00080000:0.0:1788574394.531216:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574394.531223:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:1.0:1788574394.531224:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:0.0:1788574394.531231:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574394.531247:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361051008/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574394.531258:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574394.531264:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1788574394.531264:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574394/real 1788574394]  req@ffff8dc006713100 x1875453361050752/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574419 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574394.531268:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574394.531278:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2740
00000100:00080000:0.0:1788574394.531284:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788574394.531290:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361050752/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574419 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574394.531291:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574394.531299:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574394.531315:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361051136/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574394.531321:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574394.531331:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574394.531331:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788574394.531339:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:1.0:1788574394.531339:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361050752:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788574394.531344:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574394.531350:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2740
00000100:00080000:0.0:1788574394.531354:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574394.531358:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574394.531363:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574394.531373:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361050880:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574394.531377:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361051264/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574394.531391:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574394.531395:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000800:00000100:1.0:1788574394.531400:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788574394.531401:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574394.531408:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2740
00000100:00080000:0.0:1788574394.531413:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788574394.531416:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574394/real 1788574394]  req@ffff8dc006713b80 x1875453361050880/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574419 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574394.531421:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574394.531431:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574394.531435:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361050880/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574419 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574394.531448:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361051392/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574394.531453:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574394.531463:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574394.531470:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361050880:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788574394.531471:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574394.531478:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1788574394.531479:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361051008:192.168.202.140@tcp:8:kworker.0
00000100:00080000:0.0:1788574394.531481:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574394.531488:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2740
00000100:00080000:0.0:1788574394.531492:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574394.531497:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574394.531503:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1788574394.531505:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574394.531522:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361051520/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574394.531523:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574394/real 1788574394]  req@ffff8dc006710e00 x1875453361051008/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574419 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574394.531559:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361051008/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574419 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574394.531570:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574394.531574:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574394.531580:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361051008:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574394.531587:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361051136:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574394.531603:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574394.531611:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574394/real 1788574394]  req@ffff8dc006711880 x1875453361051136/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574419 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574394.531627:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361051136/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574419 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574394.531634:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574394.531636:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574394.531638:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361051136:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574394.531649:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361051264:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574394.531661:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574394.531668:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574394/real 1788574394]  req@ffff8dc006712a00 x1875453361051264/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574419 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574394.531675:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361051264/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574419 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574394.531681:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574394.531683:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574394.531685:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361051264:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574394.531688:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361051392:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574394.531697:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574394.531703:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574394/real 1788574394]  req@ffff8dc006713800 x1875453361051392/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574419 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574394.531710:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361051392/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574419 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574394.531715:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574394.531717:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574394.531719:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361051392:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574394.531722:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361051520:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574394.531732:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574394.531737:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574394/real 1788574394]  req@ffff8dc006713100 x1875453361051520/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574419 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574394.531745:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361051520/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574419 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574394.531749:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574394.531751:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574394.531753:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361051520:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574394.915003:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574394.915004:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574394.915004:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574394.915039:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574394.915074:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574394.915126:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574395.554963:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574395.938948:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574395.938949:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574395.938985:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574395.938991:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788574395.939002:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574395.939006:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574396.578965:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574396.962988:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574396.962991:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574396.963005:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574396.963027:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574396.963044:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574396.963058:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574397.602936:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574397.986985:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574397.986987:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574397.987007:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788574397.987028:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574397.987060:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574397.987060:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574398.626971:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574399.010969:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574399.010970:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574399.010972:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574399.010977:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574399.011009:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574399.011049:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574399.650966:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574399.650970:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574399.650981:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788574399.650985:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574399.650996:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2745
00000100:00080000:1.0:1788574399.651006:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574399.651015:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574399.651051:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361051648/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574399.651079:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574399.651081:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574399.651083:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574399.651086:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2745
00000100:00080000:1.0:1788574399.651088:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574399.651091:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574399.651099:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574399.651112:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361051776/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574399.651118:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574399.651121:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574399.651122:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574399.651124:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2745
00000100:00080000:1.0:1788574399.651126:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574399.651128:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574399.651132:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574399.651140:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361051648:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788574399.651141:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361051904/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574399.651155:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574399.651157:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574399.651158:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574399.651160:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2745
00000100:00080000:1.0:1788574399.651161:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574399.651163:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574399.651166:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574399.651174:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361052032/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574399.651180:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574399.651182:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574399.651184:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574399.651186:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2745
00000100:00080000:1.0:1788574399.651189:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574399.651191:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574399.651194:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574399.651201:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361052160/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574399.651206:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574399.651208:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574399.651209:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574399.651212:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2745
00000100:00080000:1.0:1788574399.651214:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574399.651217:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574399.651220:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788574399.651226:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574399.651228:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361052288/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574399.651247:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574399.651250:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574399.651252:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574399.651256:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2745
00000100:00080000:1.0:1788574399.651259:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574399.651264:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574399.651269:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574399.651278:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574399/real 1788574399]  req@ffff8dc005dc0700 x1875453361051648/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574424 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574399.651285:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361052416/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574399.651316:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361051648/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574424 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574399.651340:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574399.651344:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574399.651349:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361051648:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788574399.651358:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361051776:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574399.651382:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574399.651396:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574399/real 1788574399]  req@ffff8dc005dc1180 x1875453361051776/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574424 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574399.651410:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361051776/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574424 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574399.651421:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574399.651425:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574399.651429:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361051776:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574399.651450:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361051904:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574399.651473:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574399.651486:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574399/real 1788574399]  req@ffff8dc005dc3b80 x1875453361051904/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574424 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574399.651498:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361051904/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574424 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574399.651507:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574399.651511:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574399.651514:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361051904:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574399.651522:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361052032:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574399.651543:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574399.651555:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574399/real 1788574399]  req@ffff8dc005dc0a80 x1875453361052032/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574424 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574399.651569:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361052032/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574424 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574399.651579:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574399.651582:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574399.651587:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361052032:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574399.651593:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361052160:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574399.651614:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574399.651625:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574399/real 1788574399]  req@ffff8dc005dc1500 x1875453361052160/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574424 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574399.651638:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361052160/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574424 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574399.651648:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574399.651653:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574399.651656:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361052160:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574399.651664:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361052288:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574399.651684:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574399.651695:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574399/real 1788574399]  req@ffff8dc005dc1c00 x1875453361052288/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574424 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574399.651708:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361052288/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574424 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574399.651716:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574399.651720:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574399.651723:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361052288:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574399.651730:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361052416:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574399.651751:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574399.651762:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574399/real 1788574399]  req@ffff8dc005dc3800 x1875453361052416/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574424 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574399.651773:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361052416/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574424 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574399.651781:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574399.651785:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574399.651788:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361052416:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574400.034974:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574400.034984:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574400.035010:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574400.035116:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574400.035124:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788574400.035145:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574400.674973:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574401.058965:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574401.058965:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574401.058965:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574401.058967:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574401.058995:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574401.059049:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574401.698984:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574402.083004:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574402.083004:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574402.083018:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574402.083061:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574402.083087:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574402.083090:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574402.723022:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574403.106974:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574403.106974:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574403.106983:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574403.107009:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574403.107020:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788574403.107029:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574403.746963:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574404.131007:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574404.131007:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574404.131013:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574404.131023:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574404.131048:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574404.131107:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1788574404.770991:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788574404.770995:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574404.771001:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788574404.771006:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574404.771015:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2750
00000100:00080000:1.0:1788574404.771024:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574404.771030:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574404.771064:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361052544/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574404.771086:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574404.771088:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574404.771090:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574404.771093:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2750
00000100:00080000:1.0:1788574404.771095:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574404.771097:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574404.771105:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574404.771116:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361052672/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574404.771123:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574404.771127:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574404.771128:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574404.771132:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2750
00000100:00080000:1.0:1788574404.771134:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574404.771136:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574404.771139:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574404.771146:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361052800/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574404.771153:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574404.771156:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574404.771157:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574404.771165:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2750
00000100:00100000:2.0:1788574404.771167:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361052544:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574404.771169:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574404.771181:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574404.771195:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574404.771209:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361052928/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574404.771215:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574404.771218:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574404.771219:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574404.771222:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2750
00000100:00080000:1.0:1788574404.771224:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574404.771227:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574404.771230:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574404.771239:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361053056/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574404.771245:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574404.771248:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574404.771249:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574404.771253:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2750
00000100:00080000:1.0:1788574404.771258:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574404.771260:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574404.771264:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788574404.771269:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574404.771274:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361053184/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574404.771291:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574404.771295:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574404.771296:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574404.771300:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2750
00000100:00080000:1.0:1788574404.771303:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574404.771305:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574404.771310:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574404.771324:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361053312/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574404.771331:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574404/real 1788574404]  req@ffff8dc005dc2d80 x1875453361052544/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574429 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574404.771354:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361052544/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574429 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574404.771364:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574404.771368:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574404.771372:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361052544:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788574404.771378:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361052672:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574404.771397:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574404.771407:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574404/real 1788574404]  req@ffff8dc005dc3800 x1875453361052672/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574429 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574404.771416:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361052672/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574429 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574404.771424:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574404.771426:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574404.771429:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361052672:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574404.771467:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361052800:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574404.771483:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574404.771496:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574404/real 1788574404]  req@ffff8dc005dc1c00 x1875453361052800/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574429 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574404.771509:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361052800/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574429 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574404.771516:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574404.771519:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574404.771521:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361052800:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574404.771525:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361052928:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574404.771537:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574404.771544:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574404/real 1788574404]  req@ffff8dc005dc1500 x1875453361052928/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574429 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574404.771552:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361052928/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574429 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574404.771558:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574404.771560:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574404.771562:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361052928:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574404.771566:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361053056:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574404.771578:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574404.771585:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574404/real 1788574404]  req@ffff8dc005dc0a80 x1875453361053056/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574429 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574404.771592:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361053056/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574429 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574404.771603:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574404.771605:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574404.771607:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361053056:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574404.771611:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361053184:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574404.771622:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574404.771628:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574404/real 1788574404]  req@ffff8dc005dc3b80 x1875453361053184/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574429 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574404.771635:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361053184/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574429 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574404.771640:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574404.771643:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574404.771645:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361053184:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574404.771649:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361053312:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574404.771659:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574404.771664:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574404/real 1788574404]  req@ffff8dc005dc1180 x1875453361053312/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574429 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574404.771671:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361053312/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574429 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574404.771676:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574404.771678:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574404.771681:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361053312:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574405.154986:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574405.154990:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574405.154993:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574405.155030:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574405.155058:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574405.155059:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574405.794945:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574406.179003:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574406.179005:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574406.179036:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574406.179041:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574406.179068:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574406.179086:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574406.819032:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574407.203041:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574407.203044:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574407.203045:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574407.203049:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574407.203101:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574407.203148:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574407.842968:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574408.227000:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574408.227049:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574408.227051:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574408.227061:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574408.227067:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574408.227120:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574408.867003:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574409.251009:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574409.251009:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574409.251015:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574409.251028:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574409.251055:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574409.251106:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574409.891050:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574409.891051:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574409.891062:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788574409.891068:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574409.891081:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2755
00000100:00080000:0.0:1788574409.891095:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574409.891103:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574409.891148:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361053440/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574409.891179:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574409.891184:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574409.891187:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574409.891192:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2755
00000100:00080000:0.0:1788574409.891196:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574409.891202:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574409.891214:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574409.891224:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361053440:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788574409.891240:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361053568/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574409.891259:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574409.891263:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574409.891268:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574409.891277:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2755
00000100:00080000:0.0:1788574409.891283:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574409.891288:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574409.891296:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788574409.891304:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574409.891310:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361053696/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574409.891323:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574409.891326:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574409.891334:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574409.891340:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2755
00000100:00080000:0.0:1788574409.891345:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574409.891349:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574409.891355:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574409.891363:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574409/real 1788574409]  req@ffff8dc006712300 x1875453361053440/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574434 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574409.891369:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453361053824/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574409.891383:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361053440/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574434 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574409.891384:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574409.891394:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574409.891399:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574409.891401:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574409.891408:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2755
00000100:00080000:2.0:1788574409.891408:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788574409.891419:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1788574409.891419:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361053440:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788574409.891438:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574409.891444:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574409.891446:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361053568:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574409.891462:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361053952/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788574409.891472:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788574409.891477:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574409.891482:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574409.891484:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788574409.891485:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574409/real 1788574409]  req@ffff8dc006713480 x1875453361053568/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574434 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574409.891493:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2755
00000100:00080000:0.0:1788574409.891502:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1788574409.891504:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361053568/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574434 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574409.891509:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574409.891519:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1788574409.891522:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574409.891528:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574409.891532:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361053568:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574409.891537:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361054080/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574409.891540:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361053696:192.168.202.140@tcp:8:kworker.0
00000100:00080000:0.0:1788574409.891558:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574409.891562:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574409.891567:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:2.0:1788574409.891567:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788574409.891575:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2755
00000100:00080000:0.0:1788574409.891580:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1788574409.891580:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574409/real 1788574409]  req@ffff8dc006712680 x1875453361053696/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574434 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574409.891588:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574409.891597:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574409.891597:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361053696/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574434 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574409.891608:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574409.891611:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574409.891616:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361054208/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574409.891619:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361053696:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574409.891631:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361053824:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574409.891649:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574409.891659:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574409/real 1788574409]  req@ffff8dc006710380 x1875453361053824/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574434 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574409.891668:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453361053824/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574434 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574409.891676:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574409.891679:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574409.891686:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361053824:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574409.891726:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361053952:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574409.891752:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574409.891777:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574409/real 1788574409]  req@ffff8dc006711c00 x1875453361053952/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574434 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574409.891787:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361053952/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574434 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574409.891793:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574409.891796:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574409.891798:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361053952:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574409.891802:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361054080:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574409.891817:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574409.891824:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574409/real 1788574409]  req@ffff8dc006711500 x1875453361054080/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574434 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574409.891831:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361054080/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574434 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574409.891836:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574409.891838:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574409.891840:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361054080:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574409.891844:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361054208:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574409.891853:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574409.891859:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574409/real 1788574409]  req@ffff8dc006712300 x1875453361054208/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574434 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574409.891904:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361054208/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574434 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574409.891909:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574409.891911:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574409.891914:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361054208:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574410.275031:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574410.275031:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574410.275032:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574410.275032:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574410.275094:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574410.275138:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574410.914967:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574411.298973:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574411.298976:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574411.298977:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574411.298981:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574411.299050:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788574411.299064:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574411.939026:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574412.322976:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574412.322987:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574412.323000:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574412.323006:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574412.323022:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574412.323074:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574412.962951:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574413.346960:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574413.346960:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574413.346961:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574413.346961:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574413.347016:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574413.347059:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574413.986967:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574414.370965:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574414.370967:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574414.370968:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574414.370987:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574414.371026:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574414.371054:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574415.010959:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574415.010962:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574415.010972:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788574415.010976:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574415.011000:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2760
00000100:00080000:0.0:1788574415.011011:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574415.011019:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574415.011057:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361054336/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574415.011086:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574415.011090:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574415.011092:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574415.011096:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2760
00000100:00080000:0.0:1788574415.011101:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574415.011106:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574415.011116:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574415.011122:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361054336:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788574415.011137:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361054464/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574415.011150:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574415.011155:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574415.011157:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574415.011162:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2760
00000100:00080000:0.0:1788574415.011166:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574415.011171:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574415.011178:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788574415.011188:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574415.011194:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361054592/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574415.011207:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574415.011210:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574415.011212:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574415.011216:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2760
00000100:00080000:0.0:1788574415.011267:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574415.011272:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574415.011278:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574415.011290:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574415/real 1788574415]  req@ffff8dc006713100 x1875453361054336/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574440 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574415.011295:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361054720/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574415.011321:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574415.011327:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:2.0:1788574415.011328:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361054336/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574440 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574415.011332:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574415.011343:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2760
00000100:00080000:2.0:1788574415.011349:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574415.011350:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574415.011361:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788574415.011362:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574415.011371:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574415.011372:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361054336:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788574415.011389:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361054848/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574415.011403:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361054464:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788574415.011404:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574415.011413:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574415.011416:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574415.011423:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2760
00000100:00080000:0.0:1788574415.011428:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574415.011432:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:2.0:1788574415.011438:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:0.0:1788574415.011441:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574415.011455:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574415/real 1788574415]  req@ffff8dc006713800 x1875453361054464/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574440 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574415.011460:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361054976/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574415.011482:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788574415.011483:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361054464/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574440 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574415.011490:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574415.011495:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574415.011505:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2760
00000100:00080000:2.0:1788574415.011507:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574415.011510:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574415.011515:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788574415.011520:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574415.011525:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361054464:192.168.202.140@tcp:38:kworker.0
00000008:00100000:0.0:1788574415.011528:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574415.011536:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361054592:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574415.011546:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361055104/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788574415.011561:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574415.011576:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574415/real 1788574415]  req@ffff8dc006712a00 x1875453361054592/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574440 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574415.011598:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361054592/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574440 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574415.011608:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574415.011612:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574415.011615:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361054592:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574415.011621:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361054720:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574415.011640:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574415.011651:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574415/real 1788574415]  req@ffff8dc006711880 x1875453361054720/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574440 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574415.011664:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361054720/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574440 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574415.011673:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574415.011676:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574415.011680:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361054720:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574415.011695:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361054848:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574415.011713:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574415.011723:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574415/real 1788574415]  req@ffff8dc006710e00 x1875453361054848/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574440 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574415.011735:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361054848/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574440 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574415.011743:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574415.011746:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574415.011749:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361054848:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574415.011755:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361054976:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574415.011771:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574415.011782:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574415/real 1788574415]  req@ffff8dc006713b80 x1875453361054976/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574440 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574415.011801:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361054976/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574440 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574415.011809:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574415.011812:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574415.011816:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361054976:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574415.011821:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361055104:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574415.011838:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574415.011848:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574415/real 1788574415]  req@ffff8dc006713100 x1875453361055104/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574440 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574415.011859:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361055104/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574440 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574415.011886:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574415.011891:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574415.011894:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361055104:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574415.394934:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574415.394951:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574415.394965:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788574415.394976:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574415.394981:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574415.395012:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574416.034981:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574416.419011:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574416.419012:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574416.419039:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574416.419055:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574416.419079:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574416.419096:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574417.058944:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574417.442950:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574417.442952:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574417.442958:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574417.442987:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574417.442988:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574417.442994:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574418.082991:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574418.466981:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574418.466981:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574418.466986:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574418.467012:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574418.467014:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574418.467030:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574419.106928:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574419.490966:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574419.490968:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574419.490985:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574419.490997:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574419.491015:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574419.491016:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574420.130970:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574420.130985:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574420.130992:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788574420.130996:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574420.131006:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2765
00000100:00080000:1.0:1788574420.131016:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574420.131024:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574420.131075:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361055232/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574420.131100:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574420.131104:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574420.131106:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574420.131110:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2765
00000100:00080000:1.0:1788574420.131115:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574420.131120:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574420.131131:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574420.131132:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361055232:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788574420.131152:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361055360/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574420.131163:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574420.131168:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574420.131170:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574420.131174:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2765
00000100:00080000:1.0:1788574420.131181:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574420.131186:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574420.131191:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574420.131204:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361055488/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574420.131214:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574420.131218:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574420.131220:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788574420.131226:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361055360:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788574420.131227:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2765
00000100:00080000:1.0:1788574420.131235:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574420.131239:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574420.131245:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574420.131259:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361055488:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574420.131262:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361055616/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574420.131276:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574420.131280:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:2.0:1788574420.131283:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361055616:192.168.202.140@tcp:8:kworker.0
00000100:00080000:1.0:1788574420.131293:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574420.131304:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2765
00000100:00080000:1.0:1788574420.131309:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574420.131315:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574420.131321:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574420.131333:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361055744/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574420.131350:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574420.131353:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574420.131355:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574420.131360:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2765
00000100:00080000:1.0:1788574420.131364:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574420.131368:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574420.131373:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574420.131377:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361055744:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574420.131388:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361055872/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574420.131399:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574420.131403:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574420.131405:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788574420.131409:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361055872:192.168.202.140@tcp:8:kworker.0
00000100:00080000:1.0:1788574420.131413:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2765
00000100:00080000:1.0:1788574420.131419:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574420.131424:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574420.131430:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574420.131442:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361056000/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574420.131477:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361056000:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574420.514950:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574420.514957:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574420.514973:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574420.514983:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574420.514990:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574420.514999:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574421.154987:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574421.538980:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574421.538980:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574421.538997:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574421.539012:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574421.539114:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574421.539128:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574422.178985:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574422.562970:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574422.562970:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574422.562971:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574422.562974:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574422.563004:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788574422.563080:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574423.202956:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000400:00000100:0.0:1788574423.203119:0:2335:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.140:988
00000400:00000100:0.0:1788574423.203152:0:2335:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.140@tcp at host 192.168.202.140 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:0.0:1788574423.203168:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:0.0:1788574423.203213:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:0.0:1788574423.203222:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:0.0:1788574423.203230:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:0.0:1788574423.203235:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:0.0:1788574423.203244:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:0.0:1788574423.203251:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:2.0:1788574423.203262:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574420/real 1788574423]  req@ffff8dc005dc1500 x1875453361055744/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574445 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574423.203285:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361055744/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574445 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574423.203299:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574423.203304:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574423.203309:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361055744:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574423.203318:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574420/real 1788574423]  req@ffff8dc005dc0a80 x1875453361055616/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574445 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574423.203331:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361055616/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574445 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574423.203341:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574423.203346:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574423.203349:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361055616:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574423.203356:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574420/real 1788574423]  req@ffff8dc005dc1180 x1875453361055360/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574445 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574423.203367:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361055360/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574445 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574423.203377:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574423.203380:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574423.203383:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361055360:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574423.203389:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574420/real 1788574423]  req@ffff8dc005dc3b80 x1875453361055488/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574445 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574423.203400:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361055488/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574445 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574423.203408:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574423.203411:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574423.203414:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361055488:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574423.203420:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574420/real 1788574423]  req@ffff8dc005dc0700 x1875453361055232/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574445 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574423.203430:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361055232/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574445 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574423.203437:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574423.203440:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574423.203443:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361055232:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788574423.203472:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574420/real 1788574423]  req@ffff8dc005dc3800 x1875453361056000/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574445 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574423.203485:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361056000/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574445 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574423.203494:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574423.203498:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574423.203501:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361056000:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574423.203508:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574420/real 1788574423]  req@ffff8dc005dc1c00 x1875453361055872/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574445 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574423.203520:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361055872/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574445 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574423.203530:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574423.203533:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574423.203537:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361055872:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574423.586982:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574423.586982:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574423.586982:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574423.587014:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574423.587017:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788574423.587031:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574424.227030:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574424.610925:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574424.610954:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574424.610958:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574424.610968:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574424.610997:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574424.611032:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574425.250965:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574425.251007:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574425.251012:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788574425.251016:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574425.251023:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2770
00000100:00080000:0.0:1788574425.251032:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574425.251038:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574425.251065:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361056128/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574425.251102:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574425.251107:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574425.251109:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574425.251113:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2770
00000100:00080000:0.0:1788574425.251117:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574425.251121:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574425.251131:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574425.251144:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361056128:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788574425.251146:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361056256/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574425.251157:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574425.251160:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574425.251161:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574425.251165:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2770
00000100:00080000:0.0:1788574425.251168:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574425.251172:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574425.251176:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574425.251185:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361056384/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574425.251193:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574425.251196:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574425.251197:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574425.251201:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2770
00000100:00080000:0.0:1788574425.251203:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574425.251207:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:2.0:1788574425.251207:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:0.0:1788574425.251211:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574425.251220:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453361056512/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574425.251228:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574425.251231:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574425.251233:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574425.251237:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2770
00000100:00080000:0.0:1788574425.251240:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574425.251243:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574425.251247:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574425/real 1788574425]  req@ffff8dc006712300 x1875453361056128/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574450 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1788574425.251248:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574425.251256:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361056640/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574425.251264:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361056128/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574450 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574425.251265:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574425.251268:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574425.251270:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574425.251274:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2770
00000100:00080000:0.0:1788574425.251277:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574425.251281:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574425.251285:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1788574425.251286:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574425.251290:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574425.251295:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361056768/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574425.251295:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361056128:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788574425.251304:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574425.251306:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574425.251308:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574425.251311:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2770
00000100:00080000:0.0:1788574425.251314:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1788574425.251317:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361056256:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788574425.251318:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574425.251323:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574425.251341:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361056896/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788574425.251341:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574425.251355:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574425/real 1788574425]  req@ffff8dc006711500 x1875453361056256/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574450 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574425.251368:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361056256/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574450 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574425.251381:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574425.251385:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574425.251388:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361056256:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574425.251395:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361056384:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574425.251418:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574425.251431:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574425/real 1788574425]  req@ffff8dc006711c00 x1875453361056384/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574450 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574425.251445:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361056384/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574450 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574425.251455:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574425.251459:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574425.251463:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361056384:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574425.251469:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361056512:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574425.251490:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574425.251503:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574425/real 1788574425]  req@ffff8dc006710380 x1875453361056512/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574450 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574425.251515:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453361056512/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574450 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574425.251524:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574425.251527:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574425.251532:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361056512:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574425.251538:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361056640:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574425.251560:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574425.251582:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574425/real 1788574425]  req@ffff8dc006712680 x1875453361056640/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574450 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574425.251595:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361056640/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574450 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574425.251605:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574425.251608:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574425.251611:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361056640:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574425.251617:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361056768:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574425.251638:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574425.251650:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574425/real 1788574425]  req@ffff8dc006713480 x1875453361056768/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574450 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574425.251663:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361056768/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574450 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574425.251671:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574425.251674:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574425.251677:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361056768:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574425.251696:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361056896:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574425.251724:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574425.251736:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574425/real 1788574425]  req@ffff8dc006712300 x1875453361056896/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574450 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574425.251748:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361056896/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574450 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574425.251756:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574425.251760:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574425.251763:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361056896:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574425.634972:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574425.634972:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574425.634998:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574425.635019:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574425.635032:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788574425.635119:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574426.274949:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574426.658958:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574426.658961:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574426.658966:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574426.658990:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574426.658994:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574426.659010:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574427.298944:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574427.682969:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574427.682969:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574427.682969:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574427.682997:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574427.683002:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574427.683015:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574428.322965:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574428.706959:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574428.706959:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574428.706970:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574428.706993:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574428.706996:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574428.706996:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574429.347006:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574429.731028:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574429.731030:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574429.731048:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574429.731071:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574429.731075:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574429.731107:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574430.371016:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574430.371028:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788574430.371033:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788574430.371040:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574430.371045:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2776
00000100:00080000:1.0:1788574430.371058:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574430.371066:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574430.371110:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361057024/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574430.371131:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574430.371136:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574430.371138:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574430.371141:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2776
00000100:00080000:1.0:1788574430.371158:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574430.371162:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574430.371173:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574430.371188:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361057152/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574430.371191:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361057024:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574430.371206:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574430.371209:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574430.371211:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574430.371215:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2776
00000100:00080000:1.0:1788574430.371218:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574430.371220:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574430.371224:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574430.371233:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361057280/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574430.371239:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574430.371242:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574430.371245:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574430.371249:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2776
00000100:00080000:1.0:1788574430.371253:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574430.371257:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574430.371264:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788574430.371273:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574430.371287:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361057408/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574430.371300:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574430.371304:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574430.371306:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574430.371312:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2776
00000100:00080000:1.0:1788574430.371317:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1788574430.371324:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574430/real 1788574430]  req@ffff8dc005dc2d80 x1875453361057024/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574455 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574430.371325:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574430.371334:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574430.371354:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361057536/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574430.371357:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361057024/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574455 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574430.371383:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574430.371386:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574430.371389:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574430.371393:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574430.371394:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574430.371402:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361057024:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574430.371404:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2776
00000100:00080000:1.0:1788574430.371411:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574430.371417:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574430.371423:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574430.371432:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361057152:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574430.371438:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361057664/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574430.371453:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:2.0:1788574430.371459:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788574430.371461:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574430.371465:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788574430.371474:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574430/real 1788574430]  req@ffff8dc005dc1c00 x1875453361057152/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574455 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574430.371480:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2776
00000100:00100000:2.0:1788574430.371488:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361057152/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574455 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574430.371492:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574430.371500:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574430.371507:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1788574430.371509:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574430.371514:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574430.371518:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361057152:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574430.371524:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361057792/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574430.371528:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361057280:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574430.371552:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574430.371562:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574430/real 1788574430]  req@ffff8dc005dc3800 x1875453361057280/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574455 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574430.371570:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361057280/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574455 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574430.371578:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574430.371580:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574430.371583:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361057280:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574430.371586:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361057408:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574430.371605:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574430.371614:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574430/real 1788574430]  req@ffff8dc005dc0700 x1875453361057408/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574455 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574430.371638:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361057408/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574455 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574430.371647:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574430.371651:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574430.371655:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361057408:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574430.371662:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361057536:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574430.371682:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574430.371691:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574430/real 1788574430]  req@ffff8dc005dc3b80 x1875453361057536/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574455 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574430.371699:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361057536/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574455 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574430.371706:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574430.371708:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574430.371722:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361057536:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574430.371750:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361057664:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574430.371773:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574430.371785:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574430/real 1788574430]  req@ffff8dc005dc1180 x1875453361057664/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574455 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574430.371799:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361057664/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574455 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574430.371805:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574430.371807:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574430.371809:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361057664:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574430.371813:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361057792:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574430.371826:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574430.371832:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574430/real 1788574430]  req@ffff8dc005dc0a80 x1875453361057792/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574455 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574430.371840:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361057792/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574455 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574430.371845:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574430.371855:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574430.371857:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361057792:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574430.754974:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574430.755004:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574430.755016:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574430.755035:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574430.755057:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574430.755061:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574431.394953:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574431.779013:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574431.779013:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574431.779013:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574431.779054:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574431.779056:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574431.779057:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574432.418975:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574432.802977:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574432.802978:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574432.802978:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574432.803012:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574432.803012:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788574432.803027:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574433.443058:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574433.826980:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574433.826992:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574433.827025:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574433.827027:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574433.827028:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574433.827048:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574434.466983:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574434.850992:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574434.850993:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574434.850993:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574434.851031:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574434.851032:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574434.851061:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1788574435.491015:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574435.491026:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788574435.491031:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574435.491042:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2781
00000100:00080000:2.0:1788574435.491055:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574435.491063:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574435.491110:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453361057920/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574435.491143:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574435.491147:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574435.491148:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574435.491153:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2781
00000100:00080000:2.0:1788574435.491156:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574435.491159:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574435.491170:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574435.491180:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361057920:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788574435.491182:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453361058048/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574435.491195:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574435.491199:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574435.491230:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574435.491236:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2781
00000100:00080000:2.0:1788574435.491243:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574435.491248:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574435.491255:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574435.491269:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361058176/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788574435.491279:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788574435.491279:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574435.491285:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574435.491287:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574435.491291:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2781
00000100:00080000:2.0:1788574435.491296:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574435.491299:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574435.491304:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574435.491315:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361058304/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574435.491321:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574435.491324:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574435.491326:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574435.491329:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2781
00000100:00080000:2.0:1788574435.491332:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788574435.491336:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574435/real 1788574435]  req@ffff8dc020494a80 x1875453361057920/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574460 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574435.491337:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574435.491344:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574435.491355:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453361058432/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574435.491373:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788574435.491377:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453361057920/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574460 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574435.491378:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574435.491382:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574435.491394:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574435.491398:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2781
00000100:00080000:1.0:1788574435.491402:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788574435.491404:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788574435.491409:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361057920:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788574435.491410:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574435.491418:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574435.491430:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361058560/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574435.491436:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574435.491439:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574435.491441:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1788574435.491444:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361058048:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788574435.491447:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2781
00000100:00080000:2.0:1788574435.491453:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574435.491456:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574435.491459:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574435.491469:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361058688/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788574435.491475:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574435.491490:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574435/real 1788574435]  req@ffff8dc020497480 x1875453361058048/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574460 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574435.491501:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453361058048/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574460 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574435.491511:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1788574435.491514:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574435.491515:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574435.491521:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361058048:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574435.491528:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361058176:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574435.491544:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574435.491553:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574435/real 1788574435]  req@ffff8dc020495180 x1875453361058176/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574460 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574435.491561:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361058176/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574460 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574435.491567:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574435.491570:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574435.491572:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361058176:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574435.491575:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361058304:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574435.491585:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574435.491591:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574435/real 1788574435]  req@ffff8dc020494000 x1875453361058304/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574460 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574435.491603:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361058304/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574460 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574435.491609:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574435.491611:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574435.491612:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361058304:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574435.491616:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361058432:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574435.491626:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574435.491633:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574435/real 1788574435]  req@ffff8dc020496d80 x1875453361058432/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574460 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574435.491640:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453361058432/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574460 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574435.491646:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574435.491648:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574435.491650:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361058432:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574435.491653:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361058560:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574435.491663:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574435.491668:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574435/real 1788574435]  req@ffff8dc020495880 x1875453361058560/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574460 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574435.491676:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361058560/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574460 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574435.491686:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574435.491688:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574435.491690:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361058560:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574435.491703:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361058688:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574435.491713:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574435.491718:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574435/real 1788574435]  req@ffff8dc020495500 x1875453361058688/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574460 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574435.491726:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361058688/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574460 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574435.491731:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574435.491733:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574435.491735:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361058688:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574435.875018:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574435.875019:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574435.875039:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574435.875064:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574435.875064:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574435.875078:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574436.514962:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574436.899006:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574436.899006:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574436.899007:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574436.899089:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574436.899159:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788574436.899253:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574437.538985:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574437.923025:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574437.923031:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574437.923033:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574437.923081:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574437.923082:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788574437.923099:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574438.562979:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574438.947006:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574438.947013:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574438.947014:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574438.947017:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574438.947055:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574438.947149:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574439.587031:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574439.970969:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574439.971020:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574439.971026:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574439.971042:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574439.971055:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788574439.971086:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574440.610980:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574440.611019:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574440.611028:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788574440.611032:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574440.611043:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2786
00000100:00080000:1.0:1788574440.611055:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574440.611062:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574440.611107:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361058816/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574440.611139:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574440.611142:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574440.611144:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574440.611147:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2786
00000100:00080000:1.0:1788574440.611151:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574440.611155:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574440.611168:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574440.611186:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361058944/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574440.611199:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361058816:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574440.611202:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574440.611208:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574440.611210:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574440.611215:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2786
00000100:00080000:1.0:1788574440.611220:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574440.611224:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574440.611231:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574440.611246:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361059072/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574440.611270:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574440.611274:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574440.611277:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574440.611281:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2786
00000100:00080000:1.0:1788574440.611285:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574440.611288:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574440.611293:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788574440.611298:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574440.611306:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361059200/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574440.611314:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574440.611317:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574440.611319:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574440.611323:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2786
00000100:00080000:1.0:1788574440.611328:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574440.611332:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574440.611337:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574440.611353:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361059328/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574440.611354:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574440/real 1788574440]  req@ffff8dc005dc1500 x1875453361058816/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574465 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574440.611387:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574440.611390:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574440.611392:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574440.611396:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2786
00000100:00080000:1.0:1788574440.611399:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1788574440.611400:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361058816/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574465 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574440.611405:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574440.611415:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1788574440.611418:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574440.611425:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574440.611428:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361059456/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574440.611432:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361058816:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574440.611445:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574440.611447:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574440.611449:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574440.611452:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2786
00000100:00080000:1.0:1788574440.611454:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574440.611456:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574440.611459:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574440.611464:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361058944:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574440.611468:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361059584/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788574440.611499:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574440.611517:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574440/real 1788574440]  req@ffff8dc005dc0a80 x1875453361058944/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574465 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574440.611530:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361058944/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574465 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574440.611543:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574440.611545:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574440.611548:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361058944:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574440.611552:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361059072:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574440.611568:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574440.611576:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574440/real 1788574440]  req@ffff8dc005dc1180 x1875453361059072/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574465 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574440.611583:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361059072/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574465 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574440.611590:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574440.611592:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574440.611594:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361059072:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574440.611597:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361059200:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574440.611608:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574440.611613:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574440/real 1788574440]  req@ffff8dc005dc3b80 x1875453361059200/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574465 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574440.611620:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361059200/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574465 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574440.611626:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574440.611628:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574440.611631:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361059200:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574440.611635:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361059328:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574440.611645:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574440.611651:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574440/real 1788574440]  req@ffff8dc005dc0700 x1875453361059328/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574465 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574440.611658:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361059328/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574465 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574440.611665:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574440.611666:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574440.611668:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361059328:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574440.611671:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361059456:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574440.611682:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574440.611688:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574440/real 1788574440]  req@ffff8dc005dc3800 x1875453361059456/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574465 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574440.611696:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361059456/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574465 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574440.611701:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574440.611703:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574440.611705:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361059456:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574440.611717:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361059584:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574440.611727:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574440.611734:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574440/real 1788574440]  req@ffff8dc005dc1c00 x1875453361059584/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574465 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574440.611741:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361059584/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574465 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574440.611747:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574440.611748:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574440.611751:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361059584:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574440.994965:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574440.994972:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574440.994989:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574440.994999:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574440.995005:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574440.995029:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574441.634978:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574442.018935:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574442.018945:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574442.018962:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574442.018971:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788574442.019047:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574442.019060:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574442.658998:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574443.043018:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574443.043020:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574443.043021:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574443.043063:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574443.043115:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574443.043131:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574443.682981:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574444.066948:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574444.066948:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574444.066973:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574444.066994:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788574444.066997:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574444.067007:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574444.706940:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574445.090996:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574445.091002:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574445.091034:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574445.091049:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574445.091101:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574445.091102:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574445.731022:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788574445.731027:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574445.731036:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788574445.731042:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574445.731055:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2791
00000100:00080000:1.0:1788574445.731067:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574445.731076:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574445.731121:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361059712/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574445.731173:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574445.731178:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574445.731180:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574445.731187:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2791
00000100:00080000:1.0:1788574445.731194:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574445.731200:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574445.731211:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574445.731229:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361059712:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788574445.731232:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361059840/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574445.731261:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574445.731266:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574445.731269:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574445.731278:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2791
00000100:00080000:1.0:1788574445.731285:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574445.731295:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574445.731304:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574445.731335:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361059968/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574445.731345:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574445.731349:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574445.731351:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574445.731355:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2791
00000100:00080000:1.0:1788574445.731361:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574445.731365:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574445.731371:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574445.731385:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361060096/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574445.731395:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574445.731399:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574445.731401:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574445.731407:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2791
00000100:00080000:1.0:1788574445.731411:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574445.731416:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574445.731422:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574445.731437:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361060224/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788574445.731444:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788574445.731459:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574445.731463:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574445.731467:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574445.731475:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2791
00000100:00080000:1.0:1788574445.731482:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574445.731488:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574445.731494:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574445.731511:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361060352/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788574445.731516:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574445/real 1788574445]  req@ffff8dc005dc2d80 x1875453361059712/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574470 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574445.731569:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788574445.731570:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361059712/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574470 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574445.731595:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574445.731599:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788574445.731600:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574445.731605:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788574445.731605:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361059712:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574445.731623:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2791
00000100:00080000:1.0:1788574445.731628:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574445.731633:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574445.731640:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574445.731646:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361059840:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574445.731664:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361060480/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788574445.731791:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574445.731805:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574445/real 1788574445]  req@ffff8dc005dc1c00 x1875453361059840/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574470 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574445.731851:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361059840/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574470 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574445.731863:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574445.731908:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574445.731917:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361059840:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574445.731930:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361059968:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574445.731961:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574445.731972:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574445/real 1788574445]  req@ffff8dc005dc3800 x1875453361059968/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574470 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574445.731980:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361059968/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574470 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574445.731987:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574445.731990:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574445.731992:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361059968:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574445.731997:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361060096:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574445.732011:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574445.732017:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574445/real 1788574445]  req@ffff8dc005dc0700 x1875453361060096/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574470 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574445.732025:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361060096/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574470 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574445.732031:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574445.732033:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574445.732035:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361060096:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574445.732039:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361060224:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788574445.732051:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574445.732057:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574445/real 1788574445]  req@ffff8dc005dc3b80 x1875453361060224/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574470 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574445.732065:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361060224/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574470 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574445.732071:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574445.732073:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574445.732075:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361060224:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574445.732079:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361060352:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574445.732090:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574445.732096:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574445/real 1788574445]  req@ffff8dc005dc1180 x1875453361060352/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574470 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574445.732103:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361060352/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574470 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574445.732113:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574445.732116:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574445.732118:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361060352:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574445.732132:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361060480:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574445.732143:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574445.732149:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574445/real 1788574445]  req@ffff8dc005dc0a80 x1875453361060480/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574470 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574445.732156:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361060480/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574470 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574445.732162:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574445.732164:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574445.732166:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361060480:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574446.115016:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574446.115027:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574446.115027:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574446.115071:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788574446.115091:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574446.115093:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574446.754966:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574447.139006:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574447.139006:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574447.139017:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574447.139032:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574447.139054:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574447.139065:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574447.778955:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574448.162971:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574448.162974:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574448.163034:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574448.163043:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574448.163045:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574448.163055:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574448.802930:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574449.186977:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574449.186978:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574449.187025:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574449.187092:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574449.187105:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574449.187119:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574449.826952:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574450.210975:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574450.210975:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574450.210975:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574450.211008:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574450.211010:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574450.211011:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1788574450.850979:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788574450.850980:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574450.850991:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788574450.850996:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574450.851007:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2796
00000100:00080000:1.0:1788574450.851018:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574450.851027:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574450.851066:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361060608/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574450.851096:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574450.851100:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574450.851102:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574450.851106:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2796
00000100:00080000:1.0:1788574450.851109:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574450.851112:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574450.851121:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574450.851134:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361060736/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574450.851143:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574450.851146:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574450.851148:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574450.851154:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2796
00000100:00100000:3.0:1788574450.851154:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361060608:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574450.851159:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574450.851165:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574450.851169:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574450.851177:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361060864/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574450.851189:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574450.851192:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574450.851193:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574450.851196:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2796
00000100:00080000:1.0:1788574450.851198:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574450.851200:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574450.851204:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574450.851216:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361060992/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574450.851226:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1788574450.851232:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788574450.851233:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574450.851238:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574450.851244:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2796
00000100:00080000:1.0:1788574450.851250:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574450.851255:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574450.851261:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574450.851277:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574450/real 1788574450]  req@ffff8dc005dc1500 x1875453361060608/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574475 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574450.851278:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361061120/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574450.851310:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574450.851314:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574450.851315:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788574450.851319:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361060608/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574475 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574450.851320:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2796
00000100:00080000:1.0:1788574450.851326:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574450.851332:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574450.851339:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788574450.851346:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1788574450.851351:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361061248/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574450.851353:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574450.851361:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361060608:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574450.851368:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574450.851385:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574450.851388:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574450.851392:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2796
00000100:00080000:1.0:1788574450.851395:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574450.851402:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788574450.851402:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361060736:192.168.202.140@tcp:38:kworker.0
00000008:00100000:1.0:1788574450.851408:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574450.851421:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361061376/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788574450.851432:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574450.851444:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574450/real 1788574450]  req@ffff8dc005dc0a80 x1875453361060736/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574475 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574450.851454:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361060736/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574475 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574450.851462:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574450.851464:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574450.851466:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361060736:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574450.851470:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361060864:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574450.851483:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574450.851489:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574450/real 1788574450]  req@ffff8dc005dc1180 x1875453361060864/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574475 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574450.851496:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361060864/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574475 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574450.851502:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574450.851504:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574450.851506:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361060864:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574450.851510:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361060992:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574450.851519:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574450.851525:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574450/real 1788574450]  req@ffff8dc005dc3b80 x1875453361060992/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574475 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574450.851532:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361060992/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574475 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574450.851538:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574450.851540:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574450.851541:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361060992:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574450.851545:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361061120:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788574450.851554:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574450.851560:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574450/real 1788574450]  req@ffff8dc005dc0700 x1875453361061120/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574475 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574450.851567:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361061120/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574475 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574450.851572:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574450.851574:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574450.851576:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361061120:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574450.851579:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361061248:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574450.851589:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574450.851594:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574450/real 1788574450]  req@ffff8dc005dc3800 x1875453361061248/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574475 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574450.851605:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361061248/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574475 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574450.851613:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574450.851616:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574450.851619:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361061248:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574450.851639:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361061376:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574450.851662:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574450.851675:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574450/real 1788574450]  req@ffff8dc005dc1c00 x1875453361061376/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574475 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574450.851688:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361061376/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574475 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574450.851696:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574450.851700:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574450.851704:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361061376:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574451.234979:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574451.234987:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574451.234989:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574451.235008:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574451.235019:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574451.235030:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574451.874941:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574452.258946:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574452.258947:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788574452.258988:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574452.259069:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574452.259074:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574452.259133:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574452.898964:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574453.282940:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574453.282940:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574453.282947:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574453.283000:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574453.283087:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574453.283184:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574453.922937:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574454.306963:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574454.306963:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574454.306973:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574454.306986:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574454.306996:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574454.307019:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574454.946972:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574455.330971:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574455.330971:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574455.330971:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574455.330992:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574455.331000:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574455.331006:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574455.970944:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574455.971016:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574455.971023:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788574455.971028:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574455.971038:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2801
00000100:00080000:0.0:1788574455.971049:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574455.971057:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574455.971092:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361061504/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574455.971115:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574455.971118:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574455.971120:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574455.971123:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2801
00000100:00080000:0.0:1788574455.971126:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574455.971128:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574455.971136:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574455.971145:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361061632/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574455.971152:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574455.971155:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574455.971156:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574455.971158:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2801
00000100:00080000:0.0:1788574455.971160:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574455.971162:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574455.971166:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574455.971173:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361061760/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574455.971180:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788574455.971183:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361061504:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788574455.971184:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574455.971187:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574455.971194:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2801
00000100:00080000:0.0:1788574455.971196:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574455.971198:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574455.971201:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574455.971211:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361061888/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574455.971217:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574455.971219:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574455.971220:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574455.971223:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2801
00000100:00080000:0.0:1788574455.971226:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574455.971229:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574455.971231:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788574455.971249:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574455.971252:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361062016/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574455.971259:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574455.971262:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574455.971264:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574455.971267:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2801
00000100:00080000:0.0:1788574455.971270:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574455.971272:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574455.971279:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574455.971292:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361062144/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788574455.971292:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574455/real 1788574455]  req@ffff8dc006713100 x1875453361061504/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574480 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574455.971323:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574455.971326:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574455.971327:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788574455.971331:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361061504/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574480 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574455.971332:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2801
00000100:00080000:0.0:1788574455.971337:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574455.971343:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574455.971350:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788574455.971352:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574455.971358:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574455.971361:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361062272/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788574455.971365:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361061504:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788574455.971377:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361061632:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788574455.971397:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574455.971408:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574455/real 1788574455]  req@ffff8dc006713b80 x1875453361061632/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574480 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574455.971417:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361061632/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574480 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574455.971424:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574455.971426:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574455.971458:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361061632:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574455.971478:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361061760:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574455.971494:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574455.971501:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574455/real 1788574455]  req@ffff8dc006710e00 x1875453361061760/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574480 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574455.971509:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361061760/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574480 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574455.971519:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574455.971522:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574455.971524:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361061760:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574455.971528:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361061888:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574455.971537:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574455.971543:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574455/real 1788574455]  req@ffff8dc006711880 x1875453361061888/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574480 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574455.971550:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361061888/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574480 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574455.971556:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574455.971557:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574455.971559:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361061888:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574455.971563:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361062016:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788574455.971572:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574455.971578:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574455/real 1788574455]  req@ffff8dc006712a00 x1875453361062016/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574480 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574455.971586:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361062016/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574480 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574455.971591:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574455.971593:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574455.971596:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361062016:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574455.971599:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361062144:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574455.971609:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574455.971614:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574455/real 1788574455]  req@ffff8dc006713800 x1875453361062144/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574480 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574455.971621:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361062144/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574480 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574455.971626:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574455.971628:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574455.971630:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361062144:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574455.971633:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361062272:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574455.971643:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574455.971648:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574455/real 1788574455]  req@ffff8dc006712300 x1875453361062272/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574480 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574455.971656:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361062272/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574480 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574455.971661:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574455.971662:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574455.971664:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361062272:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574456.354951:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574456.354951:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574456.354952:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574456.354976:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574456.354991:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574456.354992:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574456.994953:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574457.378975:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574457.378975:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574457.378978:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574457.378998:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574457.379008:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574457.379009:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574458.018917:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574458.402976:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574458.402976:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574458.402985:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574458.403006:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574458.403014:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574458.403020:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574459.042961:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574459.426953:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574459.426967:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574459.426978:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574459.426991:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574459.427000:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574459.427023:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574460.067003:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574460.450977:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574460.450977:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574460.450977:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574460.450998:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574460.451008:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574460.451010:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574461.090995:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788574461.091021:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574461.091029:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788574461.091034:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574461.091046:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2806
00000100:00080000:2.0:1788574461.091057:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574461.091065:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574461.091108:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453361062400/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574461.091134:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574461.091137:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574461.091138:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574461.091141:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2806
00000100:00080000:2.0:1788574461.091144:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574461.091146:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574461.091156:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574461.091166:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453361062528/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574461.091174:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574461.091177:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574461.091178:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574461.091181:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2806
00000100:00080000:2.0:1788574461.091183:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574461.091186:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574461.091189:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574461.091196:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453361062656/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788574461.091203:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361062400:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788574461.091214:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574461.091218:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574461.091220:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574461.091222:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2806
00000100:00080000:2.0:1788574461.091224:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574461.091226:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574461.091229:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574461.091244:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453361062784/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574461.091254:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574461.091257:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574461.091258:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574461.091262:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2806
00000100:00080000:2.0:1788574461.091281:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574461.091283:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574461.091287:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574461.091295:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361062912/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574461.091303:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1788574461.091306:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788574461.091307:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574461.091312:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574461.091315:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2806
00000100:00080000:2.0:1788574461.091318:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574461.091321:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574461.091324:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574461.091333:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361063040/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574461.091340:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574461.091342:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574461.091343:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574461.091345:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2806
00000100:00080000:2.0:1788574461.091348:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574461.091350:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574461.091353:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574461.091360:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361063168/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788574461.091372:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574461/real 1788574461]  req@ffff8dc020494e00 x1875453361062400/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574486 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574461.091398:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453361062400/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574486 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574461.091413:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574461.091418:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574461.091423:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361062400:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788574461.091432:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361062528:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788574461.091461:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574461.091476:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574461/real 1788574461]  req@ffff8dc020497100 x1875453361062528/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574486 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574461.091507:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453361062528/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574486 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574461.091521:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574461.091525:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574461.091529:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361062528:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574461.091562:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361062656:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574461.091592:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574461.091606:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574461/real 1788574461]  req@ffff8dc020496a00 x1875453361062656/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574486 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574461.091621:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453361062656/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574486 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574461.091632:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574461.091636:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574461.091640:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361062656:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574461.091647:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361062784:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574461.091669:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574461.091680:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574461/real 1788574461]  req@ffff8dc020494380 x1875453361062784/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574486 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574461.091693:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453361062784/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574486 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574461.091703:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574461.091707:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574461.091711:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361062784:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574461.091718:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361062912:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788574461.091740:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574461.091753:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574461/real 1788574461]  req@ffff8dc020494700 x1875453361062912/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574486 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574461.091774:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361062912/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574486 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574461.091783:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574461.091786:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574461.091790:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361062912:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574461.091796:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361063040:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574461.091817:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574461.091828:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574461/real 1788574461]  req@ffff8dc020495500 x1875453361063040/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574486 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574461.091841:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361063040/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574486 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574461.091849:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574461.091853:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574461.091857:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361063040:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574461.091863:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361063168:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574461.091917:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574461.091929:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574461/real 1788574461]  req@ffff8dc020495880 x1875453361063168/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574486 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574461.091941:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361063168/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574486 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574461.091957:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574461.091961:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574461.091965:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361063168:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574461.474948:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574461.474956:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574461.474957:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574461.474986:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574461.474993:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574461.474994:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574462.114984:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574462.498975:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574462.498975:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574462.498978:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574462.498999:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574462.499016:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788574462.499044:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574463.138978:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574463.522968:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574463.522970:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574463.522988:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574463.523002:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574463.523015:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574463.523039:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574464.162972:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574464.546939:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574464.546960:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574464.547024:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574464.547048:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574464.547068:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788574464.547139:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574465.186993:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574465.570949:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574465.570960:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574465.571020:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574465.571022:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574465.571038:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574465.571050:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574466.210978:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574466.210987:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:2.0:1788574466.210989:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574466.210992:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574466.211006:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2811
00000100:00080000:1.0:1788574466.211015:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574466.211022:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574466.211057:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361063296/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574466.211092:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574466.211095:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574466.211097:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574466.211100:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2811
00000100:00080000:1.0:1788574466.211102:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574466.211104:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574466.211113:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574466.211126:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361063424/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574466.211134:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574466.211138:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574466.211139:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574466.211142:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2811
00000100:00080000:1.0:1788574466.211145:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574466.211148:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574466.211152:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574466.211156:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361063296:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788574466.211166:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361063552/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574466.211174:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574466.211177:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574466.211178:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574466.211183:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2811
00000100:00080000:1.0:1788574466.211185:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574466.211189:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574466.211192:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574466.211200:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361063680/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574466.211207:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574466.211209:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574466.211211:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574466.211213:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2811
00000100:00080000:1.0:1788574466.211216:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574466.211222:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574466.211227:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574466.211236:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361063808/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574466.211242:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574466.211245:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574466.211247:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1788574466.211256:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788574466.211260:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2811
00000100:00080000:1.0:1788574466.211264:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574466.211267:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574466.211272:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574466.211285:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361063936/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574466.211293:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574466.211296:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574466.211297:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574466.211301:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2811
00000100:00080000:1.0:1788574466.211303:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574466.211308:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574466.211312:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574466.211316:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574466/real 1788574466]  req@ffff8dc005dc2d80 x1875453361063296/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574491 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574466.211324:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361064064/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788574466.211352:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361063296/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574491 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574466.211363:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574466.211367:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574466.211370:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361063296:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788574466.211377:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361063424:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788574466.211396:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574466.211405:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574466/real 1788574466]  req@ffff8dc005dc1c00 x1875453361063424/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574491 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574466.211413:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361063424/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574491 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574466.211421:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574466.211424:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574466.211426:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361063424:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574466.211452:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361063552:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574466.211464:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574466.211471:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574466/real 1788574466]  req@ffff8dc005dc3800 x1875453361063552/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574491 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574466.211478:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361063552/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574491 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574466.211487:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574466.211491:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574466.211494:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361063552:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574466.211502:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361063680:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574466.211523:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574466.211535:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574466/real 1788574466]  req@ffff8dc005dc0700 x1875453361063680/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574491 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574466.211563:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361063680/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574491 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574466.211573:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574466.211575:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574466.211578:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361063680:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574466.211583:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361063808:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788574466.211601:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574466.211609:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574466/real 1788574466]  req@ffff8dc005dc3b80 x1875453361063808/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574491 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574466.211617:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361063808/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574491 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574466.211623:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574466.211625:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574466.211628:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361063808:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574466.211632:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361063936:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574466.211643:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574466.211649:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574466/real 1788574466]  req@ffff8dc005dc1180 x1875453361063936/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574491 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574466.211656:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361063936/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574491 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574466.211661:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574466.211663:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574466.211665:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361063936:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574466.211669:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361064064:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574466.211679:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574466.211685:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574466/real 1788574466]  req@ffff8dc005dc0a80 x1875453361064064/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574491 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574466.211696:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361064064/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574491 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574466.211704:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574466.211707:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574466.211710:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361064064:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574466.595005:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574466.595049:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788574466.595062:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574466.595080:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574466.595094:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574466.595110:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574467.235051:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574467.618998:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574467.619018:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574467.619116:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574467.619196:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574467.619224:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574467.619253:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574468.258948:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574468.643025:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574468.643032:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574468.643041:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574468.643070:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574468.643077:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574468.643094:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574469.282983:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574469.667005:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574469.667005:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574469.667015:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574469.667049:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574469.667050:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788574469.667063:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574470.306973:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574470.691033:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574470.691033:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574470.691036:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574470.691064:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574470.691089:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574470.691093:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00080000:3.0:1788574471.331023:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788574471.331024:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788574471.331038:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788574471.331044:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574471.331057:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2816
00000100:00080000:3.0:1788574471.331069:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574471.331078:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788574471.331117:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ce00 x1875453361064192/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574471.331161:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574471.331166:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574471.331168:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574471.331172:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2816
00000100:00080000:3.0:1788574471.331177:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574471.331183:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574471.331193:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574471.331213:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361064192:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788574471.331215:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644dc00 x1875453361064320/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574471.331230:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574471.331233:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574471.331235:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574471.331240:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2816
00000100:00080000:3.0:1788574471.331244:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574471.331250:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574471.331256:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788574471.331268:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574471.331283:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c000 x1875453361064448/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574471.331295:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574471.331299:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574471.331301:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574471.331306:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2816
00000100:00100000:2.0:1788574471.331308:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574471/real 1788574471]  req@ffff8dc00644ce00 x1875453361064192/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574496 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574471.331312:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574471.331321:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574471.331327:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ce00 x1875453361064192/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574496 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1788574471.331329:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1788574471.331342:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574471.331349:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574471.331351:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f800 x1875453361064576/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574471.331362:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361064192:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788574471.331363:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574471.331371:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574471.331373:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574471.331379:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2816
00000100:00080000:3.0:1788574471.331383:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1788574471.331388:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361064320:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788574471.331390:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574471.331399:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788574471.331409:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574471.331417:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ce00 x1875453361064704/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574471.331423:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574471/real 1788574471]  req@ffff8dc00644dc00 x1875453361064320/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574496 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574471.331445:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574471.331449:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:2.0:1788574471.331451:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644dc00 x1875453361064320/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574496 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574471.331453:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574471.331464:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2816
00000100:00080000:3.0:1788574471.331472:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574471.331478:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574471.331479:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:2.0:1788574471.331486:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000008:00100000:3.0:1788574471.331489:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574471.331493:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361064320:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574471.331506:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ca80 x1875453361064832/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574471.331507:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361064448:192.168.202.140@tcp:8:kworker.0
00000100:00080000:3.0:1788574471.331524:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574471.331528:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574471.331531:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574471.331536:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2816
00000800:00000100:2.0:1788574471.331541:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788574471.331543:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574471.331551:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574471.331557:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574471.331559:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574471/real 1788574471]  req@ffff8dc00644c000 x1875453361064448/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574496 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574471.331573:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ea00 x1875453361064960/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574471.331577:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c000 x1875453361064448/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574496 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574471.331618:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574471.331623:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574471.331627:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361064448:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574471.331636:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361064576:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574471.331668:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574471.331682:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574471/real 1788574471]  req@ffff8dc00644f800 x1875453361064576/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574496 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574471.331695:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f800 x1875453361064576/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574496 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574471.331705:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574471.331709:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574471.331712:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361064576:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574471.331729:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361064704:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574471.331751:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574471.331765:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574471/real 1788574471]  req@ffff8dc00644ce00 x1875453361064704/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574496 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574471.331778:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ce00 x1875453361064704/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574496 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574471.331789:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574471.331792:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574471.331796:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361064704:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574471.331802:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361064832:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574471.331822:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574471.331834:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574471/real 1788574471]  req@ffff8dc00644ca80 x1875453361064832/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574496 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574471.331848:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ca80 x1875453361064832/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574496 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574471.331857:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574471.331860:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574471.331864:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361064832:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574471.331901:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361064960:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574471.331923:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574471.331936:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574471/real 1788574471]  req@ffff8dc00644ea00 x1875453361064960/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574496 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574471.331950:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ea00 x1875453361064960/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574496 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574471.331966:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574471.331970:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574471.331974:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361064960:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574471.714951:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574471.714956:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574471.715016:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574471.715018:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574471.715045:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788574471.715053:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574472.355028:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574472.738996:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574472.738996:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574472.738996:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574472.739034:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574472.739036:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574472.739037:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574473.378967:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574473.762988:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574473.762988:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574473.762998:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574473.763031:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574473.763040:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574473.763061:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574474.403049:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574474.787009:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574474.787010:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574474.787010:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574474.787010:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574474.787048:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574474.787107:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574475.426949:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574475.811001:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574475.811001:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574475.811025:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574475.811035:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574475.811041:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574475.811060:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1788574476.451013:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788574476.451013:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574476.451024:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788574476.451029:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574476.451039:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2822
00000100:00080000:1.0:1788574476.451052:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574476.451060:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574476.451106:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361065088/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574476.451129:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574476.451132:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574476.451133:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574476.451137:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2822
00000100:00080000:1.0:1788574476.451139:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574476.451144:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574476.451155:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574476.451165:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361065088:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788574476.451169:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361065216/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574476.451179:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574476.451182:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574476.451183:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574476.451185:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2822
00000100:00080000:1.0:1788574476.451187:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574476.451191:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574476.451195:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574476.451203:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361065344/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574476.451210:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574476.451213:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574476.451214:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574476.451217:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2822
00000100:00080000:1.0:1788574476.451221:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574476.451223:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574476.451226:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574476.451234:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361065472/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574476.451240:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574476.451243:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574476.451246:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:2.0:1788574476.451247:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788574476.451252:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2822
00000100:00080000:1.0:1788574476.451255:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574476.451258:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574476.451263:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574476.451276:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361065600/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574476.451286:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574476.451290:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574476.451292:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574476.451299:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2822
00000100:00080000:1.0:1788574476.451304:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1788574476.451308:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574476/real 1788574476]  req@ffff8dc005dc1500 x1875453361065088/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574501 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574476.451312:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574476.451322:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574476.451338:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361065728/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574476.451344:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361065088/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574501 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574476.451349:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574476.451356:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574476.451360:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574476.451365:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2822
00000100:00080000:2.0:1788574476.451366:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574476.451371:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574476.451374:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788574476.451378:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574476.451381:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361065088:192.168.202.140@tcp:250:kworker.0
00000008:00100000:1.0:1788574476.451386:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574476.451402:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361065856/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574476.451410:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361065216:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574476.451436:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574476.451449:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574476/real 1788574476]  req@ffff8dc005dc0a80 x1875453361065216/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574501 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574476.451459:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361065216/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574501 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574476.451466:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574476.451469:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574476.451471:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361065216:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574476.451476:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361065344:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574476.451488:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574476.451495:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574476/real 1788574476]  req@ffff8dc005dc1180 x1875453361065344/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574501 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574476.451503:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361065344/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574501 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574476.451510:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574476.451512:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574476.451513:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361065344:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574476.451517:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361065472:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574476.451529:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574476.451535:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574476/real 1788574476]  req@ffff8dc005dc3b80 x1875453361065472/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574501 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574476.451548:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361065472/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574501 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574476.451554:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574476.451556:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574476.451557:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361065472:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574476.451561:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361065600:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574476.451571:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574476.451578:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574476/real 1788574476]  req@ffff8dc005dc0700 x1875453361065600/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574501 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574476.451586:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361065600/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574501 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574476.451592:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574476.451594:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574476.451596:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361065600:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574476.451599:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361065728:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574476.451609:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574476.451615:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574476/real 1788574476]  req@ffff8dc005dc3800 x1875453361065728/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574501 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574476.451622:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361065728/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574501 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574476.451631:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574476.451633:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574476.451635:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361065728:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574476.451648:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361065856:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574476.451688:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574476.451697:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574476/real 1788574476]  req@ffff8dc005dc1c00 x1875453361065856/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574501 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574476.451705:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361065856/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574501 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574476.451711:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574476.451713:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574476.451715:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361065856:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574476.834971:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574476.834971:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574476.834971:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574476.835007:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574476.835011:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574476.835024:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574477.475009:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574477.859014:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574477.859014:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574477.859014:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574477.859054:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574477.859059:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574477.859061:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574478.499029:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574478.882988:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574478.882988:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574478.882989:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574478.882995:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574478.883028:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574478.883075:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574479.522963:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574479.907039:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574479.907040:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574479.907041:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574479.907043:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574479.907092:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574479.907145:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574480.547015:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574480.930973:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574480.930995:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574480.930997:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574480.931027:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574480.931042:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574480.931063:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574481.571001:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574481.571023:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574481.571038:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788574481.571044:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574481.571056:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2827
00000100:00080000:1.0:1788574481.571070:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574481.571078:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574481.571121:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361065984/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574481.571147:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574481.571151:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574481.571153:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574481.571157:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2827
00000100:00080000:1.0:1788574481.571160:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574481.571165:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574481.571177:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574481.571193:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361066112/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574481.571203:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361065984:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574481.571229:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574481.571233:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574481.571234:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574481.571241:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2827
00000100:00080000:1.0:1788574481.571245:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574481.571248:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574481.571253:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574481.571265:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361066240/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574481.571274:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574481.571278:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574481.571279:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574481.571288:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2827
00000800:00000100:2.0:1788574481.571291:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788574481.571303:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574481.571308:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574481.571314:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574481.571326:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361066368/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574481.571334:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788574481.571336:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574481/real 1788574481]  req@ffff8dc005dc2d80 x1875453361065984/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574506 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574481.571338:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574481.571343:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574481.571359:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2827
00000100:00080000:1.0:1788574481.571368:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574481.571374:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574481.571379:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574481.571382:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361065984/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574506 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574481.571393:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1788574481.571398:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361066496/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574481.571401:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574481.571415:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361065984:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574481.571429:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574481.571433:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574481.571436:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574481.571442:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2827
00000100:00080000:1.0:1788574481.571444:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574481.571446:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574481.571452:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574481.571459:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361066112:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574481.571471:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361066624/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574481.571483:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574481.571486:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574481.571488:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574481.571492:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2827
00000100:00080000:1.0:1788574481.571500:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1788574481.571501:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788574481.571508:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574481.571513:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574481.571526:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361066752/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574481.571540:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574481/real 1788574481]  req@ffff8dc005dc1c00 x1875453361066112/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574506 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574481.571564:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361066112/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574506 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574481.571583:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574481.571588:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574481.571593:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361066112:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574481.571603:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361066240:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574481.571631:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574481.571646:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574481/real 1788574481]  req@ffff8dc005dc3800 x1875453361066240/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574506 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574481.571660:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361066240/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574506 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574481.571678:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574481.571682:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574481.571686:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361066240:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574481.571693:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361066368:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574481.571734:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574481.571747:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574481/real 1788574481]  req@ffff8dc005dc0700 x1875453361066368/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574506 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574481.571759:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361066368/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574506 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574481.571769:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574481.571772:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574481.571775:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361066368:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574481.571782:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361066496:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574481.571800:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574481.571809:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574481/real 1788574481]  req@ffff8dc005dc3b80 x1875453361066496/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574506 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574481.571822:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361066496/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574506 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574481.571831:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574481.571834:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574481.571838:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361066496:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574481.571858:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361066624:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574481.571915:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574481.571932:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574481/real 1788574481]  req@ffff8dc005dc1180 x1875453361066624/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574506 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574481.571945:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361066624/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574506 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574481.571953:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574481.571955:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574481.571959:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361066624:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574481.571965:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361066752:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574481.571985:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574481.571997:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574481/real 1788574481]  req@ffff8dc005dc0a80 x1875453361066752/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574506 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574481.572011:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361066752/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574506 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574481.572019:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574481.572023:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574481.572026:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361066752:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574481.954977:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574481.954981:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574481.954985:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574481.955052:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574481.955053:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574481.955066:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574482.594970:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574482.978942:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574482.978959:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788574482.979003:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574482.979012:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574482.979016:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574482.979027:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574483.618948:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574484.002968:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574484.002968:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574484.002969:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574484.002969:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574484.003002:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574484.003050:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574484.642991:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574485.026959:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574485.026959:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574485.026960:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574485.026964:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574485.026994:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788574485.027046:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574485.666948:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574486.050982:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574486.050982:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574486.050982:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574486.050982:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574486.051015:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574486.051049:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574486.690962:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788574486.690975:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574486.690981:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788574486.690985:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574486.690993:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2832
00000100:00080000:2.0:1788574486.691003:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574486.691009:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574486.691043:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453361066880/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574486.691067:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574486.691070:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574486.691071:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574486.691074:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2832
00000100:00080000:2.0:1788574486.691076:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574486.691079:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574486.691088:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574486.691104:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361066880:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788574486.691105:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361067008/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574486.691123:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574486.691126:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574486.691129:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574486.691133:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2832
00000100:00080000:2.0:1788574486.691136:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574486.691139:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574486.691145:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574486.691158:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361067136/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574486.691169:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574486.691173:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574486.691175:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574486.691179:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2832
00000100:00080000:2.0:1788574486.691183:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574486.691188:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574486.691194:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574486.691207:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453361067264/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788574486.691213:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361067008:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788574486.691226:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574486.691230:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574486.691233:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574486.691239:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2832
00000100:00080000:2.0:1788574486.691252:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788574486.691257:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361067136:192.168.202.140@tcp:8:kworker.0
00000100:00080000:2.0:1788574486.691263:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574486.691268:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574486.691281:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453361067392/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574486.691291:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788574486.691294:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361067264:192.168.202.140@tcp:8:kworker.0
00000100:00080000:2.0:1788574486.691296:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574486.691300:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574486.691305:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2832
00000100:00080000:2.0:1788574486.691309:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574486.691313:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574486.691318:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574486.691321:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361067392:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574486.691332:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361067520/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574486.691343:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788574486.691348:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361067520:192.168.202.140@tcp:8:kworker.0
00000100:00080000:2.0:1788574486.691357:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574486.691360:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574486.691365:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2832
00000100:00080000:2.0:1788574486.691370:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574486.691375:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574486.691381:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574486.691394:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361067648/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788574486.691444:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361067648:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574487.074961:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574487.074961:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574487.074961:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574487.074963:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574487.074996:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788574487.075049:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574487.714955:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574488.098973:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574488.098973:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574488.098973:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574488.098973:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574488.099009:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574488.099051:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574488.738956:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574489.122962:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574489.122968:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574489.122972:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574489.122998:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574489.122999:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574489.123011:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574489.762973:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000400:00000100:1.0:1788574489.763101:0:2337:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.140:988
00000400:00000100:1.0:1788574489.763131:0:2337:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.140@tcp at host 192.168.202.140 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:1.0:1788574489.763144:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788574489.763176:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788574489.763181:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788574489.763188:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788574489.763199:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788574489.763208:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788574489.763220:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:3.0:1788574489.763229:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574486/real 1788574489]  req@ffff8dc020494a80 x1875453361067392/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574511 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574489.763254:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453361067392/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574511 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574489.763274:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574489.763278:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574489.763283:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361067392:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574489.763292:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574486/real 1788574489]  req@ffff8dc020497480 x1875453361067264/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574511 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574489.763312:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453361067264/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574511 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574489.763321:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574489.763325:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574489.763328:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361067264:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574489.763334:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574486/real 1788574489]  req@ffff8dc020494000 x1875453361067008/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574511 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574489.763346:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361067008/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574511 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574489.763356:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574489.763360:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574489.763364:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361067008:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574489.763371:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574486/real 1788574489]  req@ffff8dc020495180 x1875453361067136/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574511 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574489.763384:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361067136/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574511 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574489.763394:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574489.763398:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574489.763402:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361067136:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574489.763409:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574486/real 1788574489]  req@ffff8dc020496d80 x1875453361066880/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574511 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574489.763421:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453361066880/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574511 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574489.763428:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574489.763431:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574489.763434:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361066880:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788574489.763465:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574486/real 1788574489]  req@ffff8dc020495500 x1875453361067648/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574511 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574489.763479:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361067648/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574511 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574489.763487:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574489.763491:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574489.763495:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361067648:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574489.763502:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574486/real 1788574489]  req@ffff8dc020495880 x1875453361067520/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574511 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574489.763514:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361067520/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574511 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574489.763521:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574489.763525:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574489.763528:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361067520:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574490.146975:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574490.146975:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574490.146975:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574490.147005:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574490.147014:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574490.147014:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574490.786965:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574491.170969:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574491.170974:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574491.171004:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574491.171018:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574491.171018:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574491.171088:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1788574491.810997:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788574491.811001:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788574491.811006:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788574491.811013:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574491.811026:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2837
00000100:00080000:2.0:1788574491.811036:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574491.811044:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574491.811076:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361067776/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574491.811100:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574491.811103:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574491.811104:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574491.811107:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2837
00000100:00080000:2.0:1788574491.811110:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574491.811113:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574491.811121:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574491.811132:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453361067904/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788574491.811140:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361067776:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788574491.811145:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574491.811152:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574491.811153:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574491.811156:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2837
00000100:00080000:2.0:1788574491.811158:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574491.811161:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574491.811166:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574491.811178:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453361068032/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574491.811185:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574491.811187:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574491.811188:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574491.811190:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2837
00000100:00080000:2.0:1788574491.811193:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574491.811195:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574491.811198:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574491.811207:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453361068160/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574491.811216:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574491.811219:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574491.811220:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574491.811223:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2837
00000100:00080000:2.0:1788574491.811231:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574491.811235:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574491.811241:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788574491.811255:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574491.811258:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453361068288/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574491.811272:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574491.811275:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574491.811278:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574491.811283:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2837
00000100:00080000:2.0:1788574491.811288:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574491.811293:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574491.811299:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574491.811315:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361068416/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788574491.811323:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574491/real 1788574491]  req@ffff8dc020494700 x1875453361067776/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574516 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574491.811335:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574491.811345:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574491.811347:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574491.811352:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2837
00000100:00080000:2.0:1788574491.811356:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574491.811363:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574491.811372:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574491.811379:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361067776/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574516 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574491.811392:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361068544/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574491.811397:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574491.811417:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574491.811427:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361067776:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788574491.811471:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361067904:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788574491.811503:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574491.811520:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574491/real 1788574491]  req@ffff8dc020494380 x1875453361067904/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574516 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574491.811534:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453361067904/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574516 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574491.811548:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574491.811552:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574491.811556:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361067904:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574491.811564:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361068032:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574491.811595:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574491.811608:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574491/real 1788574491]  req@ffff8dc020496a00 x1875453361068032/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574516 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574491.811621:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453361068032/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574516 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574491.811631:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574491.811634:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574491.811637:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361068032:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574491.811645:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361068160:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574491.811668:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574491.811681:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574491/real 1788574491]  req@ffff8dc020497100 x1875453361068160/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574516 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574491.811692:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453361068160/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574516 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574491.811700:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574491.811704:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574491.811708:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361068160:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574491.811715:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361068288:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788574491.811738:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574491.811751:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574491/real 1788574491]  req@ffff8dc020494e00 x1875453361068288/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574516 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574491.811762:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453361068288/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574516 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574491.811772:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574491.811776:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574491.811780:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361068288:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574491.811787:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361068416:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574491.811810:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574491.811857:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574491/real 1788574491]  req@ffff8dc020495880 x1875453361068416/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574516 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574491.811912:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361068416/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574516 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574491.811921:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574491.811925:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574491.811928:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361068416:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574491.811935:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361068544:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574491.811961:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574491.811976:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574491/real 1788574491]  req@ffff8dc020495500 x1875453361068544/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574516 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574491.811990:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361068544/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574516 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574491.811998:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574491.812001:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574491.812005:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361068544:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574492.195035:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574492.195040:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574492.195040:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574492.195046:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574492.195100:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574492.195144:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574492.834995:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574493.218968:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574493.218968:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574493.218973:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574493.219016:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574493.219019:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574493.219100:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574493.858972:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574494.242943:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574494.242952:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574494.242954:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574494.242959:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574494.242988:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574494.243015:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574494.882941:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574495.266956:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574495.266956:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574495.266961:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574495.266962:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574495.266990:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574495.267022:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574495.906982:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574496.290966:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574496.290966:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574496.290984:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574496.291023:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574496.291052:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788574496.291079:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574496.930994:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788574496.931000:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574496.931012:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788574496.931017:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574496.931028:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2842
00000100:00080000:3.0:1788574496.931040:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574496.931048:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788574496.931089:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d500 x1875453361068672/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574496.931118:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574496.931122:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574496.931124:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574496.931129:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2842
00000100:00080000:3.0:1788574496.931134:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574496.931138:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574496.931147:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574496.931153:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361068672:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788574496.931161:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c380 x1875453361068800/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574496.931170:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574496.931172:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574496.931173:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574496.931176:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2842
00000100:00080000:3.0:1788574496.931178:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574496.931181:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574496.931184:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574496.931192:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f480 x1875453361068928/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574496.931198:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574496.931201:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574496.931202:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574496.931205:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2842
00000100:00080000:3.0:1788574496.931207:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574496.931209:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574496.931212:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788574496.931217:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574496.931223:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d180 x1875453361069056/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574496.931235:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574496.931239:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574496.931241:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574496.931246:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2842
00000100:00080000:3.0:1788574496.931250:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574496.931254:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574496.931260:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574496.931268:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574496/real 1788574496]  req@ffff8dc00644d500 x1875453361068672/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574521 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574496.931276:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e680 x1875453361069184/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574496.931288:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d500 x1875453361068672/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574521 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574496.931288:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574496.931297:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574496.931302:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574496.931305:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574496.931309:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2842
00000100:00080000:2.0:1788574496.931313:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788574496.931315:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1788574496.931318:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361068672:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788574496.931324:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574496.931329:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574496.931338:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c700 x1875453361069312/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574496.931343:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361068800:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788574496.931351:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574496.931355:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574496.931356:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574496.931360:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2842
00000100:00080000:3.0:1788574496.931365:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574496.931370:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:2.0:1788574496.931371:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:3.0:1788574496.931376:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574496.931386:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574496/real 1788574496]  req@ffff8dc00644c380 x1875453361068800/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574521 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574496.931387:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e300 x1875453361069440/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574496.931425:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453361068800/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574521 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574496.931434:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574496.931437:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574496.931440:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361068800:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574496.931445:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361068928:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574496.931473:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574496.931487:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574496/real 1788574496]  req@ffff8dc00644f480 x1875453361068928/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574521 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574496.931501:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453361068928/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574521 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574496.931517:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574496.931521:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574496.931524:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361068928:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574496.931531:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361069056:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574496.931553:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574496.931563:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574496/real 1788574496]  req@ffff8dc00644d180 x1875453361069056/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574521 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574496.931571:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453361069056/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574521 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574496.931586:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574496.931588:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574496.931591:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361069056:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574496.931595:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361069184:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574496.931609:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574496.931626:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574496/real 1788574496]  req@ffff8dc00644e680 x1875453361069184/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574521 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574496.931634:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453361069184/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574521 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574496.931640:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574496.931641:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574496.931644:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361069184:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574496.931657:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361069312:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574496.931670:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574496.931677:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574496/real 1788574496]  req@ffff8dc00644c700 x1875453361069312/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574521 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574496.931685:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453361069312/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574521 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574496.931690:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574496.931691:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574496.931693:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361069312:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574496.931697:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361069440:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574496.931707:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574496.931713:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574496/real 1788574496]  req@ffff8dc00644e300 x1875453361069440/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574521 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574496.931720:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453361069440/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574521 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574496.931725:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574496.931727:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574496.931729:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361069440:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574497.315014:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574497.315014:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574497.315030:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574497.315054:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574497.315063:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574497.315078:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574497.955043:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574498.338993:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574498.339003:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574498.339011:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574498.339044:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574498.339056:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788574498.339100:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574498.978977:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574499.363037:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574499.363037:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574499.363052:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574499.363085:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574499.363087:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574499.363095:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574500.002959:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574500.386955:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574500.386957:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574500.386964:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574500.386987:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574500.387001:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788574500.387015:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574501.026996:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574501.411036:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574501.411041:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574501.411041:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574501.411078:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574501.411084:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574501.411086:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574502.050990:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574502.051018:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574502.051023:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788574502.051026:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574502.051034:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2847
00000100:00080000:0.0:1788574502.051042:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574502.051048:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574502.051079:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361069568/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574502.051101:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574502.051104:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574502.051105:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574502.051108:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2847
00000100:00080000:0.0:1788574502.051110:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574502.051112:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574502.051120:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574502.051129:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361069696/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574502.051136:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574502.051139:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574502.051140:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574502.051142:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2847
00000100:00080000:0.0:1788574502.051144:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574502.051146:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574502.051151:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574502.051154:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361069568:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788574502.051160:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453361069824/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574502.051168:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574502.051171:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574502.051172:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574502.051174:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2847
00000100:00080000:0.0:1788574502.051176:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574502.051179:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574502.051181:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574502.051190:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361069952/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574502.051196:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574502.051198:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574502.051199:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574502.051202:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2847
00000100:00080000:0.0:1788574502.051204:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574502.051207:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574502.051210:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574502.051218:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361070080/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788574502.051227:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788574502.051228:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574502.051234:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574502.051236:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574502.051239:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2847
00000100:00080000:0.0:1788574502.051243:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574502.051246:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574502.051249:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574502.051256:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361070208/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574502.051261:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574502.051263:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574502.051265:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574502.051268:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2847
00000100:00080000:0.0:1788574502.051271:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574502.051273:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574502.051277:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574502.051282:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574502/real 1788574502]  req@ffff8dc006713480 x1875453361069568/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574527 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574502.051287:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361070336/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574502.051327:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361069568/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574527 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574502.051340:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574502.051344:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574502.051349:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361069568:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788574502.051357:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361069696:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574502.051382:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574502.051396:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574502/real 1788574502]  req@ffff8dc006712680 x1875453361069696/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574527 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574502.051409:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361069696/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574527 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574502.051420:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574502.051424:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574502.051428:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361069696:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574502.051453:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361069824:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574502.051474:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574502.051487:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574502/real 1788574502]  req@ffff8dc006710380 x1875453361069824/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574527 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574502.051500:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453361069824/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574527 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574502.051510:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574502.051514:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574502.051517:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361069824:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574502.051524:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361069952:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574502.051543:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574502.051554:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574502/real 1788574502]  req@ffff8dc006711c00 x1875453361069952/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574527 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574502.051567:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361069952/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574527 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574502.051577:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574502.051580:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574502.051584:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361069952:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574502.051591:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361070080:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574502.051610:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574502.051622:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574502/real 1788574502]  req@ffff8dc006711500 x1875453361070080/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574527 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574502.051635:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361070080/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574527 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574502.051645:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574502.051648:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574502.051652:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361070080:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574502.051659:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361070208:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574502.051681:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574502.051693:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574502/real 1788574502]  req@ffff8dc006712300 x1875453361070208/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574527 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574502.051707:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361070208/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574527 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574502.051725:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574502.051729:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574502.051732:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361070208:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574502.051739:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361070336:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574502.051755:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574502.051764:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574502/real 1788574502]  req@ffff8dc006713800 x1875453361070336/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574527 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574502.051771:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361070336/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574527 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574502.051777:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574502.051779:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574502.051781:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361070336:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574502.434959:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574502.434959:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574502.434960:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574502.434973:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574502.434991:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788574502.435064:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574503.075052:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574503.458975:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574503.458975:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574503.458975:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574503.458979:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574503.459010:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574503.459056:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574504.099047:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574504.482993:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574504.482997:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574504.483032:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574504.483056:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574504.483063:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788574504.483131:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574505.123005:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574505.506991:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574505.506993:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574505.506995:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574505.507019:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574505.507052:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574505.507109:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574506.146982:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574506.531004:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574506.531004:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574506.531004:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574506.531052:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574506.531064:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788574506.531173:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574507.170971:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574507.170973:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574507.170982:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788574507.170987:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574507.170997:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2852
00000100:00080000:1.0:1788574507.171008:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574507.171016:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574507.171058:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361070464/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574507.171087:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574507.171091:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574507.171093:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574507.171098:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2852
00000100:00080000:1.0:1788574507.171103:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574507.171108:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574507.171118:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574507.171135:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361070592/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574507.171139:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361070464:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574507.171156:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574507.171161:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574507.171163:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574507.171168:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2852
00000100:00080000:1.0:1788574507.171173:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574507.171177:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574507.171183:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574507.171197:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361070720/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788574507.171202:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788574507.171213:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574507.171217:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574507.171220:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574507.171225:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2852
00000100:00080000:1.0:1788574507.171230:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574507.171235:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574507.171241:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574507.171242:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574507/real 1788574507]  req@ffff8dc005dc1500 x1875453361070464/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574532 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574507.171258:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361070848/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574507.171262:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361070464/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574532 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574507.171271:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574507.171279:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574507.171284:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361070464:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574507.171286:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574507.171292:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574507.171294:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574507.171299:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2852
00000100:00080000:1.0:1788574507.171304:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574507.171309:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574507.171313:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361070592:192.168.202.140@tcp:38:kworker.0
00000008:00100000:1.0:1788574507.171315:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574507.171332:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361070976/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788574507.171338:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788574507.171351:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788574507.171354:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574507/real 1788574507]  req@ffff8dc005dc0a80 x1875453361070592/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574532 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574507.171358:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574507.171362:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574507.171371:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2852
00000100:00100000:2.0:1788574507.171372:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361070592/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574532 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574507.171375:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574507.171381:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574507.171389:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1788574507.171392:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574507.171397:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574507.171400:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361070592:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574507.171405:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361071104/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574507.171412:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361070720:192.168.202.140@tcp:8:kworker.0
00000100:00080000:1.0:1788574507.171419:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574507.171423:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574507.171426:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574507.171430:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2852
00000100:00080000:1.0:1788574507.171435:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574507.171439:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:2.0:1788574507.171445:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:1.0:1788574507.171446:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574507.171460:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361071232/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574507.171462:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574507/real 1788574507]  req@ffff8dc005dc1180 x1875453361070720/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574532 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574507.171492:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361070720/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574532 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574507.171498:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574507.171501:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574507.171504:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361070720:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574507.171509:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361070848:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574507.171530:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574507.171543:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574507/real 1788574507]  req@ffff8dc005dc3b80 x1875453361070848/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574532 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574507.171556:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361070848/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574532 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574507.171570:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574507.171573:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574507.171577:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361070848:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574507.171594:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361070976:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574507.171617:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574507.171630:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574507/real 1788574507]  req@ffff8dc005dc0700 x1875453361070976/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574532 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574507.171638:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361070976/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574532 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574507.171644:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574507.171646:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574507.171648:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361070976:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574507.171653:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361071104:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574507.171666:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574507.171672:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574507/real 1788574507]  req@ffff8dc005dc3800 x1875453361071104/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574532 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574507.171679:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361071104/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574532 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574507.171684:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574507.171686:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574507.171689:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361071104:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574507.171692:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361071232:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574507.171702:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574507.171708:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574507/real 1788574507]  req@ffff8dc005dc1c00 x1875453361071232/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574532 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574507.171715:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361071232/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574532 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574507.171720:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574507.171722:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574507.171723:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361071232:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574507.554968:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574507.554972:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574507.554993:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574507.555007:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574507.555016:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574507.555059:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574508.194973:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574508.578967:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574508.578970:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574508.578971:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574508.578972:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574508.578999:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788574508.579054:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574509.219001:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574509.603027:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574509.603027:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574509.603029:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574509.603058:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574509.603066:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574509.603066:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574510.242952:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574510.626964:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574510.626965:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574510.626972:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574510.626993:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574510.626999:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788574510.627007:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574511.267045:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574511.651026:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574511.651026:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574511.651053:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574511.651073:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574511.651094:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574511.651128:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574512.290995:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788574512.290999:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574512.291009:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788574512.291013:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574512.291025:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2857
00000100:00080000:1.0:1788574512.291037:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574512.291052:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574512.291098:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361071360/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574512.291127:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574512.291130:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574512.291132:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574512.291136:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2857
00000100:00080000:1.0:1788574512.291138:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574512.291141:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574512.291152:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574512.291163:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361071488/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574512.291172:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574512.291175:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574512.291177:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574512.291183:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2857
00000100:00080000:1.0:1788574512.291186:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1788574512.291188:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361071360:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574512.291189:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574512.291195:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574512.291211:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361071616/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574512.291219:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574512.291222:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574512.291223:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574512.291228:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2857
00000100:00080000:1.0:1788574512.291231:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574512.291233:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574512.291236:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574512.291247:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361071744/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574512.291253:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574512.291256:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574512.291257:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574512.291260:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2857
00000100:00080000:1.0:1788574512.291269:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574512.291271:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574512.291275:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788574512.291281:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574512.291286:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361071872/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574512.291295:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574512.291298:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574512.291300:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574512.291305:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2857
00000100:00080000:1.0:1788574512.291313:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574512.291316:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574512.291318:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574512.291326:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361072000/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574512.291333:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574512.291336:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574512.291337:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574512.291341:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2857
00000100:00080000:1.0:1788574512.291348:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1788574512.291349:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574512/real 1788574512]  req@ffff8dc005dc2d80 x1875453361071360/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574537 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574512.291353:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574512.291360:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574512.291376:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361072128/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574512.291432:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361071360/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574537 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574512.291444:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574512.291449:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574512.291453:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361071360:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788574512.291478:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361071488:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574512.291501:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574512.291511:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574512/real 1788574512]  req@ffff8dc005dc1c00 x1875453361071488/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574537 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574512.291529:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361071488/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574537 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574512.291536:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574512.291539:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574512.291541:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361071488:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574512.291546:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361071616:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574512.291560:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574512.291568:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574512/real 1788574512]  req@ffff8dc005dc3800 x1875453361071616/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574537 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574512.291575:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361071616/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574537 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574512.291585:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574512.291587:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574512.291589:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361071616:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574512.291593:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361071744:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574512.291604:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574512.291610:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574512/real 1788574512]  req@ffff8dc005dc0700 x1875453361071744/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574537 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574512.291622:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361071744/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574537 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574512.291632:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574512.291635:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574512.291638:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361071744:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574512.291645:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361071872:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574512.291668:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574512.291681:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574512/real 1788574512]  req@ffff8dc005dc3b80 x1875453361071872/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574537 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574512.291694:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361071872/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574537 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574512.291704:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574512.291707:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574512.291711:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361071872:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574512.291718:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361072000:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574512.291738:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574512.291747:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574512/real 1788574512]  req@ffff8dc005dc1180 x1875453361072000/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574537 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574512.291754:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361072000/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574537 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574512.291760:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574512.291762:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574512.291764:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361072000:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574512.291768:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361072128:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574512.291789:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574512.291797:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574512/real 1788574512]  req@ffff8dc005dc0a80 x1875453361072128/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574537 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574512.291804:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361072128/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574537 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574512.291809:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574512.291812:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574512.291814:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361072128:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574512.674935:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574512.674962:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574512.674969:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574512.674991:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574512.674994:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574512.675009:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574513.314994:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574513.698982:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574513.698983:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574513.699000:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574513.699009:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574513.699025:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574513.699026:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574514.338977:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574514.722925:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574514.722966:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574514.722974:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574514.722986:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574514.722990:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574514.723035:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574515.362965:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574515.746984:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574515.746984:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574515.747014:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574515.747099:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574515.747111:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574515.747129:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574516.387015:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574516.771000:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574516.771000:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574516.771000:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574516.771029:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574516.771035:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574516.771036:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574517.410978:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574517.410981:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574517.410990:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788574517.410994:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574517.411004:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2863
00000100:00080000:0.0:1788574517.411015:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574517.411022:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574517.411057:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361072256/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574517.411086:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574517.411092:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574517.411095:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574517.411099:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2863
00000100:00080000:0.0:1788574517.411103:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574517.411108:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574517.411119:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574517.411123:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361072256:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788574517.411134:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361072384/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574517.411146:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574517.411149:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574517.411152:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574517.411156:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2863
00000100:00080000:0.0:1788574517.411159:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574517.411163:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574517.411169:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574517.411181:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361072512/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788574517.411186:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788574517.411192:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574517.411195:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574517.411197:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574517.411200:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2863
00000100:00080000:0.0:1788574517.411205:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574517.411208:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574517.411213:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574517.411222:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361072640/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574517.411224:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574517/real 1788574517]  req@ffff8dc006712a00 x1875453361072256/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574542 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574517.411233:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574517.411236:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574517.411237:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574517.411241:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2863
00000100:00100000:1.0:1788574517.411242:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361072256/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574542 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574517.411245:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574517.411249:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574517.411253:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1788574517.411253:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574517.411258:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574517.411262:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361072256:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788574517.411263:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361072768/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574517.411271:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574517.411274:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574517.411276:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574517.411280:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2863
00000100:00080000:0.0:1788574517.411283:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574517.411286:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574517.411290:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361072384:192.168.202.140@tcp:38:kworker.0
00000008:00100000:0.0:1788574517.411291:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574517.411302:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361072896/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574517.411312:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1788574517.411315:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788574517.411316:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574517.411318:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574517.411322:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2863
00000100:00080000:0.0:1788574517.411325:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788574517.411327:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574517/real 1788574517]  req@ffff8dc006711880 x1875453361072384/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574542 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574517.411328:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574517.411333:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574517.411341:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361072384/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574542 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574517.411342:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361073024/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574517.411352:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574517.411356:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574517.411359:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361072384:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574517.411366:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361072512:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574517.411388:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574517.411400:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574517/real 1788574517]  req@ffff8dc006710e00 x1875453361072512/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574542 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574517.411413:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361072512/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574542 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574517.411422:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574517.411426:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574517.411429:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361072512:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574517.411435:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361072640:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574517.411457:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574517.411470:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574517/real 1788574517]  req@ffff8dc006713b80 x1875453361072640/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574542 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574517.411493:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361072640/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574542 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574517.411505:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574517.411508:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574517.411512:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361072640:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574517.411520:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361072768:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574517.411542:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574517.411556:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574517/real 1788574517]  req@ffff8dc006713100 x1875453361072768/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574542 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574517.411571:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361072768/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574542 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574517.411582:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574517.411586:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574517.411590:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361072768:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574517.411618:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361072896:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574517.411642:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574517.411657:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574517/real 1788574517]  req@ffff8dc006712a00 x1875453361072896/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574542 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574517.411671:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361072896/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574542 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574517.411687:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574517.411690:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574517.411694:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361072896:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574517.411700:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361073024:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574517.411718:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574517.411730:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574517/real 1788574517]  req@ffff8dc006713800 x1875453361073024/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574542 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574517.411742:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361073024/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574542 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574517.411750:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574517.411753:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574517.411757:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361073024:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574517.794952:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574517.794955:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574517.794960:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574517.794993:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574517.795011:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788574517.795016:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574518.435040:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574518.818970:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574518.818998:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574518.819026:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574518.819032:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574518.819040:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574518.819045:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574519.459006:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574519.842968:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574519.842968:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574519.842976:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574519.843023:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574519.843087:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788574519.843166:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574520.482964:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574520.867010:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574520.867018:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574520.867048:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574520.867067:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574520.867077:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574520.867120:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574521.506972:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574521.891019:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574521.891024:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574521.891026:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574521.891039:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574521.891063:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788574521.891131:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1788574522.530952:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788574522.530969:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574522.530987:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788574522.530993:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574522.531022:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2868
00000100:00080000:0.0:1788574522.531037:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574522.531047:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574522.531102:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361073152/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574522.531133:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574522.531138:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574522.531140:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574522.531146:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2868
00000100:00080000:0.0:1788574522.531153:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574522.531159:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574522.531172:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574522.531189:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361073152:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788574522.531194:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361073280/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574522.531209:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574522.531213:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574522.531216:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574522.531220:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2868
00000100:00080000:0.0:1788574522.531225:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574522.531230:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574522.531236:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574522.531251:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361073408/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574522.531270:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574522.531273:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574522.531275:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574522.531278:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2868
00000100:00080000:0.0:1788574522.531281:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574522.531283:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574522.531287:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1788574522.531293:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574522.531298:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453361073536/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574522.531308:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574522.531312:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574522.531315:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574522.531320:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2868
00000100:00080000:0.0:1788574522.531325:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574522.531329:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574522.531334:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574522.531350:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361073664/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574522.531355:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574522/real 1788574522]  req@ffff8dc006712300 x1875453361073152/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574547 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574522.531367:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574522.531376:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574522.531378:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574522.531385:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2868
00000100:00100000:1.0:1788574522.531391:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361073152/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574547 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574522.531392:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574522.531403:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574522.531414:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1788574522.531415:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574522.531424:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574522.531431:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361073792/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574522.531432:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361073152:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788574522.531450:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574522.531454:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574522.531456:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574522.531461:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2868
00000100:00080000:0.0:1788574522.531467:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788574522.531472:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361073280:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788574522.531476:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574522.531485:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574522.531501:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361073920/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788574522.531512:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574522.531533:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574522/real 1788574522]  req@ffff8dc006711500 x1875453361073280/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574547 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574522.531549:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361073280/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574547 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574522.531561:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574522.531565:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574522.531568:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361073280:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574522.531576:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361073408:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574522.531601:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574522.531626:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574522/real 1788574522]  req@ffff8dc006711c00 x1875453361073408/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574547 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574522.531641:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361073408/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574547 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574522.531663:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574522.531667:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574522.531670:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361073408:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574522.531676:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361073536:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574522.531697:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574522.531709:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574522/real 1788574522]  req@ffff8dc006710380 x1875453361073536/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574547 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574522.531720:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453361073536/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574547 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574522.531729:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574522.531732:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574522.531736:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361073536:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574522.531742:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361073664:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574522.531762:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574522.531773:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574522/real 1788574522]  req@ffff8dc006712680 x1875453361073664/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574547 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574522.531786:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361073664/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574547 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574522.531796:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574522.531799:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574522.531804:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361073664:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574522.531810:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361073792:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574522.531827:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574522.531837:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574522/real 1788574522]  req@ffff8dc006713480 x1875453361073792/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574547 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574522.531849:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361073792/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574547 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574522.531857:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574522.531860:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574522.531864:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361073792:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574522.531906:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361073920:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574522.531925:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574522.531936:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574522/real 1788574522]  req@ffff8dc006712300 x1875453361073920/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574547 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574522.531949:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361073920/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574547 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574522.531958:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574522.531961:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574522.531965:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361073920:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574522.914977:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574522.915011:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574522.915023:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574522.915024:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574522.915070:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574522.915100:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574523.554990:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574523.938954:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574523.938955:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574523.938962:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788574523.938985:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574523.938989:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574523.939020:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574524.578953:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574524.963043:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574524.963043:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574524.963043:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574524.963084:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574524.963089:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788574524.963128:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574525.603009:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574525.987037:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574525.987047:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574525.987048:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574525.987103:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574525.987104:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574525.987105:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574526.626954:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574527.010951:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574527.010987:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574527.011001:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788574527.011047:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574527.011048:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574527.011063:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00080000:2.0:1788574527.651035:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788574527.651044:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788574527.651049:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788574527.651055:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574527.651067:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2873
00000100:00080000:2.0:1788574527.651080:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574527.651096:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574527.651141:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453361074048/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574527.651167:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574527.651171:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574527.651177:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574527.651182:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2873
00000100:00080000:2.0:1788574527.651186:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574527.651190:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574527.651204:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574527.651220:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361074048:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788574527.651222:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361074176/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574527.651236:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574527.651239:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574527.651241:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574527.651244:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2873
00000100:00080000:2.0:1788574527.651247:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574527.651250:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574527.651256:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574527.651271:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361074304/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574527.651281:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574527.651286:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574527.651289:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574527.651293:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2873
00000800:00000100:1.0:1788574527.651298:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788574527.651300:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574527.651308:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574527.651314:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574527.651325:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453361074432/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574527.651333:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574527.651336:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574527.651337:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574527.651341:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2873
00000100:00080000:2.0:1788574527.651344:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574527.651348:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574527.651352:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574527/real 1788574527]  req@ffff8dc020496d80 x1875453361074048/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574552 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1788574527.651354:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574527.651367:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453361074560/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574527.651374:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788574527.651379:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453361074048/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574552 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574527.651379:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574527.651384:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574527.651392:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2873
00000100:00080000:2.0:1788574527.651396:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574527.651398:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574527.651399:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574527.651407:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1788574527.651409:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574527.651416:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361074048:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788574527.651422:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361074688/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574527.651430:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574527.651432:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574527.651434:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574527.651436:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2873
00000100:00080000:2.0:1788574527.651439:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788574527.651442:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361074176:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788574527.651445:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574527.651451:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574527.651459:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361074816/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788574527.651482:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574527.651494:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574527/real 1788574527]  req@ffff8dc020495180 x1875453361074176/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574552 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574527.651503:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361074176/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574552 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574527.651517:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574527.651520:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574527.651522:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361074176:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574527.651526:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361074304:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574527.651539:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574527.651545:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574527/real 1788574527]  req@ffff8dc020494000 x1875453361074304/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574552 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574527.651553:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361074304/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574552 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574527.651559:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574527.651562:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574527.651564:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361074304:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574527.651567:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361074432:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574527.651578:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574527.651584:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574527/real 1788574527]  req@ffff8dc020497480 x1875453361074432/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574552 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574527.651591:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453361074432/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574552 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574527.651597:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574527.651599:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574527.651602:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361074432:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574527.651606:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361074560:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574527.651617:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574527.651623:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574527/real 1788574527]  req@ffff8dc020494a80 x1875453361074560/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574552 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574527.651631:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453361074560/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574552 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574527.651642:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574527.651645:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574527.651648:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361074560:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574527.651654:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361074688:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574527.651676:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574527.651689:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574527/real 1788574527]  req@ffff8dc020495500 x1875453361074688/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574552 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574527.651700:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361074688/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574552 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574527.651706:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574527.651708:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574527.651710:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361074688:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574527.651725:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361074816:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574527.651739:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574527.651746:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574527/real 1788574527]  req@ffff8dc020495880 x1875453361074816/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574552 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574527.651754:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361074816/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574552 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574527.651760:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574527.651762:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574527.651764:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361074816:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574528.035021:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574528.035021:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574528.035047:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574528.035070:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574528.035077:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574528.035082:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574528.674968:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574529.059016:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574529.059016:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574529.059016:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574529.059071:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574529.059071:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788574529.059117:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574529.698995:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574530.082984:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574530.082984:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574530.082996:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574530.083027:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574530.083066:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788574530.083071:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574530.722960:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574531.106993:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574531.106999:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574531.107009:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574531.107061:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574531.107075:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574531.107091:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574531.746949:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574532.130951:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574532.130953:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574532.130991:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574532.131013:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574532.131032:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574532.131039:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574532.770977:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788574532.771014:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574532.771023:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788574532.771028:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574532.771040:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2878
00000100:00080000:2.0:1788574532.771053:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574532.771086:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574532.771134:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453361074944/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574532.771165:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574532.771168:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574532.771170:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574532.771173:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2878
00000100:00080000:2.0:1788574532.771176:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574532.771178:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574532.771189:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574532.771203:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453361075072/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574532.771213:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574532.771218:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574532.771221:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574532.771226:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2878
00000100:00080000:2.0:1788574532.771234:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788574532.771235:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361074944:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788574532.771247:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574532.771257:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574532.771274:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453361075200/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574532.771283:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574532.771286:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574532.771288:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574532.771291:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2878
00000100:00080000:2.0:1788574532.771296:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574532.771299:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574532.771303:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1788574532.771310:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574532.771316:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453361075328/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574532.771326:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574532.771329:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574532.771330:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574532.771334:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2878
00000100:00080000:2.0:1788574532.771338:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574532.771342:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574532.771348:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574532.771358:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574532/real 1788574532]  req@ffff8dc020494e00 x1875453361074944/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574557 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574532.771364:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361075456/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574532.771405:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788574532.771411:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453361074944/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574557 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574532.771411:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574532.771419:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574532.771434:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2878
00000100:00080000:1.0:1788574532.771436:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574532.771438:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574532.771446:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788574532.771452:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574532.771458:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361074944:192.168.202.140@tcp:250:kworker.0
00000008:00100000:2.0:1788574532.771460:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574532.771468:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361075072:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574532.771486:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361075584/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788574532.771496:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788574532.771510:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788574532.771511:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574532/real 1788574532]  req@ffff8dc020497100 x1875453361075072/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574557 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574532.771526:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574532.771533:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1788574532.771536:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453361075072/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574557 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574532.771547:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2878
00000100:00080000:1.0:1788574532.771555:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574532.771558:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574532.771561:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574532.771566:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361075072:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788574532.771570:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574532.771579:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574532.771599:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361075712/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574532.771600:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361075200:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574532.771649:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574532.771665:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574532/real 1788574532]  req@ffff8dc020496a00 x1875453361075200/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574557 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574532.771679:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453361075200/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574557 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574532.771689:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574532.771692:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574532.771694:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361075200:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574532.771699:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361075328:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574532.771716:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574532.771723:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574532/real 1788574532]  req@ffff8dc020494380 x1875453361075328/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574557 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574532.771731:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453361075328/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574557 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574532.771737:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574532.771739:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574532.771741:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361075328:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574532.771746:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361075456:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574532.771757:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574532.771763:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574532/real 1788574532]  req@ffff8dc020494700 x1875453361075456/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574557 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574532.771770:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361075456/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574557 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574532.771776:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574532.771777:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574532.771779:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361075456:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574532.771783:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361075584:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574532.771794:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574532.771800:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574532/real 1788574532]  req@ffff8dc020495880 x1875453361075584/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574557 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574532.771812:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361075584/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574557 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574532.771817:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574532.771819:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574532.771820:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361075584:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574532.771833:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361075712:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574532.771843:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574532.771849:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574532/real 1788574532]  req@ffff8dc020495500 x1875453361075712/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574557 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574532.771856:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361075712/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574557 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574532.771861:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574532.771863:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574532.771896:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361075712:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574533.154965:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574533.154965:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574533.154993:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574533.155003:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574533.155012:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574533.155044:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574533.794941:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574534.178957:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574534.178957:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574534.179008:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574534.179129:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574534.179154:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788574534.179203:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574534.818968:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574535.202966:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574535.202967:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574535.202971:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574535.202976:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574535.203006:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574535.203058:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574535.843003:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574536.227007:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574536.227015:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574536.227025:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574536.227039:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574536.227053:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574536.227069:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574536.866990:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574537.250952:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574537.250965:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574537.251010:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574537.251011:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574537.251035:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574537.251045:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00080000:2.0:1788574537.891007:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788574537.891012:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788574537.891024:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788574537.891030:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574537.891043:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2883
00000100:00080000:2.0:1788574537.891057:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574537.891068:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574537.891135:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453361075840/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574537.891175:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574537.891179:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574537.891181:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574537.891185:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2883
00000100:00080000:2.0:1788574537.891189:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574537.891192:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574537.891204:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574537.891215:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453361075968/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574537.891223:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574537.891226:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574537.891227:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574537.891230:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2883
00000100:00080000:2.0:1788574537.891232:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574537.891234:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574537.891239:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574537.891246:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361075840:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788574537.891256:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361076096/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574537.891264:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574537.891266:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574537.891268:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574537.891271:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2883
00000100:00080000:2.0:1788574537.891273:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574537.891276:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574537.891279:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574537.891287:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361076224/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574537.891295:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574537.891298:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574537.891299:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574537.891301:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2883
00000100:00080000:2.0:1788574537.891303:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574537.891305:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574537.891308:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574537.891316:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453361076352/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574537.891322:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574537.891325:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574537.891326:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574537.891329:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2883
00000100:00080000:2.0:1788574537.891332:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574537.891334:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574537.891337:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574537.891348:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361076480/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788574537.891350:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788574537.891360:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574537.891363:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574537.891364:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574537.891367:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2883
00000100:00080000:2.0:1788574537.891370:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574537.891373:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574537.891377:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574537.891384:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361076608/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574537.891419:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574537/real 1788574537]  req@ffff8dc020494a80 x1875453361075840/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574562 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574537.891445:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453361075840/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574562 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574537.891458:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574537.891464:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574537.891468:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361075840:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788574537.891478:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361075968:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574537.891508:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574537.891525:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574537/real 1788574537]  req@ffff8dc020497480 x1875453361075968/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574562 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574537.891540:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453361075968/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574562 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574537.891553:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574537.891557:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574537.891561:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361075968:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574537.891592:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361076096:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574537.891634:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574537.891650:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574537/real 1788574537]  req@ffff8dc020494000 x1875453361076096/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574562 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574537.891664:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361076096/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574562 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574537.891675:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574537.891679:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574537.891683:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361076096:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574537.891690:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361076224:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574537.891714:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574537.891727:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574537/real 1788574537]  req@ffff8dc020495180 x1875453361076224/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574562 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574537.891741:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361076224/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574562 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574537.891751:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574537.891755:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574537.891758:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361076224:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574537.891764:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361076352:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574537.891786:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574537.891799:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574537/real 1788574537]  req@ffff8dc020496d80 x1875453361076352/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574562 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574537.891820:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453361076352/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574562 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574537.891830:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574537.891834:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574537.891837:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361076352:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574537.891844:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361076480:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574537.891899:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574537.891914:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574537/real 1788574537]  req@ffff8dc020495500 x1875453361076480/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574562 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574537.891928:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361076480/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574562 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574537.891937:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574537.891940:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574537.891944:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361076480:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574537.891950:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361076608:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574537.891972:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574537.891984:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574537/real 1788574537]  req@ffff8dc020495880 x1875453361076608/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574562 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574537.891997:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361076608/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574562 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574537.892013:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574537.892016:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574537.892020:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361076608:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574538.274980:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574538.274980:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574538.275016:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574538.275059:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574538.275146:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574538.275189:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574538.915017:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574539.298978:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574539.298980:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574539.299033:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574539.299061:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574539.299062:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574539.299077:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574539.938961:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574540.322999:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574540.322999:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574540.323001:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574540.323044:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574540.323062:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788574540.323077:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574540.963003:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574541.346960:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574541.346972:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574541.346978:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574541.347003:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574541.347004:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574541.347006:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574541.986986:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574542.371020:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574542.371020:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574542.371020:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574542.371065:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574542.371076:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574542.371084:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1788574543.011007:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574543.011020:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:0.0:1788574543.011023:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788574543.011025:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574543.011045:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2888
00000100:00080000:2.0:1788574543.011060:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574543.011071:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574543.011139:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361076736/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574543.011175:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574543.011178:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574543.011181:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574543.011185:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2888
00000100:00080000:2.0:1788574543.011188:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574543.011191:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574543.011202:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574543.011215:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453361076864/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574543.011223:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574543.011226:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574543.011228:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574543.011232:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2888
00000100:00080000:2.0:1788574543.011235:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574543.011237:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574543.011241:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574543.011249:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361076736:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788574543.011254:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453361076992/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574543.011272:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574543.011275:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574543.011276:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574543.011278:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2888
00000100:00080000:2.0:1788574543.011280:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574543.011283:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574543.011286:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574543.011295:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453361077120/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574543.011301:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574543.011304:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574543.011305:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574543.011309:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2888
00000100:00080000:2.0:1788574543.011311:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574543.011313:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574543.011316:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574543.011323:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453361077248/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574543.011330:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574543.011333:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574543.011334:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574543.011338:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2888
00000100:00080000:2.0:1788574543.011342:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574543.011350:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:1.0:1788574543.011351:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:2.0:1788574543.011354:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574543.011365:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361077376/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574543.011373:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574543.011376:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574543.011378:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574543.011382:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2888
00000100:00080000:2.0:1788574543.011385:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574543.011388:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574543.011392:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574543.011400:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361077504/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574543.011415:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574543/real 1788574543]  req@ffff8dc020494700 x1875453361076736/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574568 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574543.011438:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361076736/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574568 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574543.011449:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574543.011454:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574543.011458:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361076736:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788574543.011466:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361076864:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574543.011492:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574543.011505:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574543/real 1788574543]  req@ffff8dc020494380 x1875453361076864/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574568 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574543.011525:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453361076864/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574568 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574543.011535:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574543.011539:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574543.011542:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361076864:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574543.011567:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361076992:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574543.011590:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574543.011602:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574543/real 1788574543]  req@ffff8dc020496a00 x1875453361076992/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574568 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574543.011615:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453361076992/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574568 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574543.011624:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574543.011627:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574543.011631:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361076992:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574543.011638:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361077120:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574543.011658:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574543.011670:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574543/real 1788574543]  req@ffff8dc020497100 x1875453361077120/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574568 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574543.011681:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453361077120/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574568 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574543.011707:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574543.011711:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574543.011715:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361077120:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574543.011722:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361077248:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574543.011743:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574543.011754:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574543/real 1788574543]  req@ffff8dc020494e00 x1875453361077248/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574568 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574543.011766:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453361077248/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574568 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574543.011775:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574543.011778:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574543.011782:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361077248:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574543.011789:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361077376:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574543.011809:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574543.011821:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574543/real 1788574543]  req@ffff8dc020495880 x1875453361077376/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574568 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574543.011833:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361077376/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574568 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574543.011841:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574543.011844:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574543.011849:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361077376:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574543.011855:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361077504:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574543.011907:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574543.011919:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574543/real 1788574543]  req@ffff8dc020495500 x1875453361077504/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574568 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574543.011932:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361077504/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574568 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574543.011940:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574543.011943:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574543.011947:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361077504:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574543.395029:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574543.395047:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574543.395047:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574543.395090:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574543.395113:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574543.395134:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574544.034994:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574544.418986:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574544.418987:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574544.419020:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574544.419027:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574544.419062:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574544.419078:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574545.058958:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574545.442975:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574545.443004:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574545.443013:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574545.443058:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574545.443059:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574545.443068:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574546.083012:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574546.466968:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574546.466970:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574546.467022:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574546.467034:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574546.467035:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574546.467068:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574547.107010:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574547.491019:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574547.491021:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574547.491021:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574547.491033:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574547.491069:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574547.491079:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574548.131055:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574548.131062:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574548.131073:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788574548.131083:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574548.131105:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2893
00000100:00080000:1.0:1788574548.131117:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574548.131123:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574548.131179:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361077632/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574548.131219:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574548.131224:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574548.131226:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574548.131232:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2893
00000100:00080000:1.0:1788574548.131237:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574548.131242:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574548.131252:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574548.131258:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361077632:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788574548.131272:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361077760/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574548.131283:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574548.131286:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574548.131288:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574548.131291:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2893
00000100:00080000:1.0:1788574548.131293:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574548.131296:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574548.131299:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574548.131310:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361077888/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574548.131317:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574548.131320:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574548.131321:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574548.131324:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2893
00000100:00080000:1.0:1788574548.131328:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574548.131338:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574548.131342:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574548.131353:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361078016/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788574548.131364:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788574548.131366:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574548.131370:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574548.131372:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574548.131376:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2893
00000100:00080000:1.0:1788574548.131378:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574548.131381:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574548.131386:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574548.131396:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361078144/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574548.131403:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574548.131407:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574548.131408:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574548.131415:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2893
00000100:00080000:1.0:1788574548.131420:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1788574548.131424:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574548/real 1788574548]  req@ffff8dc005dc1500 x1875453361077632/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574573 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574548.131429:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574548.131444:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574548.131473:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361077632/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574573 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574548.131476:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361078272/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574548.131508:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574548.131521:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574548.131532:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361077632:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574548.131558:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574548.131563:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574548.131566:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788574548.131577:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361077760:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788574548.131578:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2893
00000100:00080000:1.0:1788574548.131590:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574548.131595:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574548.131601:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788574548.131612:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574548.131618:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361078400/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574548.131632:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574548/real 1788574548]  req@ffff8dc005dc0a80 x1875453361077760/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574573 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574548.131650:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361077760/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574573 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574548.131679:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574548.131684:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574548.131688:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361077760:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574548.131711:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361077888:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574548.131734:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574548.131744:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574548/real 1788574548]  req@ffff8dc005dc1180 x1875453361077888/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574573 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574548.131757:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361077888/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574573 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574548.131767:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574548.131770:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574548.131774:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361077888:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574548.131781:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361078016:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574548.131804:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574548.131813:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574548/real 1788574548]  req@ffff8dc005dc3b80 x1875453361078016/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574573 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574548.131828:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361078016/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574573 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574548.131835:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574548.131837:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574548.131840:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361078016:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574548.131844:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361078144:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574548.131859:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574548.131895:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574548/real 1788574548]  req@ffff8dc005dc0700 x1875453361078144/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574573 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574548.131905:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361078144/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574573 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574548.131911:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574548.131914:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574548.131917:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361078144:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574548.131924:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361078272:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574548.131941:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574548.131949:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574548/real 1788574548]  req@ffff8dc005dc3800 x1875453361078272/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574573 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574548.131956:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361078272/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574573 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574548.131967:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574548.131969:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574548.131971:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361078272:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574548.131988:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361078400:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574548.132004:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574548.132012:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574548/real 1788574548]  req@ffff8dc005dc1c00 x1875453361078400/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574573 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574548.132019:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361078400/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574573 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574548.132025:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574548.132027:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574548.132028:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361078400:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574548.514953:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574548.514971:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574548.515013:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574548.515066:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574548.515077:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574548.515118:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574549.155012:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574549.538947:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574549.538964:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574549.539002:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574549.539025:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574549.539027:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574549.539027:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574550.179024:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574550.562984:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574550.562984:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574550.562988:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574550.563021:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574550.563025:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574550.563026:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574551.202976:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574551.586985:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574551.586985:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574551.586997:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574551.586997:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574551.587057:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574551.587098:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574552.227005:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574552.610996:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574552.610996:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574552.610996:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574552.611008:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574552.611035:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574552.611075:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1788574553.250973:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788574553.250973:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574553.250984:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788574553.250989:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574553.251000:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2898
00000100:00080000:1.0:1788574553.251011:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574553.251019:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574553.251064:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361078528/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574553.251093:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574553.251097:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574553.251098:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574553.251101:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2898
00000100:00080000:1.0:1788574553.251104:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574553.251107:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574553.251118:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574553.251127:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361078528:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788574553.251132:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361078656/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574553.251141:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574553.251143:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574553.251144:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574553.251147:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2898
00000100:00080000:1.0:1788574553.251149:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574553.251152:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574553.251155:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574553.251163:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361078784/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574553.251170:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574553.251190:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574553.251192:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574553.251195:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2898
00000100:00080000:1.0:1788574553.251199:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574553.251202:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574553.251207:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574553.251218:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361078912/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574553.251224:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574553.251227:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574553.251229:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574553.251232:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2898
00000100:00080000:1.0:1788574553.251235:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574553.251238:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574553.251241:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574553.251249:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361079040/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574553.251256:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574553.251259:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574553.251261:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574553.251265:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2898
00000100:00080000:1.0:1788574553.251267:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574553.251269:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574553.251273:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574553.251278:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361078656:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574553.251283:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361079168/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574553.251297:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574553.251300:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574553.251302:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574553.251305:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2898
00000100:00080000:1.0:1788574553.251308:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574553.251311:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574553.251315:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361078784:192.168.202.140@tcp:8:kworker.0
00000008:00100000:1.0:1788574553.251316:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574553.251331:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361079296/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574553.251343:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361078912:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574553.251360:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361079040:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574553.251379:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361079168:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574553.251408:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361079296:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574553.635008:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574553.635008:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574553.635008:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574553.635009:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574553.635045:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574553.635083:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574554.275009:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574554.658963:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574554.659002:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574554.659002:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574554.659033:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574554.659052:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574554.659053:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574555.299003:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574555.683041:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574555.683046:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574555.683051:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574555.683104:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574555.683118:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574555.683118:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574556.323023:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000400:00000100:3.0:1788574556.323201:0:2336:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.140:988
00000400:00000100:3.0:1788574556.323246:0:2336:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.140@tcp at host 192.168.202.140 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:3.0:1788574556.323268:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788574556.323321:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788574556.323332:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788574556.323344:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788574556.323357:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788574556.323367:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788574556.323376:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:2.0:1788574556.323390:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574553/real 1788574556]  req@ffff8dc005dc1c00 x1875453361078656/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574578 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574556.323423:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361078656/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574578 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574556.323441:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574556.323447:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574556.323452:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361078656:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574556.323462:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574553/real 1788574556]  req@ffff8dc005dc3800 x1875453361078784/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574578 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574556.323486:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361078784/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574578 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574556.323496:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574556.323501:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574556.323505:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361078784:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574556.323513:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574553/real 1788574556]  req@ffff8dc005dc0700 x1875453361078912/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574578 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574556.323530:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361078912/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574578 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574556.323551:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574556.323555:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574556.323558:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361078912:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574556.323565:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574553/real 1788574556]  req@ffff8dc005dc3b80 x1875453361079040/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574578 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574556.323576:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361079040/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574578 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574556.323585:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574556.323588:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574556.323592:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361079040:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574556.323600:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574553/real 1788574556]  req@ffff8dc005dc2d80 x1875453361078528/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574578 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574556.323614:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361078528/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574578 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574556.323623:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574556.323626:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574556.323630:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361078528:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788574556.323673:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574553/real 1788574556]  req@ffff8dc005dc1180 x1875453361079168/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574578 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574556.323686:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361079168/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574578 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574556.323695:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574556.323699:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574556.323702:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361079168:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574556.323709:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574553/real 1788574556]  req@ffff8dc005dc0a80 x1875453361079296/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574578 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574556.323721:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361079296/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574578 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574556.323730:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574556.323733:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574556.323736:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361079296:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574556.706968:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574556.706992:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574556.707024:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574556.707025:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574556.707028:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574556.707069:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574557.347011:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574557.731043:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574557.731079:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574557.731089:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574557.731148:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574557.731154:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574557.731216:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1788574558.371121:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574558.371132:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788574558.371137:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788574558.371141:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788574558.371149:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2904
00000100:00080000:2.0:1788574558.371178:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574558.371203:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574558.371242:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453361079424/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574558.371280:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574558.371286:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574558.371288:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574558.371293:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2904
00000100:00080000:2.0:1788574558.371299:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574558.371306:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574558.371319:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574558.371334:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361079424:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788574558.371343:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361079552/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574558.371362:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574558.371366:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574558.371368:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574558.371374:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2904
00000100:00080000:2.0:1788574558.371379:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574558.371384:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574558.371395:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574558.371412:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361079680/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574558.371427:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574558.371433:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574558.371436:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574558.371441:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2904
00000100:00080000:2.0:1788574558.371446:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574558.371452:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574558.371459:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1788574558.371462:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574558.371485:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453361079808/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574558.371502:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574558.371508:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574558.371510:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574558.371517:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2904
00000100:00080000:2.0:1788574558.371523:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574558.371530:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574558.371539:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574558.371548:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574558/real 1788574558]  req@ffff8dc020496d80 x1875453361079424/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574583 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574558.371568:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453361079936/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574558.371587:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788574558.371594:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453361079424/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574583 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574558.371596:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574558.371605:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574558.371622:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2904
00000100:00080000:1.0:1788574558.371627:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574558.371630:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574558.371645:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788574558.371647:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574558.371658:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361079424:192.168.202.140@tcp:250:kworker.0
00000008:00100000:2.0:1788574558.371664:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574558.371692:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361080064/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574558.371708:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788574558.371710:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361079552:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788574558.371726:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574558.371730:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574558.371738:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2904
00000100:00080000:2.0:1788574558.371745:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574558.371753:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:1.0:1788574558.371770:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:2.0:1788574558.371774:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574558.371799:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574558/real 1788574558]  req@ffff8dc020495180 x1875453361079552/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574583 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574558.371803:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361080192/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574558.371830:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361079552/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574583 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574558.371852:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574558.371856:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574558.371861:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361079552:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574558.371900:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361079680:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574558.371934:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574558.371951:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574558/real 1788574558]  req@ffff8dc020494000 x1875453361079680/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574583 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574558.371965:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361079680/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574583 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574558.371974:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574558.371979:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574558.371983:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361079680:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574558.371993:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361079808:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574558.372019:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574558.372033:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574558/real 1788574558]  req@ffff8dc020497480 x1875453361079808/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574583 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574558.372066:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453361079808/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574583 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574558.372078:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574558.372081:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574558.372085:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361079808:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574558.372094:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361079936:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574558.372118:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574558.372131:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574558/real 1788574558]  req@ffff8dc020494a80 x1875453361079936/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574583 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574558.372145:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453361079936/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574583 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574558.372155:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574558.372158:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574558.372175:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361079936:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574558.372199:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361080064:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574558.372223:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574558.372237:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574558/real 1788574558]  req@ffff8dc020495500 x1875453361080064/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574583 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574558.372256:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361080064/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574583 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574558.372266:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574558.372270:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574558.372274:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361080064:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574558.372281:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361080192:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574558.372302:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574558.372314:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574558/real 1788574558]  req@ffff8dc020495880 x1875453361080192/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574583 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574558.372326:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361080192/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574583 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574558.372335:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574558.372339:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574558.372342:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361080192:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574558.754946:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574558.754959:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574558.754980:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574558.754998:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574558.755003:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574558.755010:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574559.394995:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574559.779028:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574559.779028:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574559.779031:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574559.779036:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574559.779074:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574559.779091:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574560.418960:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574560.802943:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574560.802959:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574560.802959:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574560.802964:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574560.802984:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574560.803007:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574561.443000:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574561.827031:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574561.827031:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574561.827032:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574561.827081:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574561.827100:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574561.827114:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574562.467014:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574562.850986:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574562.850986:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574562.850986:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574562.850986:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574562.851022:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574562.851071:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574563.490987:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574563.490990:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574563.491000:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788574563.491005:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574563.491016:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2909
00000100:00080000:1.0:1788574563.491027:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574563.491035:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574563.491081:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361080320/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574563.491118:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574563.491122:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574563.491125:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574563.491130:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2909
00000100:00080000:1.0:1788574563.491144:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574563.491150:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574563.491163:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574563.491170:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361080320:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788574563.491185:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361080448/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574563.491199:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574563.491204:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574563.491206:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574563.491211:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2909
00000100:00080000:1.0:1788574563.491216:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574563.491221:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574563.491227:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574563.491238:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361080576/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788574563.491251:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788574563.491256:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574563.491260:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574563.491261:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574563.491265:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2909
00000100:00080000:1.0:1788574563.491269:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574563.491272:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574563.491277:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574563.491284:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361080704/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574563.491290:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574563.491293:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574563.491295:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574563.491298:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2909
00000100:00080000:1.0:1788574563.491300:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574563.491304:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574563.491307:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574563.491313:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574563/real 1788574563]  req@ffff8dc005dc1500 x1875453361080320/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574588 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574563.491319:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361080832/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574563.491339:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574563.491343:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574563.491344:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788574563.491349:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361080320/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574588 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574563.491352:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2909
00000100:00080000:1.0:1788574563.491358:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574563.491365:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574563.491370:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1788574563.491371:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574563.491378:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574563.491384:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361080960/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574563.491384:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361080320:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574563.491398:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574563.491400:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574563.491401:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574563.491405:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2909
00000100:00080000:1.0:1788574563.491407:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574563.491409:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574563.491413:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574563.491416:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361080448:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574563.491424:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361081088/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788574563.491443:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574563.491458:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574563/real 1788574563]  req@ffff8dc005dc0a80 x1875453361080448/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574588 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574563.491467:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361080448/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574588 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574563.491476:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574563.491478:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574563.491481:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361080448:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574563.491485:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361080576:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574563.491499:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574563.491505:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574563/real 1788574563]  req@ffff8dc005dc1180 x1875453361080576/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574588 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574563.491514:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361080576/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574588 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574563.491525:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574563.491527:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574563.491530:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361080576:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574563.491533:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361080704:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574563.491544:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574563.491550:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574563/real 1788574563]  req@ffff8dc005dc2d80 x1875453361080704/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574588 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574563.491557:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361080704/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574588 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574563.491564:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574563.491566:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574563.491568:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361080704:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574563.491572:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361080832:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574563.491583:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574563.491589:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574563/real 1788574563]  req@ffff8dc005dc3b80 x1875453361080832/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574588 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574563.491602:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361080832/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574588 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574563.491612:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574563.491615:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574563.491620:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361080832:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574563.491627:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361080960:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574563.491650:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574563.491661:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574563/real 1788574563]  req@ffff8dc005dc0700 x1875453361080960/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574588 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574563.491676:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361080960/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574588 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574563.491681:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574563.491684:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574563.491686:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361080960:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574563.491700:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361081088:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574563.491715:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574563.491722:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574563/real 1788574563]  req@ffff8dc005dc3800 x1875453361081088/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574588 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574563.491730:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361081088/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574588 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574563.491736:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574563.491738:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574563.491740:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361081088:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574563.875002:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574563.875002:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574563.875039:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574563.875041:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574563.875062:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574563.875079:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574564.515045:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574564.898991:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574564.898991:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574564.898992:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574564.899027:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574564.899027:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574564.899036:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574565.538947:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574565.923001:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574565.923001:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574565.923001:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574565.923037:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788574565.923045:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574565.923064:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574566.562958:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574566.947022:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574566.947022:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574566.947022:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574566.947045:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574566.947078:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574566.947080:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574567.587001:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574567.971005:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574567.971005:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574567.971032:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574567.971044:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574567.971097:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788574567.971147:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574568.611011:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788574568.611013:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574568.611021:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788574568.611025:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574568.611033:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2914
00000100:00080000:2.0:1788574568.611042:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574568.611048:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574568.611080:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453361081216/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574568.611115:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574568.611120:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574568.611121:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574568.611125:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2914
00000100:00080000:2.0:1788574568.611129:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574568.611133:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574568.611142:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574568.611152:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453361081344/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574568.611162:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574568.611169:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574568.611171:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1788574568.611172:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361081216:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788574568.611178:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2914
00000100:00080000:2.0:1788574568.611190:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574568.611197:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574568.611202:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574568.611212:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453361081472/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574568.611219:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574568.611221:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574568.611222:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574568.611225:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2914
00000100:00080000:2.0:1788574568.611227:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574568.611229:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574568.611233:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574568.611242:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453361081600/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574568.611250:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574568.611253:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574568.611254:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574568.611256:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2914
00000100:00080000:2.0:1788574568.611259:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574568.611261:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574568.611266:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574568.611273:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361081728/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788574568.611280:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788574568.611291:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574568.611294:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574568.611296:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574568.611299:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2914
00000100:00080000:2.0:1788574568.611303:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574568.611308:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574568.611313:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574568.611322:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361081856/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574568.611329:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574568.611332:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574568.611333:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574568.611336:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2914
00000100:00080000:2.0:1788574568.611341:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788574568.611346:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574568/real 1788574568]  req@ffff8dc020494e00 x1875453361081216/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574593 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574568.611348:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574568.611354:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574568.611373:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361081984/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574568.611385:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453361081216/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574593 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574568.611396:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574568.611402:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574568.611406:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361081216:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788574568.611429:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361081344:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574568.611448:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574568.611457:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574568/real 1788574568]  req@ffff8dc020497100 x1875453361081344/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574593 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574568.611466:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453361081344/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574593 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574568.611475:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574568.611477:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574568.611479:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361081344:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574568.611484:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361081472:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574568.611497:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574568.611503:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574568/real 1788574568]  req@ffff8dc020496a00 x1875453361081472/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574593 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574568.611516:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453361081472/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574593 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574568.611522:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574568.611524:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574568.611526:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361081472:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574568.611530:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361081600:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574568.611541:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574568.611547:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574568/real 1788574568]  req@ffff8dc020494380 x1875453361081600/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574593 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574568.611555:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453361081600/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574593 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574568.611570:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574568.611571:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574568.611573:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361081600:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574568.611577:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361081728:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574568.611590:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574568.611597:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574568/real 1788574568]  req@ffff8dc020494700 x1875453361081728/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574593 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574568.611605:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361081728/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574593 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574568.611616:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574568.611618:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574568.611620:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361081728:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574568.611624:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361081856:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574568.611635:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574568.611641:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574568/real 1788574568]  req@ffff8dc020495880 x1875453361081856/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574593 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574568.611649:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361081856/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574593 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574568.611657:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574568.611661:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574568.611664:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361081856:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574568.611671:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361081984:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574568.611695:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574568.611707:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574568/real 1788574568]  req@ffff8dc020495500 x1875453361081984/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574593 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574568.611721:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361081984/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574593 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574568.611729:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574568.611731:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574568.611734:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361081984:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574568.994994:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574568.994994:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574568.995044:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574568.995052:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574568.995054:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574568.995088:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574569.634972:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574570.018954:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574570.018961:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574570.018961:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574570.018986:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574570.018994:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574570.018995:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574570.658950:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574571.042973:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574571.042981:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574571.042981:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574571.042985:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574571.043025:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574571.043069:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574571.682967:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574572.066971:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574572.066971:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574572.066980:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574572.067025:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788574572.067051:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574572.067052:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574572.706946:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574573.090924:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574573.090941:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574573.090958:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574573.090968:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574573.090976:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574573.090988:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574573.730969:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574573.731020:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574573.731025:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788574573.731028:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574573.731036:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2919
00000100:00080000:1.0:1788574573.731045:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574573.731051:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574573.731109:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361082112/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574573.731135:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574573.731137:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574573.731139:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574573.731142:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2919
00000100:00080000:1.0:1788574573.731145:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574573.731147:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574573.731156:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574573.731167:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361082240/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574573.731176:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361082112:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574573.731178:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574573.731185:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574573.731187:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574573.731190:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2919
00000100:00080000:1.0:1788574573.731192:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574573.731195:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574573.731198:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574573.731207:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361082368/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574573.731213:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574573.731216:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574573.731218:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574573.731220:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2919
00000100:00080000:1.0:1788574573.731222:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574573.731225:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574573.731228:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574573.731236:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361082496/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788574573.731242:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788574573.731249:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574573.731252:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574573.731254:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574573.731258:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2919
00000100:00080000:1.0:1788574573.731263:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574573.731266:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574573.731270:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574573.731279:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361082624/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574573.731285:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574573/real 1788574573]  req@ffff8dc005dc1c00 x1875453361082112/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574598 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574573.731288:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574573.731296:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574573.731300:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574573.731307:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2919
00000100:00080000:1.0:1788574573.731311:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574573.731314:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574573.731317:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361082112/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574598 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1788574573.731319:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1788574573.731332:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1788574573.731333:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361082752/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574573.731338:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574573.731346:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361082112:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574573.731349:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574573.731354:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574573.731355:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574573.731359:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2919
00000100:00080000:1.0:1788574573.731362:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574573.731364:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574573.731368:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574573.731371:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361082240:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574573.731378:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361082880/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788574573.731395:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574573.731406:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574573/real 1788574573]  req@ffff8dc005dc3800 x1875453361082240/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574598 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574573.731415:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361082240/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574598 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574573.731423:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574573.731425:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574573.731428:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361082240:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574573.731432:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361082368:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574573.731443:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574573.731459:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574573/real 1788574573]  req@ffff8dc005dc0700 x1875453361082368/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574598 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574573.731472:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361082368/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574598 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574573.731481:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574573.731485:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574573.731488:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361082368:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574573.731495:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361082496:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574573.731516:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574573.731526:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574573/real 1788574573]  req@ffff8dc005dc3b80 x1875453361082496/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574598 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574573.731534:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361082496/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574598 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574573.731540:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574573.731542:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574573.731544:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361082496:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574573.731548:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361082624:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574573.731560:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574573.731567:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574573/real 1788574573]  req@ffff8dc005dc2d80 x1875453361082624/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574598 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574573.731583:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361082624/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574598 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574573.731589:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574573.731591:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574573.731593:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361082624:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574573.731597:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361082752:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574573.731608:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574573.731615:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574573/real 1788574573]  req@ffff8dc005dc1180 x1875453361082752/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574598 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574573.731623:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361082752/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574598 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574573.731628:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574573.731635:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574573.731637:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361082752:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574573.731654:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361082880:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574573.731674:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574573.731687:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574573/real 1788574573]  req@ffff8dc005dc0a80 x1875453361082880/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574598 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574573.731700:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361082880/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574598 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574573.731709:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574573.731713:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574573.731716:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361082880:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574574.114963:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574574.114965:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574574.114970:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574574.114995:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788574574.114996:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574574.115002:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574574.754984:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574575.138977:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574575.139014:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574575.139017:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574575.139018:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574575.139078:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788574575.139159:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574575.779025:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574576.163025:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574576.163025:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574576.163027:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788574576.163099:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574576.163107:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574576.163112:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574576.803033:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574577.187018:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574577.187036:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574577.187041:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574577.187086:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574577.187110:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574577.187128:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574577.827020:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574578.210948:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574578.210955:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574578.210960:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574578.211003:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574578.211016:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788574578.211038:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574578.850952:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788574578.850986:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574578.850994:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788574578.850998:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574578.851008:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2924
00000100:00080000:2.0:1788574578.851018:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574578.851026:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574578.851075:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453361083008/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574578.851104:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574578.851108:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574578.851110:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574578.851114:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2924
00000100:00080000:2.0:1788574578.851119:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574578.851124:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574578.851135:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574578.851144:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361083008:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788574578.851152:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453361083136/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574578.851166:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574578.851170:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574578.851172:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574578.851177:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2924
00000100:00080000:2.0:1788574578.851181:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574578.851186:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574578.851192:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574578.851204:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361083264/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574578.851214:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1788574578.851217:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788574578.851220:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574578.851224:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574578.851229:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2924
00000100:00080000:2.0:1788574578.851234:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574578.851238:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574578.851244:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574578.851257:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361083392/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574578.851262:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574578/real 1788574578]  req@ffff8dc020494a80 x1875453361083008/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574603 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574578.851282:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574578.851287:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574578.851290:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1788574578.851291:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453361083008/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574603 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574578.851299:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2924
00000100:00080000:1.0:1788574578.851304:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574578.851306:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574578.851310:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574578.851317:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361083008:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788574578.851317:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574578.851329:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574578.851346:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453361083520/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574578.851347:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361083136:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788574578.851367:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574578.851371:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574578.851374:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574578.851380:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2924
00000800:00000100:1.0:1788574578.851385:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788574578.851388:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574578.851394:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574578.851400:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574578.851402:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574578/real 1788574578]  req@ffff8dc020497480 x1875453361083136/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574603 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574578.851421:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453361083136/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574603 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574578.851422:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453361083648/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574578.851444:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574578.851454:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574578.851458:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574578.851462:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574578.851466:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2924
00000100:00080000:1.0:1788574578.851470:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788574578.851475:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788574578.851476:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361083136:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788574578.851486:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574578.851487:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361083264:192.168.202.140@tcp:8:kworker.0
00000008:00100000:2.0:1788574578.851497:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1788574578.851516:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574578.851516:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361083776/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574578.851527:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574578/real 1788574578]  req@ffff8dc020494000 x1875453361083264/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574603 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574578.851539:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361083264/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574603 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574578.851547:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574578.851550:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574578.851552:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361083264:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574578.851557:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361083392:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574578.851569:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574578.851582:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574578/real 1788574578]  req@ffff8dc020495180 x1875453361083392/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574603 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574578.851590:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361083392/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574603 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574578.851596:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574578.851598:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574578.851601:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361083392:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574578.851613:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361083520:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574578.851625:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574578.851632:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574578/real 1788574578]  req@ffff8dc020496d80 x1875453361083520/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574603 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574578.851639:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453361083520/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574603 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574578.851648:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574578.851651:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574578.851655:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361083520:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574578.851661:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361083648:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574578.851680:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574578.851692:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574578/real 1788574578]  req@ffff8dc020494a80 x1875453361083648/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574603 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574578.851704:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453361083648/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574603 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574578.851710:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574578.851712:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574578.851714:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361083648:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574578.851719:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361083776:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574578.851732:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574578.851739:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574578/real 1788574578]  req@ffff8dc020495500 x1875453361083776/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574603 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574578.851747:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361083776/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574603 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574578.851752:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574578.851754:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574578.851756:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361083776:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574579.234972:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574579.234973:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574579.235007:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574579.235103:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574579.235115:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574579.235163:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574579.874979:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574580.258977:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574580.258977:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574580.258985:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574580.259000:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574580.259018:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788574580.259075:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574580.898939:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574581.282945:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574581.282945:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574581.283012:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574581.283063:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574581.283067:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574581.283108:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574581.922965:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574582.306970:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574582.306983:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574582.307007:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574582.307009:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574582.307035:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574582.307055:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574582.946946:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574583.330978:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574583.330978:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574583.330982:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574583.330993:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574583.331031:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574583.331067:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574583.970991:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574583.971039:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574583.971047:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788574583.971052:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574583.971062:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2929
00000100:00080000:0.0:1788574583.971072:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574583.971081:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574583.971120:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361083904/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574583.971148:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574583.971152:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574583.971153:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574583.971158:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2929
00000100:00080000:0.0:1788574583.971161:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574583.971165:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574583.971175:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574583.971186:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361084032/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574583.971193:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574583.971195:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574583.971197:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574583.971199:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2929
00000100:00080000:0.0:1788574583.971202:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574583.971204:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574583.971207:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574583.971213:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361084160/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574583.971219:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574583.971223:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574583.971225:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574583.971228:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2929
00000100:00080000:0.0:1788574583.971230:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574583.971232:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574583.971235:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574583.971242:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361084288/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574583.971250:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574583.971251:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574583.971253:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574583.971257:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2929
00000100:00080000:0.0:1788574583.971263:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788574583.971265:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361083904:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788574583.971267:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574583.971273:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574583.971286:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361084416/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574583.971294:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574583.971297:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574583.971298:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574583.971301:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2929
00000100:00080000:0.0:1788574583.971303:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574583.971306:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574583.971309:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574583.971316:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361084544/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574583.971321:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574583.971323:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574583.971324:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574583.971327:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2929
00000100:00080000:0.0:1788574583.971329:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574583.971331:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574583.971334:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574583.971344:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361084672/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788574583.971376:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574583.971429:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574583/real 1788574583]  req@ffff8dc006713800 x1875453361083904/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574608 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574583.971448:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361083904/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574608 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574583.971458:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574583.971461:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574583.971466:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361083904:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788574583.971472:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361084032:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574583.971491:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574583.971499:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574583/real 1788574583]  req@ffff8dc006712a00 x1875453361084032/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574608 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574583.971508:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361084032/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574608 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574583.971517:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574583.971519:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574583.971521:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361084032:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574583.971525:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361084160:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574583.971538:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574583.971547:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574583/real 1788574583]  req@ffff8dc006713100 x1875453361084160/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574608 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574583.971559:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361084160/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574608 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574583.971569:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574583.971574:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574583.971577:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361084160:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574583.971610:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361084288:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574583.971627:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574583.971637:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574583/real 1788574583]  req@ffff8dc006713b80 x1875453361084288/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574608 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574583.971646:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361084288/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574608 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574583.971653:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574583.971655:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574583.971657:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361084288:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574583.971662:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361084416:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574583.971674:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574583.971681:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574583/real 1788574583]  req@ffff8dc006710e00 x1875453361084416/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574608 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574583.971689:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361084416/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574608 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574583.971695:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574583.971697:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574583.971699:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361084416:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574583.971703:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361084544:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574583.971714:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574583.971721:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574583/real 1788574583]  req@ffff8dc006711880 x1875453361084544/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574608 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574583.971728:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361084544/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574608 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574583.971734:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574583.971737:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574583.971739:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361084544:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574583.971742:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361084672:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574583.971753:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574583.971758:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574583/real 1788574583]  req@ffff8dc006712300 x1875453361084672/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574608 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574583.971765:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361084672/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574608 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574583.971770:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574583.971772:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574583.971775:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361084672:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574584.355036:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574584.355036:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574584.355073:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574584.355096:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574584.355118:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788574584.355137:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574584.994968:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574585.378994:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574585.378994:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574585.378994:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574585.379020:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574585.379052:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574585.379091:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574586.019020:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574586.403034:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574586.403034:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574586.403062:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574586.403084:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574586.403099:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788574586.403109:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574587.042942:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574587.426965:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574587.426965:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574587.426966:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574587.427042:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574587.427052:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574587.427058:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574588.066935:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574588.450964:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574588.450964:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574588.451021:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574588.451045:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574588.451052:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574588.451073:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574589.091123:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574589.091128:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574589.091138:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788574589.091145:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574589.091158:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2934
00000100:00080000:0.0:1788574589.091174:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574589.091183:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574589.091222:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361084800/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574589.091249:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574589.091253:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574589.091255:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574589.091259:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2934
00000100:00080000:0.0:1788574589.091265:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574589.091270:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574589.091283:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574589.091291:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361084800:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788574589.091298:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361084928/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574589.091309:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574589.091313:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574589.091315:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574589.091319:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2934
00000100:00080000:0.0:1788574589.091322:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574589.091326:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574589.091339:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574589.091351:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453361085056/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574589.091358:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574589.091360:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574589.091362:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574589.091365:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2934
00000100:00080000:0.0:1788574589.091407:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574589.091411:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574589.091415:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788574589.091418:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574589.091442:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361085184/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574589.091456:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574589.091460:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574589.091463:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574589.091470:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2934
00000100:00080000:0.0:1788574589.091477:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574589.091482:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574589.091491:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574589.091507:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361085312/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574589.091519:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574589.091525:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574589.091528:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574589.091535:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2934
00000100:00080000:0.0:1788574589.091541:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574589.091546:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574589.091551:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574589.091574:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361085440/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788574589.091581:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574589/real 1788574589]  req@ffff8dc006713480 x1875453361084800/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574614 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574589.091586:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574589.091591:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574589.091597:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574589.091614:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2934
00000100:00080000:0.0:1788574589.091619:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574589.091623:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574589.091627:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574589.091635:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361085568/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788574589.091673:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361084800/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574614 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574589.091686:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574589.091690:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574589.091693:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361084800:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788574589.091713:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361084928:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788574589.091734:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574589.091744:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574589/real 1788574589]  req@ffff8dc006712680 x1875453361084928/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574614 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574589.091752:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361084928/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574614 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574589.091759:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574589.091762:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574589.091764:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361084928:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574589.091768:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361085056:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574589.091781:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574589.091787:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574589/real 1788574589]  req@ffff8dc006710380 x1875453361085056/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574614 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574589.091794:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453361085056/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574614 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574589.091799:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574589.091801:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574589.091803:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361085056:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574589.091807:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361085184:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574589.091818:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574589.091824:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574589/real 1788574589]  req@ffff8dc006711c00 x1875453361085184/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574614 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574589.091831:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361085184/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574614 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574589.091836:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574589.091838:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574589.091840:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361085184:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574589.091843:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361085312:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788574589.091854:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574589.091859:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574589/real 1788574589]  req@ffff8dc006711500 x1875453361085312/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574614 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574589.091908:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361085312/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574614 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574589.091915:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574589.091918:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574589.091920:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361085312:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574589.091925:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361085440:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574589.091945:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574589.091961:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574589/real 1788574589]  req@ffff8dc006712300 x1875453361085440/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574614 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574589.091974:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361085440/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574614 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574589.091994:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574589.091997:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574589.091999:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361085440:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574589.092004:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361085568:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574589.092020:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574589.092027:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574589/real 1788574589]  req@ffff8dc006711880 x1875453361085568/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574614 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574589.092034:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361085568/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574614 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574589.092044:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574589.092046:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574589.092048:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361085568:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574589.474986:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574589.474989:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574589.474991:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574589.474999:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574589.475033:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574589.475064:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574590.114950:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574590.498951:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574590.498953:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574590.498987:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574590.499012:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574590.499013:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574590.499016:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574591.139004:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574591.522935:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574591.522941:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574591.522943:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574591.522961:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574591.522977:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574591.523039:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574592.162944:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574592.546983:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574592.546983:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574592.546983:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574592.546984:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574592.547019:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574592.547047:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574593.186987:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574593.570950:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574593.570964:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574593.570968:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574593.571000:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574593.571010:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574593.571013:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00080000:1.0:1788574594.210976:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788574594.210981:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574594.210986:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788574594.210991:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574594.211000:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2939
00000100:00080000:1.0:1788574594.211009:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574594.211016:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574594.211050:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361085696/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574594.211071:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574594.211074:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574594.211076:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574594.211079:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2939
00000100:00080000:1.0:1788574594.211081:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574594.211083:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574594.211092:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574594.211103:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361085824/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788574594.211109:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361085696:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574594.211115:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574594.211118:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574594.211119:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574594.211122:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2939
00000100:00080000:1.0:1788574594.211124:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574594.211127:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574594.211131:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574594.211140:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361085952/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574594.211147:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574594.211150:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574594.211152:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574594.211154:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2939
00000100:00080000:1.0:1788574594.211157:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574594.211159:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574594.211162:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574594.211170:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361086080/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574594.211177:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1788574594.211180:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788574594.211181:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574594.211185:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574594.211189:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2939
00000100:00080000:1.0:1788574594.211192:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574594.211195:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574594.211199:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574594.211207:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361086208/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574594.211214:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574594.211217:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574594.211218:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574594.211222:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2939
00000100:00080000:1.0:1788574594.211225:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788574594.211228:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574594/real 1788574594]  req@ffff8dc005dc1500 x1875453361085696/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574619 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574594.211230:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574594.211236:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574594.211247:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361086336/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574594.211255:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788574594.211257:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361085696/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574619 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574594.211258:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574594.211261:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574594.211268:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2939
00000100:00080000:1.0:1788574594.211274:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574594.211280:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574594.211284:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788574594.211284:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574594.211293:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574594.211298:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361086464/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788574594.211303:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361085696:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788574594.211331:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361085824:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788574594.211355:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574594.211367:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574594/real 1788574594]  req@ffff8dc005dc0a80 x1875453361085824/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574619 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574594.211381:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361085824/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574619 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574594.211393:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574594.211397:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574594.211401:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361085824:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574594.211408:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361085952:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574594.211426:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574594.211437:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574594/real 1788574594]  req@ffff8dc005dc1180 x1875453361085952/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574619 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574594.211449:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361085952/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574619 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574594.211460:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574594.211463:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574594.211467:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361085952:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574594.211473:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361086080:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574594.211491:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574594.211501:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574594/real 1788574594]  req@ffff8dc005dc2d80 x1875453361086080/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574619 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574594.211514:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361086080/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574619 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574594.211524:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574594.211527:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574594.211531:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361086080:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574594.211537:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361086208:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788574594.211555:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574594.211565:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574594/real 1788574594]  req@ffff8dc005dc3b80 x1875453361086208/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574619 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574594.211578:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361086208/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574619 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574594.211588:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574594.211591:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574594.211595:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361086208:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574594.211601:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361086336:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574594.211618:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574594.211629:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574594/real 1788574594]  req@ffff8dc005dc0700 x1875453361086336/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574619 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574594.211641:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361086336/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574619 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574594.211657:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574594.211661:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574594.211665:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361086336:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574594.211671:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361086464:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574594.211689:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574594.211698:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574594/real 1788574594]  req@ffff8dc005dc3800 x1875453361086464/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574619 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574594.211711:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361086464/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574619 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574594.211720:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574594.211724:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574594.211727:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361086464:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574594.594983:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574594.594983:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574594.594983:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574594.595016:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574594.595024:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788574594.595028:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574595.234927:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574595.618999:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574595.619000:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574595.619000:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574595.619000:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574595.619057:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574595.619099:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574596.258974:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574596.642994:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574596.642994:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574596.642994:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574596.642997:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574596.643029:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788574596.643078:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574597.282969:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574597.667017:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574597.667024:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574597.667026:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574597.667030:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574597.667083:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574597.667126:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574598.306980:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574598.691001:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574598.691001:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574598.691001:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574598.691006:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574598.691030:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788574598.691091:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574599.330993:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574599.331011:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574599.331018:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788574599.331023:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574599.331035:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2944
00000100:00080000:1.0:1788574599.331046:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574599.331053:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574599.331101:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361086592/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574599.331121:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574599.331124:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574599.331125:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574599.331128:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2944
00000100:00080000:1.0:1788574599.331131:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574599.331134:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574599.331143:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574599.331154:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361086720/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788574599.331161:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361086592:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574599.331164:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574599.331168:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574599.331169:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574599.331173:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2944
00000100:00080000:1.0:1788574599.331175:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574599.331177:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574599.331180:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574599.331189:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361086848/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574599.331196:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574599.331198:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574599.331199:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574599.331202:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2944
00000100:00080000:1.0:1788574599.331204:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574599.331207:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574599.331210:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574599.331217:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361086976/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574599.331223:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574599.331225:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574599.331226:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574599.331229:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2944
00000100:00080000:1.0:1788574599.331231:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1788574599.331235:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788574599.331237:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574599.331242:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574599.331249:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361087104/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574599.331255:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574599.331258:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574599.331260:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574599.331263:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2944
00000100:00080000:1.0:1788574599.331266:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574599.331268:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574599.331272:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574599.331282:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574599/real 1788574599]  req@ffff8dc005dc1c00 x1875453361086592/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574624 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574599.331283:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361087232/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574599.331316:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574599.331319:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574599.331320:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788574599.331325:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361086592/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574624 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574599.331326:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2944
00000100:00080000:1.0:1788574599.331331:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574599.331337:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574599.331344:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788574599.331344:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574599.331351:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574599.331356:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361087360/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788574599.331357:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361086592:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788574599.331383:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361086720:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788574599.331403:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574599.331412:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574599/real 1788574599]  req@ffff8dc005dc3800 x1875453361086720/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574624 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574599.331421:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361086720/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574624 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574599.331428:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574599.331430:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574599.331432:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361086720:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574599.331436:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361086848:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574599.331447:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574599.331453:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574599/real 1788574599]  req@ffff8dc005dc0700 x1875453361086848/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574624 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574599.331465:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361086848/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574624 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574599.331470:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574599.331472:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574599.331474:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361086848:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574599.331477:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361086976:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574599.331487:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574599.331492:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574599/real 1788574599]  req@ffff8dc005dc3b80 x1875453361086976/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574624 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574599.331499:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361086976/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574624 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574599.331505:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574599.331507:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574599.331509:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361086976:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574599.331512:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361087104:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788574599.331522:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574599.331527:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574599/real 1788574599]  req@ffff8dc005dc2d80 x1875453361087104/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574624 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574599.331534:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361087104/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574624 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574599.331544:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574599.331546:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574599.331548:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361087104:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574599.331551:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361087232:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574599.331560:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574599.331566:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574599/real 1788574599]  req@ffff8dc005dc1180 x1875453361087232/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574624 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574599.331573:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361087232/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574624 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574599.331578:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574599.331580:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574599.331582:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361087232:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574599.331585:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361087360:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574599.331595:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574599.331600:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574599/real 1788574599]  req@ffff8dc005dc0a80 x1875453361087360/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574624 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574599.331607:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361087360/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574624 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574599.331612:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574599.331613:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574599.331616:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361087360:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574599.714952:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574599.714955:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574599.714955:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574599.714959:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574599.714998:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574599.715018:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574600.355030:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574600.738976:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574600.738977:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574600.738991:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574600.739010:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574600.739029:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788574600.739034:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574601.378971:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574601.762990:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574601.762990:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574601.763017:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574601.763017:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574601.763054:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574601.763093:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574602.403036:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574602.787006:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574602.787006:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574602.787042:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574602.787046:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574602.787056:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574602.787084:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574603.427035:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574603.810982:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574603.810984:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574603.810986:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574603.811016:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574603.811027:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574603.811030:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00080000:1.0:1788574604.450959:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574604.450974:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788574604.450980:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574604.450992:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2950
00000100:00080000:1.0:1788574604.451004:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574604.451013:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788574604.451024:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574604.451066:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361087488/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574604.451090:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574604.451094:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574604.451095:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574604.451099:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2950
00000100:00080000:1.0:1788574604.451102:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574604.451105:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574604.451116:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574604.451130:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361087616/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788574604.451134:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361087488:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574604.451156:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574604.451160:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574604.451161:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574604.451165:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2950
00000100:00080000:1.0:1788574604.451166:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574604.451169:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574604.451173:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574604.451182:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361087744/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574604.451194:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574604.451196:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574604.451198:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574604.451201:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2950
00000100:00080000:1.0:1788574604.451203:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574604.451205:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574604.451208:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574604.451216:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361087872/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574604.451222:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574604.451225:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574604.451227:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574604.451231:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2950
00000100:00080000:1.0:1788574604.451233:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574604.451236:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574604.451239:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788574604.451252:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574604.451253:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361088000/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574604.451267:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574604.451272:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574604.451274:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574604.451281:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2950
00000100:00080000:1.0:1788574604.451287:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574604.451292:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574604.451298:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574604.451311:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361088128/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788574604.451315:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574604/real 1788574604]  req@ffff8dc005dc1500 x1875453361087488/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574629 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574604.451326:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574604.451342:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574604.451345:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574604.451361:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2950
00000100:00080000:1.0:1788574604.451371:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574604.451376:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574604.451381:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574604.451389:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361088256/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788574604.451399:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361087488/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574629 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574604.451415:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574604.451422:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574604.451428:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361087488:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788574604.451455:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361087616:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788574604.451485:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574604.451500:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574604/real 1788574604]  req@ffff8dc005dc0a80 x1875453361087616/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574629 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574604.451523:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361087616/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574629 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574604.451535:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574604.451539:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574604.451543:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361087616:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574604.451551:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361087744:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574604.451575:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574604.451589:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574604/real 1788574604]  req@ffff8dc005dc1180 x1875453361087744/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574629 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574604.451602:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361087744/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574629 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574604.451612:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574604.451615:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574604.451619:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361087744:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574604.451627:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361087872:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574604.451650:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574604.451664:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574604/real 1788574604]  req@ffff8dc005dc2d80 x1875453361087872/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574629 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574604.451677:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361087872/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574629 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574604.451694:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574604.451698:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574604.451702:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361087872:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574604.451709:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361088000:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788574604.451730:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574604.451743:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574604/real 1788574604]  req@ffff8dc005dc3b80 x1875453361088000/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574629 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574604.451756:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361088000/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574629 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574604.451765:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574604.451768:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574604.451772:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361088000:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574604.451779:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361088128:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574604.451803:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574604.451815:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574604/real 1788574604]  req@ffff8dc005dc0700 x1875453361088128/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574629 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574604.451827:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361088128/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574629 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574604.451835:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574604.451839:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574604.451843:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361088128:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574604.451849:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361088256:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574604.451909:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574604.451920:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574604/real 1788574604]  req@ffff8dc005dc3800 x1875453361088256/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574629 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574604.451928:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361088256/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574629 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574604.451934:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574604.451936:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574604.451938:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361088256:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574604.834993:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574604.835018:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574604.835034:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574604.835039:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574604.835049:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574604.835055:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574605.474967:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574605.858967:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574605.859007:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574605.859012:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574605.859016:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574605.859029:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574605.859051:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574606.498980:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574606.882998:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574606.883001:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574606.883003:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574606.883036:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574606.883051:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574606.883069:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574607.523018:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574607.906951:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574607.906966:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574607.906972:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574607.906987:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574607.906994:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574607.907000:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574608.547020:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574608.930970:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574608.930972:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574608.931001:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574608.931033:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574608.931034:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574608.931056:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1788574609.570979:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788574609.570984:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574609.570996:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788574609.571001:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574609.571010:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2955
00000100:00080000:1.0:1788574609.571020:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574609.571027:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574609.571062:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361088384/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574609.571084:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574609.571087:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574609.571088:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574609.571091:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2955
00000100:00080000:1.0:1788574609.571093:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574609.571095:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574609.571103:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574609.571113:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361088512/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574609.571122:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574609.571124:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574609.571125:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574609.571130:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2955
00000100:00100000:3.0:1788574609.571132:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361088384:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574609.571133:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574609.571138:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574609.571146:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574609.571154:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361088640/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574609.571161:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574609.571163:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574609.571165:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574609.571167:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2955
00000100:00080000:1.0:1788574609.571170:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574609.571172:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574609.571175:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574609.571183:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361088768/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574609.571188:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574609.571191:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574609.571192:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574609.571195:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2955
00000100:00080000:1.0:1788574609.571198:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574609.571206:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:3.0:1788574609.571210:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:1.0:1788574609.571212:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574609.571226:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361088896/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574609.571233:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574609.571236:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574609.571237:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574609.571240:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2955
00000100:00080000:1.0:1788574609.571243:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574609.571245:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574609.571250:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574609.571261:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574609/real 1788574609]  req@ffff8dc005dc1c00 x1875453361088384/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574634 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574609.571262:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361089024/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574609.571285:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574609.571291:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574609.571293:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574609.571300:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2955
00000100:00080000:1.0:1788574609.571306:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574609.571311:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574609.571315:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574609.571324:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361089152/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788574609.571324:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361088384/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574634 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574609.571361:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574609.571367:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574609.571373:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361088384:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788574609.571397:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361088512:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788574609.571422:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574609.571436:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574609/real 1788574609]  req@ffff8dc005dc3800 x1875453361088512/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574634 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574609.571451:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361088512/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574634 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574609.571462:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574609.571466:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574609.571469:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361088512:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574609.571476:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361088640:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574609.571508:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574609.571521:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574609/real 1788574609]  req@ffff8dc005dc0700 x1875453361088640/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574634 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574609.571534:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361088640/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574634 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574609.571551:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574609.571554:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574609.571557:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361088640:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574609.571564:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361088768:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574609.571584:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574609.571596:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574609/real 1788574609]  req@ffff8dc005dc3b80 x1875453361088768/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574634 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574609.571610:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361088768/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574634 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574609.571620:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574609.571623:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574609.571627:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361088768:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574609.571645:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361088896:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788574609.571668:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574609.571680:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574609/real 1788574609]  req@ffff8dc005dc2d80 x1875453361088896/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574634 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574609.571694:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361088896/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574634 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574609.571703:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574609.571707:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574609.571711:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361088896:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574609.571718:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361089024:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574609.571739:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574609.571751:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574609/real 1788574609]  req@ffff8dc005dc1180 x1875453361089024/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574634 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574609.571764:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361089024/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574634 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574609.571772:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574609.571776:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574609.571780:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361089024:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574609.571786:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361089152:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574609.571806:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574609.571818:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574609/real 1788574609]  req@ffff8dc005dc0a80 x1875453361089152/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574634 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574609.571830:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361089152/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574634 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574609.571837:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574609.571841:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574609.571845:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361089152:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574609.954958:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574609.954964:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574609.954994:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574609.955009:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574609.955011:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574609.955026:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574610.594974:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574610.979034:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574610.979034:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574610.979041:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574610.979068:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574610.979080:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574610.979088:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574611.618946:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574612.003013:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574612.003013:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574612.003072:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574612.003079:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574612.003083:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574612.003138:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574612.642963:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574613.026978:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574613.026978:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574613.026992:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574613.027004:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574613.027015:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574613.027017:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574613.667035:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574614.050997:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574614.051006:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574614.051017:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574614.051064:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574614.051071:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574614.051073:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574614.690994:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788574614.691015:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574614.691023:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788574614.691028:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574614.691038:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2960
00000100:00080000:2.0:1788574614.691048:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574614.691055:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574614.691094:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361089280/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574614.691120:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574614.691123:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574614.691124:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574614.691127:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2960
00000100:00080000:2.0:1788574614.691131:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574614.691136:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574614.691145:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574614.691159:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361089280:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788574614.691161:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361089408/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574614.691175:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574614.691179:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574614.691180:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574614.691185:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2960
00000100:00080000:2.0:1788574614.691190:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574614.691204:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574614.691210:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788574614.691215:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574614.691222:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453361089536/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574614.691233:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574614.691236:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574614.691237:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574614.691240:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2960
00000100:00080000:2.0:1788574614.691243:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574614.691246:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574614.691249:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574614.691254:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574614/real 1788574614]  req@ffff8dc020495880 x1875453361089280/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574639 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574614.691260:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453361089664/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574614.691274:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574614.691277:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574614.691279:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788574614.691281:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361089280/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574639 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574614.691285:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2960
00000100:00080000:2.0:1788574614.691290:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574614.691296:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574614.691301:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788574614.691302:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574614.691308:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574614.691311:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453361089792/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788574614.691314:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361089280:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788574614.691327:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574614.691330:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574614.691332:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574614.691335:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2960
00000100:00080000:2.0:1788574614.691338:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574614.691342:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788574614.691342:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361089408:192.168.202.140@tcp:38:kworker.0
00000008:00100000:2.0:1788574614.691349:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574614.691360:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453361089920/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574614.691367:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1788574614.691370:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788574614.691373:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574614.691376:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574614.691380:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2960
00000100:00080000:2.0:1788574614.691383:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788574614.691386:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574614/real 1788574614]  req@ffff8dc020494700 x1875453361089408/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574639 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574614.691388:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574614.691394:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574614.691405:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361089408/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574639 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574614.691408:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361090048/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574614.691429:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574614.691434:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574614.691437:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361089408:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574614.691443:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361089536:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574614.691457:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574614.691463:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574614/real 1788574614]  req@ffff8dc020494380 x1875453361089536/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574639 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574614.691471:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453361089536/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574639 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574614.691477:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574614.691479:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574614.691481:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361089536:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574614.691485:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361089664:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574614.691494:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574614.691500:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574614/real 1788574614]  req@ffff8dc020496a00 x1875453361089664/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574639 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574614.691507:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453361089664/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574639 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574614.691512:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574614.691514:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574614.691516:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361089664:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574614.691519:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361089792:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788574614.691529:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574614.691535:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574614/real 1788574614]  req@ffff8dc020497100 x1875453361089792/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574639 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574614.691542:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453361089792/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574639 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574614.691548:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574614.691549:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574614.691551:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361089792:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574614.691562:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361089920:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574614.691572:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574614.691578:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574614/real 1788574614]  req@ffff8dc020494e00 x1875453361089920/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574639 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574614.691586:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453361089920/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574639 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574614.691591:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574614.691592:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574614.691594:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361089920:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574614.691598:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361090048:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574614.691607:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574614.691613:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574614/real 1788574614]  req@ffff8dc020495880 x1875453361090048/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574639 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574614.691620:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361090048/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574639 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574614.691626:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574614.691628:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574614.691630:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361090048:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574615.074952:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574615.074955:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574615.074970:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574615.074988:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574615.075002:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574615.075058:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574615.715056:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574616.099028:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574616.099028:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574616.099028:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574616.099031:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574616.099097:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574616.099169:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574616.738964:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574617.122935:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574617.122959:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574617.122984:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574617.122995:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574617.122996:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574617.123059:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574617.763006:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574618.146987:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574618.146987:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574618.147016:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574618.147041:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574618.147056:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574618.147073:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574618.786966:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574619.170994:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574619.170994:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574619.171010:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574619.171021:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574619.171030:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574619.171044:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00080000:2.0:1788574619.810942:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788574619.810944:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788574619.810952:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788574619.810956:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574619.810965:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2965
00000100:00080000:2.0:1788574619.810973:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574619.810980:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574619.811011:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361090176/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574619.811034:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574619.811036:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574619.811042:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574619.811045:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2965
00000100:00080000:2.0:1788574619.811047:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574619.811050:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574619.811058:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574619.811067:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453361090304/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574619.811075:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574619.811078:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574619.811079:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574619.811085:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2965
00000100:00100000:3.0:1788574619.811087:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361090176:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788574619.811089:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574619.811097:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574619.811104:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574619.811118:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453361090432/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574619.811137:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574619.811140:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574619.811142:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574619.811147:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2965
00000100:00080000:2.0:1788574619.811150:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574619.811153:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574619.811157:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574619.811167:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361090560/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574619.811174:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574619.811177:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574619.811179:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574619.811183:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2965
00000100:00080000:2.0:1788574619.811185:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788574619.811188:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361090304:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788574619.811192:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574619.811198:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574619.811207:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361090688/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574619.811215:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574619.811218:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574619.811219:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574619.811223:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2965
00000100:00080000:2.0:1788574619.811227:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788574619.811231:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361090432:192.168.202.140@tcp:8:kworker.0
00000100:00080000:2.0:1788574619.811234:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574619.811240:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574619.811251:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453361090816/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574619.811260:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788574619.811261:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361090560:192.168.202.140@tcp:8:kworker.0
00000100:00080000:2.0:1788574619.811269:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574619.811272:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574619.811276:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2965
00000100:00080000:2.0:1788574619.811279:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574619.811281:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574619.811284:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574619.811295:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361090944/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788574619.811298:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361090688:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574619.811331:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361090816:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574619.811345:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361090944:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574620.194968:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574620.194968:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574620.194969:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574620.194998:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574620.194999:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574620.195009:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574620.835058:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574621.218970:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574621.218970:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574621.218973:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574621.218995:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574621.219005:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574621.219006:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574621.859049:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574622.243028:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574622.243028:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574622.243047:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574622.243074:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574622.243077:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574622.243094:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574622.883133:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000400:00000100:3.0:1788574622.883271:0:2334:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.140:988
00000400:00000100:3.0:1788574622.883315:0:2334:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.140@tcp at host 192.168.202.140 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:3.0:1788574622.883332:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788574622.883377:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788574622.883391:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788574622.883403:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788574622.883416:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:1.0:1788574622.883419:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574619/real 1788574622]  req@ffff8dc020496d80 x1875453361090432/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574644 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:3.0:1788574622.883428:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788574622.883442:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:1.0:1788574622.883460:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453361090432/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574644 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574622.883475:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574622.883481:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574622.883485:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361090432:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574622.883493:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574619/real 1788574622]  req@ffff8dc020495180 x1875453361090560/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574644 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574622.883506:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361090560/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574644 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574622.883516:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574622.883520:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574622.883523:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361090560:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574622.883530:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574619/real 1788574622]  req@ffff8dc020494000 x1875453361090688/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574644 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574622.883543:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361090688/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574644 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574622.883551:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574622.883554:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574622.883557:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361090688:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574622.883564:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574619/real 1788574622]  req@ffff8dc020495500 x1875453361090176/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574644 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574622.883575:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361090176/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574644 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574622.883582:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574622.883585:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574622.883588:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361090176:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788574622.883594:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574619/real 1788574622]  req@ffff8dc020494a80 x1875453361090304/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574644 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574622.883606:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453361090304/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574644 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574622.883615:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574622.883618:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574622.883621:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361090304:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574622.883649:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574619/real 1788574622]  req@ffff8dc020497480 x1875453361090816/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574644 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574622.883662:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453361090816/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574644 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574622.883671:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574622.883674:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574622.883677:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361090816:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574622.883683:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574619/real 1788574622]  req@ffff8dc020495880 x1875453361090944/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574644 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574622.883695:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361090944/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574644 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574622.883702:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574622.883705:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574622.883709:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361090944:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574623.266983:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574623.266986:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574623.266987:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574623.266999:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574623.267020:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574623.267023:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574623.907039:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574624.290979:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574624.290979:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574624.290980:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574624.291013:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574624.291014:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574624.291029:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00080000:2.0:1788574624.931004:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574624.931017:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788574624.931022:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574624.931033:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2970
00000100:00080000:2.0:1788574624.931046:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574624.931056:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574624.931059:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574624.931101:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453361091072/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574624.931140:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574624.931144:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574624.931146:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574624.931151:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2970
00000100:00080000:2.0:1788574624.931157:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574624.931162:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574624.931172:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574624.931178:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361091072:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788574624.931202:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453361091200/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574624.931218:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574624.931222:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574624.931225:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574624.931231:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2970
00000100:00080000:2.0:1788574624.931236:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574624.931242:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574624.931249:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574624.931263:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453361091328/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1788574624.931288:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788574624.931294:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574624.931301:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574624.931304:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574624.931313:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2970
00000100:00080000:2.0:1788574624.931320:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574624.931325:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574624.931332:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574624.931352:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453361091456/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574624.931361:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574624/real 1788574624]  req@ffff8dc020494e00 x1875453361091072/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574649 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574624.931374:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574624.931383:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574624.931388:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574624.931394:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2970
00000100:00100000:0.0:1788574624.931401:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453361091072/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574649 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574624.931407:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574624.931423:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:0.0:1788574624.931427:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:2.0:1788574624.931432:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1788574624.931439:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574624.931450:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361091072:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788574624.931461:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361091584/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574624.931473:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574624.931478:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574624.931480:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574624.931491:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2970
00000100:00100000:0.0:1788574624.931499:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361091200:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788574624.931499:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574624.931513:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574624.931527:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574624.931551:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453361091712/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1788574624.931565:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788574624.931572:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574624.931579:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574624.931582:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574624.931594:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2970
00000100:00100000:0.0:1788574624.931597:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574624/real 1788574624]  req@ffff8dc020497100 x1875453361091200/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574649 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574624.931603:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574624.931617:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574624.931625:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453361091200/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574649 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1788574624.931626:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1788574624.931656:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1788574624.931663:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361091840/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574624.931667:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574624.931679:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361091200:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574624.931694:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361091328:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574624.931733:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574624.931764:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574624/real 1788574624]  req@ffff8dc020496a00 x1875453361091328/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574649 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574624.931779:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453361091328/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574649 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574624.931791:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574624.931797:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574624.931801:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361091328:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574624.931809:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361091456:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574624.931835:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574624.931848:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574624/real 1788574624]  req@ffff8dc020494380 x1875453361091456/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574649 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574624.931894:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453361091456/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574649 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574624.931905:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574624.931910:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574624.931913:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361091456:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574624.931920:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361091584:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574624.931944:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574624.931957:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574624/real 1788574624]  req@ffff8dc020494700 x1875453361091584/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574649 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574624.931968:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361091584/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574649 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574624.931978:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574624.931982:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574624.931985:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361091584:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574624.932009:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361091712:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574624.932030:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574624.932042:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574624/real 1788574624]  req@ffff8dc020494e00 x1875453361091712/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574649 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574624.932053:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453361091712/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574649 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574624.932067:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574624.932070:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574624.932073:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361091712:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574624.932080:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361091840:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574624.932099:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574624.932110:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574624/real 1788574624]  req@ffff8dc020495880 x1875453361091840/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574649 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574624.932122:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361091840/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574649 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574624.932130:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574624.932133:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574624.932137:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361091840:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574625.314991:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574625.314991:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574625.315019:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574625.315034:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574625.315035:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574625.315049:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574625.955082:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574626.338980:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574626.338985:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574626.339016:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574626.339125:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574626.339132:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574626.339142:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574626.978959:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574627.362956:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574627.362956:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574627.362959:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574627.362963:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574627.362992:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574627.363017:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574628.002977:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574628.387015:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574628.387015:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574628.387015:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574628.387022:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574628.387087:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574628.387127:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574629.026955:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574629.410959:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574629.410985:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574629.410998:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574629.411023:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574629.411035:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574629.411082:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574630.051022:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788574630.051029:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574630.051035:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788574630.051039:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574630.051047:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2975
00000100:00080000:3.0:1788574630.051056:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574630.051062:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788574630.051093:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ed80 x1875453361091968/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574630.051119:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574630.051122:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574630.051123:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574630.051126:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2975
00000100:00080000:3.0:1788574630.051128:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574630.051131:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574630.051140:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574630.051149:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644fb80 x1875453361092096/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574630.051159:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574630.051164:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:0.0:1788574630.051165:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361091968:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788574630.051166:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574630.051176:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2975
00000100:00080000:3.0:1788574630.051186:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574630.051190:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574630.051193:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574630.051214:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d880 x1875453361092224/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574630.051220:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574630.051223:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574630.051224:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574630.051227:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2975
00000100:00080000:3.0:1788574630.051231:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574630.051234:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574630.051238:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574630.051245:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f100 x1875453361092352/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574630.051251:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574630.051254:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574630.051255:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574630.051260:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2975
00000800:00000100:0.0:1788574630.051270:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788574630.051270:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574630.051280:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574630.051284:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574630.051292:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644df80 x1875453361092480/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574630.051299:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574630.051302:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574630.051304:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574630.051307:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2975
00000100:00080000:3.0:1788574630.051310:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574630.051312:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574630.051315:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574630.051321:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e300 x1875453361092608/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574630.051332:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574630.051335:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574630.051337:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574630.051341:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2975
00000100:00080000:3.0:1788574630.051345:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788574630.051347:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574630/real 1788574630]  req@ffff8dc00644ed80 x1875453361091968/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574655 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574630.051350:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574630.051355:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574630.051371:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c700 x1875453361092736/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574630.051392:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ed80 x1875453361091968/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574655 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574630.051405:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574630.051410:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574630.051414:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361091968:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788574630.051439:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361092096:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574630.051470:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574630.051485:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574630/real 1788574630]  req@ffff8dc00644fb80 x1875453361092096/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574655 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574630.051494:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644fb80 x1875453361092096/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574655 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574630.051502:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574630.051505:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574630.051507:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361092096:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574630.051512:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361092224:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574630.051527:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574630.051533:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574630/real 1788574630]  req@ffff8dc00644d880 x1875453361092224/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574655 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574630.051547:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d880 x1875453361092224/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574655 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574630.051553:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574630.051555:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574630.051557:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361092224:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574630.051561:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361092352:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574630.051573:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574630.051579:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574630/real 1788574630]  req@ffff8dc00644f100 x1875453361092352/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574655 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574630.051587:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f100 x1875453361092352/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574655 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574630.051593:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574630.051595:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574630.051597:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361092352:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574630.051601:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361092480:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574630.051613:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574630.051619:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574630/real 1788574630]  req@ffff8dc00644df80 x1875453361092480/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574655 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574630.051627:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644df80 x1875453361092480/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574655 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574630.051638:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574630.051641:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574630.051643:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361092480:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574630.051647:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361092608:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574630.051658:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574630.051664:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574630/real 1788574630]  req@ffff8dc00644e300 x1875453361092608/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574655 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574630.051671:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453361092608/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574655 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574630.051677:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574630.051679:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574630.051680:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361092608:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574630.051684:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361092736:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574630.051714:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574630.051722:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574630/real 1788574630]  req@ffff8dc00644c700 x1875453361092736/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574655 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574630.051730:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453361092736/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574655 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574630.051736:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574630.051738:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574630.051741:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361092736:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574630.435008:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574630.435008:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574630.435015:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574630.435015:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574630.435065:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574630.435113:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574631.074970:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574631.458988:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574631.458996:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574631.458996:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574631.459128:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574631.459135:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574631.459196:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574632.099006:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574632.482975:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574632.482975:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574632.482975:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574632.483001:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574632.483033:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574632.483073:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574633.122972:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574633.506964:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574633.506998:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574633.507003:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574633.507018:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574633.507039:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574633.507042:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574634.146980:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574634.530963:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574634.530971:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574634.531016:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574634.531021:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574634.531023:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574634.531037:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00080000:3.0:1788574635.170978:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574635.170986:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788574635.170990:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574635.170998:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2980
00000100:00080000:3.0:1788574635.171008:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574635.171015:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788574635.171052:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e680 x1875453361092864/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574635.171062:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788574635.171075:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574635.171078:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574635.171080:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574635.171091:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2980
00000100:00080000:3.0:1788574635.171094:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574635.171097:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574635.171106:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574635.171116:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d180 x1875453361092992/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574635.171125:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574635.171128:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574635.171130:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788574635.171134:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361092864:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788574635.171135:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2980
00000100:00080000:3.0:1788574635.171140:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574635.171146:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574635.171150:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574635.171158:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f480 x1875453361093120/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574635.171164:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574635.171167:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574635.171168:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574635.171172:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2980
00000100:00080000:3.0:1788574635.171174:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574635.171177:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574635.171181:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574635.171188:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c380 x1875453361093248/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574635.171193:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574635.171195:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574635.171197:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574635.171199:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2980
00000100:00080000:3.0:1788574635.171202:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1788574635.171206:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788574635.171207:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574635.171213:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574635.171219:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d500 x1875453361093376/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574635.171225:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574635.171228:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574635.171230:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574635.171234:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2980
00000100:00080000:3.0:1788574635.171237:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574635.171240:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574635.171243:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574635.171250:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ea00 x1875453361093504/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574635.171256:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574635.171259:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574635.171260:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574635.171263:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2980
00000100:00080000:3.0:1788574635.171266:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788574635.171268:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574635/real 1788574635]  req@ffff8dc00644e680 x1875453361092864/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574660 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574635.171270:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574635.171275:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574635.171286:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ca80 x1875453361093632/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574635.171298:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453361092864/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574660 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574635.171312:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574635.171318:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574635.171322:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361092864:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788574635.171348:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361092992:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574635.171371:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574635.171390:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574635/real 1788574635]  req@ffff8dc00644d180 x1875453361092992/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574660 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574635.171399:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453361092992/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574660 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574635.171411:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574635.171413:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574635.171416:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361092992:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574635.171420:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361093120:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574635.171435:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574635.171441:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574635/real 1788574635]  req@ffff8dc00644f480 x1875453361093120/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574660 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574635.171449:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453361093120/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574660 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574635.171454:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574635.171456:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574635.171458:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361093120:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574635.171462:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361093248:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574635.171472:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574635.171478:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574635/real 1788574635]  req@ffff8dc00644c380 x1875453361093248/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574660 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574635.171493:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453361093248/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574660 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574635.171499:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574635.171501:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574635.171504:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361093248:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574635.171508:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361093376:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574635.171519:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574635.171526:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574635/real 1788574635]  req@ffff8dc00644d500 x1875453361093376/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574660 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574635.171533:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d500 x1875453361093376/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574660 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574635.171539:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574635.171541:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574635.171544:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361093376:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574635.171550:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361093504:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574635.171569:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574635.171580:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574635/real 1788574635]  req@ffff8dc00644ea00 x1875453361093504/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574660 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574635.171593:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ea00 x1875453361093504/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574660 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574635.171601:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574635.171604:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574635.171607:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361093504:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574635.171614:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361093632:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574635.171634:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574635.171680:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574635/real 1788574635]  req@ffff8dc00644ca80 x1875453361093632/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574660 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574635.171694:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ca80 x1875453361093632/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574660 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574635.171702:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574635.171705:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574635.171708:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361093632:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574635.554971:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574635.554973:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574635.554993:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574635.555008:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574635.555022:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574635.555060:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574636.195018:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574636.578937:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574636.578939:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574636.578968:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574636.578994:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574636.579021:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574636.579041:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574637.218977:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574637.602970:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574637.602976:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574637.603005:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574637.603017:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574637.603027:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574637.603028:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574638.243048:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574638.626925:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574638.626958:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574638.626970:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574638.626976:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574638.627006:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574638.627020:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574639.266993:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574639.650992:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574639.650992:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574639.651000:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574639.651028:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574639.651030:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574639.651034:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00080000:2.0:1788574640.290965:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788574640.290973:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788574640.290974:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788574640.290978:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574640.290987:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2985
00000100:00080000:2.0:1788574640.290997:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574640.291005:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574640.291044:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453361093760/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574640.291067:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574640.291069:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574640.291071:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574640.291074:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2985
00000100:00080000:2.0:1788574640.291077:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574640.291080:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574640.291089:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574640.291100:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453361093888/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574640.291107:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574640.291110:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574640.291112:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574640.291115:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2985
00000100:00080000:2.0:1788574640.291117:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574640.291120:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574640.291124:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574640.291133:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361093760:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788574640.291137:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361094016/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574640.291153:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574640.291156:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574640.291157:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574640.291160:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2985
00000100:00080000:2.0:1788574640.291162:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574640.291164:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574640.291167:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574640.291176:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361094144/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574640.291181:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574640.291183:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574640.291184:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574640.291188:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2985
00000100:00080000:2.0:1788574640.291190:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574640.291192:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574640.291195:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574640.291202:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361094272/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574640.291207:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574640.291210:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574640.291211:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574640.291214:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2985
00000100:00080000:2.0:1788574640.291216:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574640.291218:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574640.291223:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788574640.291243:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574640.291244:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453361094400/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574640.291256:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574640.291258:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574640.291260:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574640.291264:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2985
00000100:00080000:2.0:1788574640.291267:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574640.291270:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574640.291275:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574640.291286:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361094528/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574640.291317:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574640/real 1788574640]  req@ffff8dc020497480 x1875453361093760/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574665 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574640.291343:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453361093760/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574665 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574640.291356:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574640.291361:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574640.291367:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361093760:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788574640.291375:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361093888:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574640.291398:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574640.291408:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574640/real 1788574640]  req@ffff8dc020494a80 x1875453361093888/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574665 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574640.291417:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453361093888/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574665 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574640.291425:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574640.291428:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574640.291430:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361093888:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574640.291456:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361094016:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574640.291470:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574640.291477:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574640/real 1788574640]  req@ffff8dc020495500 x1875453361094016/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574665 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574640.291484:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361094016/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574665 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574640.291491:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574640.291493:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574640.291495:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361094016:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574640.291499:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361094144:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574640.291509:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574640.291516:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574640/real 1788574640]  req@ffff8dc020494000 x1875453361094144/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574665 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574640.291527:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361094144/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574665 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574640.291536:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574640.291540:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574640.291543:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361094144:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574640.291550:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361094272:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574640.291572:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574640.291599:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574640/real 1788574640]  req@ffff8dc020495180 x1875453361094272/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574665 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574640.291610:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361094272/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574665 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574640.291617:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574640.291619:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574640.291622:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361094272:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574640.291626:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361094400:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574640.291642:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574640.291649:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574640/real 1788574640]  req@ffff8dc020496d80 x1875453361094400/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574665 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574640.291657:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453361094400/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574665 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574640.291663:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574640.291665:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574640.291667:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361094400:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574640.291671:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361094528:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574640.291682:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574640.291688:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574640/real 1788574640]  req@ffff8dc020495880 x1875453361094528/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574665 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574640.291695:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361094528/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574665 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574640.291700:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574640.291703:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574640.291704:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361094528:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574640.674988:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574640.674993:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574640.675026:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574640.675026:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574640.675034:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574640.675061:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574641.314970:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574641.699019:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574641.699019:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574641.699029:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574641.699058:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574641.699063:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574641.699072:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574642.339032:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574642.723012:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574642.723061:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574642.723073:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574642.723074:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574642.723080:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574642.723104:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574643.362973:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574643.747020:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574643.747020:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574643.747021:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574643.747024:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574643.747087:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574643.747122:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574644.386977:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574644.770965:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574644.770965:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574644.770967:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574644.771009:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574644.771021:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574644.771024:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00080000:3.0:1788574645.410989:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788574645.410996:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788574645.411002:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788574645.411008:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574645.411018:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2991
00000100:00080000:3.0:1788574645.411029:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574645.411037:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788574645.411082:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ce00 x1875453361094656/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574645.411110:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574645.411113:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574645.411114:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574645.411117:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2991
00000100:00080000:3.0:1788574645.411120:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574645.411122:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574645.411133:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574645.411142:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f800 x1875453361094784/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574645.411149:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574645.411151:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574645.411152:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574645.411155:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2991
00000100:00080000:3.0:1788574645.411157:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574645.411159:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574645.411162:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574645.411170:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c000 x1875453361094912/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574645.411178:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574645.411181:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574645.411183:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574645.411185:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2991
00000100:00080000:3.0:1788574645.411187:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574645.411189:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574645.411193:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574645.411198:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361094656:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788574645.411203:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644dc00 x1875453361095040/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574645.411211:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574645.411213:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574645.411214:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574645.411217:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2991
00000100:00080000:3.0:1788574645.411219:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574645.411222:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574645.411226:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574645.411234:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ca80 x1875453361095168/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574645.411240:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574645.411243:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574645.411244:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574645.411248:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2991
00000100:00080000:3.0:1788574645.411251:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574645.411254:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574645.411258:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574645.411265:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ea00 x1875453361095296/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574645.411270:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574645.411272:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574645.411274:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574645.411277:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2991
00000100:00080000:3.0:1788574645.411280:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1788574645.411281:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788574645.411285:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574645.411289:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574645.411296:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d500 x1875453361095424/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574645.411331:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574645/real 1788574645]  req@ffff8dc00644ce00 x1875453361094656/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574670 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574645.411348:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ce00 x1875453361094656/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574670 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574645.411357:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574645.411360:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574645.411364:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361094656:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788574645.411369:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361094784:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574645.411385:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574645.411393:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574645/real 1788574645]  req@ffff8dc00644f800 x1875453361094784/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574670 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574645.411402:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f800 x1875453361094784/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574670 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574645.411410:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574645.411412:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574645.411414:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361094784:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574645.411417:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361094912:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574645.411429:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574645.411435:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574645/real 1788574645]  req@ffff8dc00644c000 x1875453361094912/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574670 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574645.411442:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c000 x1875453361094912/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574670 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574645.411453:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574645.411456:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574645.411458:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361094912:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574645.411480:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361095040:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574645.411490:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574645.411496:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574645/real 1788574645]  req@ffff8dc00644dc00 x1875453361095040/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574670 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574645.411503:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644dc00 x1875453361095040/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574670 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574645.411510:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574645.411512:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574645.411513:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361095040:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574645.411517:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361095168:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574645.411528:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574645.411550:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574645/real 1788574645]  req@ffff8dc00644ca80 x1875453361095168/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574670 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574645.411558:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ca80 x1875453361095168/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574670 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574645.411565:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574645.411567:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574645.411570:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361095168:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574645.411574:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361095296:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574645.411586:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574645.411592:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574645/real 1788574645]  req@ffff8dc00644ea00 x1875453361095296/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574670 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574645.411600:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ea00 x1875453361095296/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574670 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574645.411605:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574645.411606:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574645.411608:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361095296:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574645.411612:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361095424:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574645.411622:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574645.411627:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574645/real 1788574645]  req@ffff8dc00644d500 x1875453361095424/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574670 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574645.411635:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d500 x1875453361095424/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574670 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574645.411640:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574645.411642:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574645.411644:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361095424:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574645.794996:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574645.794996:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574645.794999:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574645.795006:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574645.795052:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574645.795091:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574646.434973:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574646.818956:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574646.819006:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574646.819009:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574646.819014:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574646.819025:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574646.819054:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574647.459015:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574647.842979:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574647.842994:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574647.842994:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574647.842995:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574647.843045:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574647.843080:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574648.482931:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574648.867000:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574648.867003:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574648.867009:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574648.867025:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574648.867035:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788574648.867068:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574649.506988:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574649.890971:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574649.890979:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574649.891010:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574649.891025:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574649.891030:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574649.891039:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574650.530992:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788574650.530993:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574650.531002:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788574650.531006:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574650.531014:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 2996
00000100:00080000:3.0:1788574650.531023:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574650.531030:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788574650.531067:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c380 x1875453361095552/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574650.531093:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574650.531098:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574650.531100:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574650.531106:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2996
00000100:00080000:3.0:1788574650.531111:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574650.531115:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574650.531121:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361095552:192.168.202.140@tcp:250:kworker.0
00000008:00100000:3.0:1788574650.531125:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574650.531139:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f480 x1875453361095680/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574650.531148:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574650.531151:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574650.531153:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574650.531155:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2996
00000100:00080000:3.0:1788574650.531159:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574650.531162:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574650.531165:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574650.531175:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d180 x1875453361095808/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1788574650.531182:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788574650.531188:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574650.531191:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574650.531192:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574650.531196:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 2996
00000100:00080000:3.0:1788574650.531199:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574650.531201:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574650.531205:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574650.531213:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e680 x1875453361095936/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574650.531221:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788574650.531222:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574650/real 1788574650]  req@ffff8dc00644c380 x1875453361095552/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574675 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574650.531226:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574650.531230:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574650.531239:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2996
00000100:00080000:3.0:1788574650.531242:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574650.531245:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574650.531249:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574650.531250:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453361095552/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574675 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574650.531258:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c700 x1875453361096064/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574650.531260:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574650.531268:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788574650.531273:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788574650.531275:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361095552:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788574650.531278:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574650.531281:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574650.531287:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2996
00000100:00080000:3.0:1788574650.531289:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574650.531292:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574650.531295:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574650.531300:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361095680:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574650.531304:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e300 x1875453361096192/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574650.531313:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574650.531316:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574650.531318:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574650.531321:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 2996
00000800:00000100:0.0:1788574650.531326:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788574650.531327:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574650.531332:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574650.531336:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574650.531341:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574650/real 1788574650]  req@ffff8dc00644f480 x1875453361095680/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574675 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574650.531347:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644df80 x1875453361096320/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574650.531355:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453361095680/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574675 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574650.531364:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574650.531368:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574650.531372:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361095680:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574650.531377:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361095808:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574650.531391:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574650.531398:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574650/real 1788574650]  req@ffff8dc00644d180 x1875453361095808/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574675 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574650.531406:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453361095808/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574675 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574650.531411:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574650.531413:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574650.531415:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361095808:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574650.531419:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361095936:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574650.531429:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574650.531434:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574650/real 1788574650]  req@ffff8dc00644e680 x1875453361095936/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574675 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574650.531442:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453361095936/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574675 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574650.531447:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574650.531449:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574650.531451:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361095936:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574650.531454:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361096064:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574650.531463:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574650.531470:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574650/real 1788574650]  req@ffff8dc00644c700 x1875453361096064/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574675 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574650.531477:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453361096064/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574675 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574650.531496:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574650.531498:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574650.531501:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361096064:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574650.531512:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361096192:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574650.531526:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574650.531533:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574650/real 1788574650]  req@ffff8dc00644e300 x1875453361096192/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574675 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574650.531541:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453361096192/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574675 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574650.531546:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574650.531548:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574650.531550:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361096192:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574650.531553:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361096320:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574650.531567:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574650.531577:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574650/real 1788574650]  req@ffff8dc00644df80 x1875453361096320/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574675 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574650.531588:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644df80 x1875453361096320/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574675 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574650.531598:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574650.531602:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574650.531606:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361096320:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574650.914982:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574650.914987:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574650.914988:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574650.915013:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574650.915039:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788574650.915083:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574651.555005:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574651.938961:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574651.938988:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574651.939013:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574651.939029:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788574651.939034:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574651.939065:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574652.578934:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574652.962988:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574652.963002:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574652.963021:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574652.963045:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574652.963077:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788574652.963077:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574653.603048:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574653.987002:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574653.987047:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574653.987050:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574653.987067:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574653.987097:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574653.987100:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574654.626975:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574655.011010:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574655.011010:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574655.011026:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574655.011028:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574655.011078:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788574655.011139:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1788574655.651063:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788574655.651068:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574655.651078:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788574655.651086:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574655.651100:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3001
00000100:00080000:0.0:1788574655.651115:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574655.651127:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574655.651180:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361096448/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574655.651211:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574655.651214:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574655.651216:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574655.651220:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3001
00000100:00080000:0.0:1788574655.651223:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574655.651226:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574655.651238:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574655.651248:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361096576/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574655.651257:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574655.651260:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574655.651261:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574655.651266:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3001
00000100:00080000:0.0:1788574655.651268:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788574655.651269:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361096448:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788574655.651272:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574655.651278:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574655.651286:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361096704/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574655.651293:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574655.651296:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574655.651297:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574655.651300:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3001
00000100:00080000:0.0:1788574655.651302:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574655.651305:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574655.651308:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574655.651316:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361096832/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574655.651329:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574655.651333:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574655.651335:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574655.651338:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3001
00000100:00080000:0.0:1788574655.651349:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574655.651352:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574655.651356:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1788574655.651365:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574655.651366:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361096960/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574655.651374:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574655.651377:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574655.651379:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574655.651382:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3001
00000100:00080000:0.0:1788574655.651384:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574655.651387:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574655.651390:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574655.651400:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361097088/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574655.651406:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574655.651409:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574655.651411:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574655.651413:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3001
00000100:00080000:0.0:1788574655.651416:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574655.651418:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574655.651422:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574655.651445:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361097216/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574655.651445:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574655/real 1788574655]  req@ffff8dc006710e00 x1875453361096448/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574680 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574655.651485:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361096448/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574680 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574655.651498:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574655.651503:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574655.651508:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361096448:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788574655.651536:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361096576:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574655.651564:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574655.651579:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574655/real 1788574655]  req@ffff8dc006713b80 x1875453361096576/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574680 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574655.651593:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361096576/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574680 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574655.651604:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574655.651608:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574655.651612:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361096576:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574655.651619:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361096704:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574655.651643:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574655.651657:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574655/real 1788574655]  req@ffff8dc006713100 x1875453361096704/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574680 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574655.651670:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361096704/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574680 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574655.651680:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574655.651684:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574655.651687:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361096704:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574655.651694:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361096832:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574655.651716:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574655.651728:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574655/real 1788574655]  req@ffff8dc006712a00 x1875453361096832/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574680 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574655.651740:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361096832/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574680 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574655.651750:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574655.651753:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574655.651757:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361096832:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574655.651763:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361096960:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574655.651784:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574655.651796:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574655/real 1788574655]  req@ffff8dc006713800 x1875453361096960/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574680 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574655.651816:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361096960/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574680 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574655.651826:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574655.651829:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574655.651832:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361096960:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574655.651839:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361097088:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574655.651859:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574655.651907:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574655/real 1788574655]  req@ffff8dc006711880 x1875453361097088/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574680 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574655.651921:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361097088/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574680 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574655.651929:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574655.651933:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574655.651936:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361097088:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574655.651943:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361097216:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574655.651964:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574655.651977:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574655/real 1788574655]  req@ffff8dc006712300 x1875453361097216/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574680 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574655.651990:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361097216/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574680 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574655.652004:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574655.652007:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574655.652011:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361097216:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574656.034959:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574656.034975:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574656.034979:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574656.035003:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788574656.035009:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574656.035027:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574656.674959:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574657.058942:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574657.058981:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574657.058981:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574657.058996:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574657.059022:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788574657.059067:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574657.698992:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574658.082993:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574658.083002:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574658.083018:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788574658.083058:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574658.083071:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574658.083098:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574658.722982:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574659.106992:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574659.106993:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574659.107002:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574659.107047:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574659.107048:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574659.107058:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574659.746955:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574660.131018:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574660.131030:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574660.131031:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574660.131033:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574660.131081:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574660.131164:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574660.770986:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574660.771009:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574660.771022:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788574660.771028:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574660.771051:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3006
00000100:00080000:0.0:1788574660.771066:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574660.771077:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574660.771131:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361097344/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574660.771168:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574660.771173:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574660.771175:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574660.771191:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3006
00000100:00080000:0.0:1788574660.771200:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574660.771206:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574660.771216:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361097344:192.168.202.140@tcp:250:kworker.0
00000008:00100000:0.0:1788574660.771220:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574660.771244:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361097472/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574660.771257:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574660.771262:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574660.771264:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574660.771269:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3006
00000100:00080000:0.0:1788574660.771273:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574660.771279:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574660.771286:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574660.771312:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453361097600/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574660.771326:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1788574660.771326:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788574660.771332:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574660.771334:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574660.771340:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3006
00000100:00080000:0.0:1788574660.771346:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574660.771352:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574660.771358:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574660.771374:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361097728/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574660.771412:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574660/real 1788574660]  req@ffff8dc006711500 x1875453361097344/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574685 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574660.771419:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574660.771428:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574660.771433:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574660.771441:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3006
00000100:00080000:0.0:1788574660.771447:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788574660.771451:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361097344/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574685 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574660.771456:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574660.771468:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1788574660.771473:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574660.771480:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574660.771486:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361097856/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574660.771490:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361097344:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788574660.771507:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574660.771512:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574660.771514:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574660.771521:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3006
00000100:00080000:0.0:1788574660.771525:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788574660.771530:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361097472:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788574660.771532:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574660.771542:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574660.771559:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361097984/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788574660.771566:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788574660.771581:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788574660.771582:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574660/real 1788574660]  req@ffff8dc006711c00 x1875453361097472/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574685 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574660.771591:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574660.771597:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1788574660.771602:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361097472/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574685 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574660.771607:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3006
00000100:00080000:0.0:1788574660.771615:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574660.771621:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:1.0:1788574660.771621:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574660.771629:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000008:00100000:0.0:1788574660.771631:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574660.771644:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361097472:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574660.771645:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361098112/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574660.771659:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361097600:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574660.771678:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574660.771687:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574660/real 1788574660]  req@ffff8dc006710380 x1875453361097600/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574685 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574660.771697:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453361097600/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574685 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574660.771704:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574660.771706:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574660.771708:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361097600:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574660.771712:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361097728:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574660.771726:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574660.771733:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574660/real 1788574660]  req@ffff8dc006712680 x1875453361097728/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574685 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574660.771743:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361097728/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574685 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574660.771755:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574660.771758:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574660.771762:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361097728:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574660.771769:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361097856:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574660.771797:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574660.771809:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574660/real 1788574660]  req@ffff8dc006713480 x1875453361097856/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574685 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574660.771821:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361097856/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574685 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574660.771831:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574660.771834:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574660.771837:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361097856:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574660.771913:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361097984:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574660.771940:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574660.771950:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574660/real 1788574660]  req@ffff8dc006711500 x1875453361097984/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574685 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574660.771960:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361097984/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574685 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574660.771966:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574660.771969:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574660.771973:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361097984:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574660.771978:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361098112:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574660.771992:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574660.772003:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574660/real 1788574660]  req@ffff8dc006712300 x1875453361098112/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574685 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574660.772015:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361098112/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574685 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574660.772024:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574660.772028:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574660.772031:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361098112:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574661.154988:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574661.154991:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574661.155023:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574661.155041:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574661.155080:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788574661.155111:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574661.795026:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574662.179014:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574662.179033:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574662.179035:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788574662.179044:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574662.179072:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574662.179084:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574662.818994:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574663.202985:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574663.202985:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574663.202985:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574663.203015:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574663.203023:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574663.203025:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574663.842938:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574664.226962:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574664.226963:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574664.226964:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574664.227005:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788574664.227007:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574664.227022:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574664.866996:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574665.251007:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574665.251021:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574665.251025:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574665.251050:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574665.251065:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574665.251089:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00080000:0.0:1788574665.890962:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574665.890974:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788574665.890980:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574665.890991:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3011
00000100:00100000:3.0:1788574665.890999:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574665.891006:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574665.891018:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574665.891069:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361098240/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574665.891098:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574665.891103:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574665.891105:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574665.891110:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3011
00000100:00080000:0.0:1788574665.891114:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574665.891119:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574665.891132:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574665.891149:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361098368/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574665.891153:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361098240:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788574665.891161:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574665.891165:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574665.891167:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574665.891171:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3011
00000100:00080000:0.0:1788574665.891176:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574665.891180:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574665.891186:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574665.891197:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361098496/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574665.891206:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574665.891209:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574665.891211:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574665.891214:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3011
00000100:00080000:0.0:1788574665.891236:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574665.891240:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574665.891245:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1788574665.891249:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574665.891256:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361098624/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574665.891265:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574665.891269:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574665.891270:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574665.891274:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3011
00000100:00080000:0.0:1788574665.891282:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574665.891285:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574665.891291:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574665.891301:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361098752/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574665.891308:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574665/real 1788574665]  req@ffff8dc006711880 x1875453361098240/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574690 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574665.891318:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574665.891322:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574665.891324:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574665.891343:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3011
00000100:00080000:0.0:1788574665.891347:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574665.891350:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574665.891355:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574665.891359:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361098240/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574690 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574665.891366:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361098880/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574665.891371:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574665.891376:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574665.891381:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361098240:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788574665.891383:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574665.891387:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574665.891388:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574665.891391:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3011
00000100:00080000:0.0:1788574665.891394:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574665.891398:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574665.891402:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574665.891408:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361098368:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574665.891412:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361099008/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788574665.891434:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574665.891448:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574665/real 1788574665]  req@ffff8dc006713800 x1875453361098368/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574690 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574665.891462:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361098368/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574690 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574665.891470:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574665.891473:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574665.891475:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361098368:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574665.891480:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361098496:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574665.891502:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574665.891524:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574665/real 1788574665]  req@ffff8dc006712a00 x1875453361098496/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574690 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574665.891539:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361098496/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574690 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574665.891554:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574665.891556:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574665.891559:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361098496:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574665.891563:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361098624:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574665.891580:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574665.891588:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574665/real 1788574665]  req@ffff8dc006713100 x1875453361098624/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574690 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574665.891596:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361098624/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574690 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574665.891606:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574665.891610:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574665.891613:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361098624:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574665.891619:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361098752:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574665.891641:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574665.891653:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574665/real 1788574665]  req@ffff8dc006713b80 x1875453361098752/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574690 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574665.891666:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361098752/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574690 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574665.891672:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574665.891674:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574665.891677:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361098752:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574665.891682:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361098880:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574665.891697:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574665.891704:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574665/real 1788574665]  req@ffff8dc006710e00 x1875453361098880/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574690 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574665.891711:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361098880/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574690 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574665.891717:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574665.891719:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574665.891721:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361098880:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574665.891735:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361099008:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574665.891747:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574665.891753:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574665/real 1788574665]  req@ffff8dc006711880 x1875453361099008/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574690 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574665.891760:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361099008/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574690 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574665.891765:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574665.891767:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574665.891769:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361099008:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574666.275028:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574666.275028:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574666.275036:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574666.275215:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574666.275293:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574666.275360:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574666.915020:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574667.299013:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574667.299013:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574667.299013:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574667.299013:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574667.299055:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574667.299128:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574667.938963:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574668.322948:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574668.322961:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574668.322966:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574668.323006:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788574668.323009:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574668.323021:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574668.963037:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574669.346999:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574669.347019:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574669.347043:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574669.347049:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574669.347061:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574669.347067:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574669.987007:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574670.371003:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574670.371021:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574670.371039:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574670.371055:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574670.371080:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574670.371084:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00080000:2.0:1788574671.011021:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574671.011032:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:3.0:1788574671.011033:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788574671.011037:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574671.011050:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3016
00000100:00080000:2.0:1788574671.011061:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574671.011071:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574671.011118:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453361099136/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574671.011144:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574671.011147:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574671.011148:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574671.011151:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3016
00000100:00080000:2.0:1788574671.011154:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574671.011156:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574671.011165:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574671.011175:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361099264/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574671.011183:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574671.011186:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574671.011187:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574671.011190:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3016
00000100:00080000:2.0:1788574671.011193:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574671.011195:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574671.011201:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574671.011206:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361099136:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788574671.011216:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453361099392/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574671.011229:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574671.011233:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574671.011236:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574671.011240:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3016
00000100:00080000:2.0:1788574671.011245:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574671.011250:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574671.011256:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574671.011268:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453361099520/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788574671.011302:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788574671.011313:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574671.011317:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574671.011320:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574671.011326:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3016
00000100:00080000:2.0:1788574671.011331:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574671.011334:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574671.011339:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574671.011354:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574671/real 1788574671]  req@ffff8dc020494e00 x1875453361099136/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574696 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574671.011359:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453361099648/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574671.011379:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788574671.011383:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453361099136/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574696 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574671.011387:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574671.011393:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574671.011398:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574671.011401:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3016
00000100:00080000:1.0:1788574671.011406:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788574671.011407:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788574671.011412:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361099136:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788574671.011415:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574671.011424:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574671.011425:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361099264:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574671.011443:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361099776/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574671.011452:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1788574671.011453:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788574671.011459:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574671.011461:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574671.011467:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3016
00000100:00100000:1.0:1788574671.011469:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574671/real 1788574671]  req@ffff8dc020494700 x1875453361099264/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574696 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574671.011473:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574671.011483:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574671.011487:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361099264/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574696 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1788574671.011491:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1788574671.011497:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574671.011501:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574671.011505:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361099264:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574671.011511:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453361099904/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574671.011533:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361099392:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574671.011554:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574671.011568:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574671/real 1788574671]  req@ffff8dc020494380 x1875453361099392/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574696 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574671.011581:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453361099392/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574696 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574671.011591:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574671.011595:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574671.011599:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361099392:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574671.011605:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361099520:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574671.011627:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574671.011639:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574671/real 1788574671]  req@ffff8dc020496a00 x1875453361099520/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574696 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574671.011653:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453361099520/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574696 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574671.011663:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574671.011667:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574671.011670:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361099520:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574671.011677:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361099648:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574671.011699:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574671.011712:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574671/real 1788574671]  req@ffff8dc020497100 x1875453361099648/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574696 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574671.011724:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453361099648/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574696 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574671.011735:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574671.011738:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574671.011741:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361099648:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574671.011748:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361099776:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574671.011769:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574671.011781:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574671/real 1788574671]  req@ffff8dc020495880 x1875453361099776/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574696 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574671.011795:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361099776/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574696 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574671.011804:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574671.011808:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574671.011812:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361099776:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574671.011818:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361099904:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574671.011839:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574671.011850:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574671/real 1788574671]  req@ffff8dc020496d80 x1875453361099904/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574696 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574671.011863:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453361099904/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574696 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574671.011901:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574671.011905:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574671.011909:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361099904:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574671.394962:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574671.394994:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574671.395040:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574671.395047:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574671.395055:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574671.395074:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574672.034961:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574672.419044:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574672.419045:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574672.419050:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574672.419053:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574672.419101:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574672.419166:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574673.059000:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574673.442962:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574673.442981:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574673.442985:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574673.442999:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574673.443062:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574673.443076:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574674.082955:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574674.466983:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574674.466983:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574674.466983:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574674.466984:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574674.467018:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574674.467059:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574675.106974:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574675.490981:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574675.490989:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574675.490990:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574675.491023:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574675.491023:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574675.491072:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574676.130974:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788574676.131008:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574676.131013:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788574676.131016:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574676.131026:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3021
00000100:00080000:3.0:1788574676.131037:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574676.131044:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788574676.131082:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f100 x1875453361100032/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574676.131110:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574676.131114:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574676.131116:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574676.131121:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3021
00000100:00080000:3.0:1788574676.131125:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574676.131129:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574676.131139:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574676.131154:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d880 x1875453361100160/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574676.131162:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361100032:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788574676.131170:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574676.131175:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574676.131177:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574676.131182:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3021
00000100:00080000:3.0:1788574676.131187:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574676.131192:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574676.131198:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574676.131213:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644fb80 x1875453361100288/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574676.131244:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574676.131248:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574676.131250:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574676.131254:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3021
00000100:00080000:3.0:1788574676.131258:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574676.131265:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:1.0:1788574676.131266:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:3.0:1788574676.131272:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574676.131290:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ed80 x1875453361100416/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574676.131300:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574676.131305:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574676.131307:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574676.131315:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3021
00000100:00100000:1.0:1788574676.131316:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574676/real 1788574676]  req@ffff8dc00644f100 x1875453361100032/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574701 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574676.131320:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574676.131328:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574676.131337:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574676.131344:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f100 x1875453361100032/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574701 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574676.131354:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644df80 x1875453361100544/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574676.131359:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574676.131368:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788574676.131370:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788574676.131375:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361100032:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788574676.131378:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574676.131382:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574676.131390:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3021
00000100:00080000:3.0:1788574676.131395:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574676.131399:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574676.131404:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361100160:192.168.202.140@tcp:38:kworker.0
00000008:00100000:3.0:1788574676.131406:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574676.131425:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e300 x1875453361100672/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788574676.131437:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788574676.131437:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574676.131444:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574676.131446:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574676.131451:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3021
00000100:00080000:3.0:1788574676.131456:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788574676.131458:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574676/real 1788574676]  req@ffff8dc00644d880 x1875453361100160/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574701 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574676.131463:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574676.131472:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574676.131489:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c700 x1875453361100800/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574676.131495:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d880 x1875453361100160/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574701 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574676.131513:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574676.131517:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574676.131522:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361100160:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574676.131530:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361100288:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574676.131555:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574676.131569:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574676/real 1788574676]  req@ffff8dc00644fb80 x1875453361100288/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574701 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574676.131582:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644fb80 x1875453361100288/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574701 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574676.131590:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574676.131594:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574676.131598:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361100288:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574676.131604:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361100416:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574676.131626:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574676.131638:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574676/real 1788574676]  req@ffff8dc00644ed80 x1875453361100416/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574701 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574676.131650:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ed80 x1875453361100416/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574701 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574676.131665:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574676.131669:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574676.131673:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361100416:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574676.131679:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361100544:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574676.131715:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574676.131727:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574676/real 1788574676]  req@ffff8dc00644df80 x1875453361100544/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574701 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574676.131739:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644df80 x1875453361100544/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574701 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574676.131750:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574676.131753:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574676.131756:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361100544:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574676.131774:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361100672:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574676.131792:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574676.131802:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574676/real 1788574676]  req@ffff8dc00644e300 x1875453361100672/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574701 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574676.131814:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453361100672/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574701 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574676.131822:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574676.131825:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574676.131829:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361100672:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574676.131836:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361100800:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574676.131852:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574676.131862:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574676/real 1788574676]  req@ffff8dc00644c700 x1875453361100800/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574701 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574676.131898:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453361100800/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574701 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574676.131907:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574676.131910:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574676.131914:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361100800:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574676.514968:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574676.514969:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574676.514971:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574676.515001:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574676.515005:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574676.515020:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574677.155022:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574677.539007:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574677.539008:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574677.539008:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574677.539008:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574677.539056:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574677.539113:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574678.178962:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574678.562997:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574678.562998:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574678.563038:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574678.563158:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574678.563166:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574678.563195:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574679.203042:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574679.586963:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574679.586988:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574679.587001:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574679.587007:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574679.587008:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574679.587036:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574680.226949:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574680.610961:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574680.610961:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574680.610995:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574680.610995:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574680.611042:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574680.611056:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574681.250976:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788574681.250980:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574681.250990:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788574681.250994:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574681.251003:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3026
00000100:00080000:3.0:1788574681.251012:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574681.251019:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788574681.251059:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e680 x1875453361100928/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574681.251088:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574681.251092:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574681.251094:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574681.251098:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3026
00000100:00080000:3.0:1788574681.251103:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574681.251107:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574681.251118:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574681.251132:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d180 x1875453361101056/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574681.251142:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574681.251146:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574681.251150:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1788574681.251152:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361100928:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788574681.251156:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3026
00000100:00080000:3.0:1788574681.251163:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574681.251167:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574681.251185:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574681.251200:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f480 x1875453361101184/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574681.251210:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574681.251214:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574681.251216:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574681.251220:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3026
00000100:00080000:3.0:1788574681.251225:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574681.251228:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574681.251233:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1788574681.251237:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574681.251248:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c380 x1875453361101312/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574681.251259:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574681.251263:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574681.251264:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574681.251269:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3026
00000100:00080000:3.0:1788574681.251272:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574681.251277:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574681.251281:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574681.251289:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574681/real 1788574681]  req@ffff8dc00644e680 x1875453361100928/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574706 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574681.251295:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d500 x1875453361101440/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574681.251336:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574681.251340:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:1.0:1788574681.251345:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453361100928/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574706 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574681.251345:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574681.251355:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3026
00000100:00080000:3.0:1788574681.251362:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574681.251367:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574681.251368:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:1.0:1788574681.251377:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000008:00100000:3.0:1788574681.251377:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574681.251385:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361100928:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788574681.251394:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ea00 x1875453361101568/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574681.251405:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574681.251409:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574681.251411:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1788574681.251415:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361101056:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788574681.251420:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3026
00000100:00080000:3.0:1788574681.251427:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574681.251431:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574681.251437:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574681.251452:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ca80 x1875453361101696/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788574681.251453:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574681.251472:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574681/real 1788574681]  req@ffff8dc00644d180 x1875453361101056/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574706 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574681.251490:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453361101056/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574706 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574681.251502:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574681.251506:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574681.251510:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361101056:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574681.251518:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361101184:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574681.251541:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574681.251554:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574681/real 1788574681]  req@ffff8dc00644f480 x1875453361101184/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574706 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574681.251567:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453361101184/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574706 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574681.251582:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574681.251586:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574681.251589:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361101184:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574681.251596:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361101312:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574681.251616:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574681.251627:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574681/real 1788574681]  req@ffff8dc00644c380 x1875453361101312/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574706 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574681.251638:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453361101312/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574706 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574681.251648:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574681.251651:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574681.251654:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361101312:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574681.251660:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361101440:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574681.251680:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574681.251692:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574681/real 1788574681]  req@ffff8dc00644d500 x1875453361101440/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574706 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574681.251704:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d500 x1875453361101440/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574706 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574681.251713:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574681.251717:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574681.251721:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361101440:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574681.251727:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361101568:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574681.251746:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574681.251768:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574681/real 1788574681]  req@ffff8dc00644ea00 x1875453361101568/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574706 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574681.251782:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ea00 x1875453361101568/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574706 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574681.251790:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574681.251794:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574681.251797:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361101568:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574681.251817:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361101696:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574681.251846:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574681.251857:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574681/real 1788574681]  req@ffff8dc00644ca80 x1875453361101696/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574706 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574681.251897:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ca80 x1875453361101696/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574706 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574681.251906:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574681.251909:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574681.251913:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361101696:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574681.635044:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574681.635044:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574681.635044:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574681.635059:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574681.635087:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574681.635101:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574682.275003:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574682.658990:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574682.659030:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574682.659031:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574682.659050:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574682.659059:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574682.659076:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574683.298981:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574683.682988:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574683.682992:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574683.682996:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574683.683024:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574683.683036:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574683.683036:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574684.323019:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574684.706969:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574684.706969:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574684.707036:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574684.707060:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574684.707203:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574684.707217:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574685.346935:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574685.730967:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574685.730968:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574685.730983:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574685.730990:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574685.731003:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574685.731058:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1788574686.370971:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574686.370979:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788574686.370983:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788574686.370989:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788574686.370992:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3032
00000100:00080000:2.0:1788574686.371002:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574686.371009:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574686.371042:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361101824/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574686.371069:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574686.371071:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574686.371073:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574686.371076:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3032
00000100:00080000:2.0:1788574686.371078:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574686.371080:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574686.371088:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574686.371097:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361101952/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574686.371111:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574686.371115:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:1.0:1788574686.371116:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361101824:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788574686.371117:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574686.371126:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3032
00000100:00080000:2.0:1788574686.371131:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574686.371134:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574686.371139:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574686.371155:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361102080/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574686.371165:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574686.371169:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574686.371171:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574686.371175:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3032
00000100:00080000:2.0:1788574686.371179:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574686.371184:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574686.371189:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574686.371202:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453361102208/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574686.371214:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574686.371218:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574686.371219:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574686.371223:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3032
00000100:00080000:2.0:1788574686.371227:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574686.371231:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574686.371236:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361101952:192.168.202.140@tcp:38:kworker.0
00000008:00100000:2.0:1788574686.371238:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574686.371253:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453361102336/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574686.371262:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574686.371264:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574686.371266:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574686.371269:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3032
00000100:00080000:2.0:1788574686.371272:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574686.371274:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574686.371277:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574686.371281:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361102080:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574686.371290:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453361102464/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574686.371298:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574686.371301:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574686.371302:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574686.371305:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3032
00000100:00100000:1.0:1788574686.371308:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361102208:192.168.202.140@tcp:8:kworker.0
00000100:00080000:2.0:1788574686.371310:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574686.371317:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574686.371321:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574686.371332:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361102592/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574686.371335:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361102336:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574686.371362:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361102464:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574686.371380:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361102592:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574686.754936:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574686.754936:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574686.754943:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574686.754943:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574686.754966:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788574686.755013:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574687.394960:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574687.778981:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574687.779003:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574687.779030:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574687.779071:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574687.779075:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574687.779100:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574688.418999:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574688.802941:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574688.802944:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574688.802944:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574688.802952:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574688.802973:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788574688.803014:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574689.443081:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000400:00000100:1.0:1788574689.443165:0:2335:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.140:988
00000400:00000100:1.0:1788574689.443208:0:2335:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.140@tcp at host 192.168.202.140 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:1.0:1788574689.443227:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788574689.443274:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788574689.443289:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788574689.443305:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:0.0:1788574689.443309:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574686/real 1788574689]  req@ffff8dc020494000 x1875453361101952/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574711 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:1.0:1788574689.443330:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788574689.443350:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:0.0:1788574689.443356:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361101952/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574711 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:1.0:1788574689.443367:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00080000:0.0:1788574689.443381:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574689.443389:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574689.443398:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361101952:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574689.443407:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574686/real 1788574689]  req@ffff8dc020495500 x1875453361102080/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574711 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574689.443421:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361102080/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574711 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574689.443431:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574689.443434:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574689.443438:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361102080:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574689.443444:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574686/real 1788574689]  req@ffff8dc020494a80 x1875453361102208/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574711 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574689.443456:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453361102208/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574711 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574689.443466:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574689.443469:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574689.443472:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361102208:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574689.443484:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574686/real 1788574689]  req@ffff8dc020495180 x1875453361101824/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574711 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574689.443498:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361101824/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574711 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574689.443505:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574689.443508:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574689.443511:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361101824:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788574689.443536:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574686/real 1788574689]  req@ffff8dc020495880 x1875453361102592/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574711 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574689.443549:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361102592/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574711 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574689.443557:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574689.443560:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574689.443563:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361102592:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574689.443569:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574686/real 1788574689]  req@ffff8dc020497480 x1875453361102336/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574711 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574689.443580:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453361102336/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574711 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574689.443589:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574689.443626:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574689.443629:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361102336:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574689.443637:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574686/real 1788574689]  req@ffff8dc020496d80 x1875453361102464/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574711 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574689.443650:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453361102464/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574711 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574689.443658:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574689.443661:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574689.443665:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361102464:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574689.826964:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574689.826968:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574689.826970:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574689.826995:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574689.827012:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574689.827015:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574690.467008:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574690.850941:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574690.850949:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574690.850972:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574690.850984:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574690.850988:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574690.851007:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1788574691.490999:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574691.491011:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:0.0:1788574691.491014:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574691.491017:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574691.491030:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3037
00000100:00080000:1.0:1788574691.491041:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574691.491049:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574691.491086:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361102720/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574691.491114:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574691.491118:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574691.491120:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574691.491125:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3037
00000100:00080000:1.0:1788574691.491129:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574691.491133:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574691.491143:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574691.491158:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361102848/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574691.491169:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788574691.491173:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361102720:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574691.491175:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574691.491178:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574691.491187:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3037
00000100:00080000:1.0:1788574691.491190:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574691.491194:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574691.491200:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574691.491212:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361102976/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574691.491223:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574691.491228:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574691.491229:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574691.491233:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3037
00000100:00080000:1.0:1788574691.491238:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574691.491243:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574691.491248:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788574691.491254:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574691.491264:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361103104/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574691.491275:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574691.491279:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574691.491281:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574691.491286:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3037
00000100:00080000:1.0:1788574691.491289:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574691.491294:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574691.491301:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574691.491309:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574691/real 1788574691]  req@ffff8dc005dc1500 x1875453361102720/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574716 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574691.491315:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361103232/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574691.491350:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788574691.491352:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361102720/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574716 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574691.491357:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574691.491362:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574691.491371:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3037
00000100:00080000:0.0:1788574691.491373:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574691.491376:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574691.491381:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788574691.491385:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574691.491391:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361102720:192.168.202.140@tcp:250:kworker.0
00000008:00100000:1.0:1788574691.491392:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574691.491427:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361103360/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574691.491439:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574691.491443:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574691.491445:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574691.491449:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3037
00000100:00100000:0.0:1788574691.491458:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361102848:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788574691.491468:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574691.491474:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574691.491481:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788574691.491495:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574691.491498:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361103488/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574691.491517:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574691/real 1788574691]  req@ffff8dc005dc0a80 x1875453361102848/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574716 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574691.491536:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361102848/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574716 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574691.491547:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574691.491551:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574691.491555:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361102848:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574691.491568:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361102976:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574691.491595:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574691.491609:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574691/real 1788574691]  req@ffff8dc005dc1180 x1875453361102976/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574716 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574691.491622:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361102976/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574716 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574691.491630:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574691.491634:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574691.491637:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361102976:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574691.491643:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361103104:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574691.491665:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574691.491677:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574691/real 1788574691]  req@ffff8dc005dc2d80 x1875453361103104/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574716 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574691.491690:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361103104/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574716 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574691.491705:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574691.491709:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574691.491712:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361103104:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574691.491719:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361103232:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574691.491747:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574691.491760:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574691/real 1788574691]  req@ffff8dc005dc3b80 x1875453361103232/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574716 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574691.491772:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361103232/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574716 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574691.491780:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574691.491784:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574691.491787:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361103232:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574691.491793:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361103360:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574691.491815:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574691.491827:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574691/real 1788574691]  req@ffff8dc005dc0700 x1875453361103360/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574716 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574691.491839:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361103360/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574716 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574691.491847:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574691.491850:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574691.491855:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361103360:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574691.491903:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361103488:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574691.491925:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574691.491936:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574691/real 1788574691]  req@ffff8dc005dc3800 x1875453361103488/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574716 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574691.491947:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361103488/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574716 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574691.491955:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574691.491958:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574691.491961:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361103488:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574691.874958:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574691.874958:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574691.874968:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574691.874991:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574691.874991:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574691.875008:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574692.515067:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574692.898921:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574692.898944:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574692.898954:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574692.898972:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574692.898980:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574692.898981:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574693.539002:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574693.922983:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574693.922985:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574693.922999:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574693.923011:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574693.923027:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574693.923039:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574694.562961:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574694.946922:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574694.946954:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574694.946961:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574694.946971:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574694.946982:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574694.946990:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574695.586927:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574695.970974:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574695.970977:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574695.970995:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574695.971019:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574695.971020:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574695.971023:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1788574696.610985:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574696.610994:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788574696.610998:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574696.611006:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3042
00000100:00100000:3.0:1788574696.611006:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574696.611018:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574696.611026:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574696.611058:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361103616/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574696.611081:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574696.611084:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574696.611085:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574696.611088:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3042
00000100:00080000:0.0:1788574696.611090:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574696.611092:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574696.611100:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574696.611109:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361103744/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574696.611117:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574696.611119:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574696.611121:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574696.611123:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3042
00000100:00080000:0.0:1788574696.611125:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574696.611129:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574696.611133:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574696.611142:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361103872/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574696.611147:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361103616:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788574696.611156:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574696.611160:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574696.611161:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574696.611164:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3042
00000100:00080000:0.0:1788574696.611168:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574696.611170:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574696.611174:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574696.611184:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361104000/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574696.611190:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574696.611192:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574696.611194:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574696.611196:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3042
00000100:00080000:0.0:1788574696.611207:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574696.611212:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574696.611217:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788574696.611227:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574696.611231:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453361104128/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574696.611243:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574696.611247:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574696.611249:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574696.611254:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3042
00000100:00080000:0.0:1788574696.611259:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574696.611264:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574696.611272:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574696.611273:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574696/real 1788574696]  req@ffff8dc006712300 x1875453361103616/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574721 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574696.611290:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361104256/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574696.611302:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361103616/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574721 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574696.611304:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574696.611315:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574696.611319:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574696.611322:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574696.611326:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3042
00000100:00080000:2.0:1788574696.611328:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788574696.611335:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1788574696.611335:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361103616:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788574696.611344:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574696.611346:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361103744:192.168.202.140@tcp:38:kworker.0
00000008:00100000:0.0:1788574696.611355:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574696.611371:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361104384/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788574696.611377:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574696.611394:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574696/real 1788574696]  req@ffff8dc006711500 x1875453361103744/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574721 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574696.611408:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361103744/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574721 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574696.611415:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574696.611418:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574696.611420:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361103744:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574696.611443:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361103872:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574696.611462:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574696.611473:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574696/real 1788574696]  req@ffff8dc006713480 x1875453361103872/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574721 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574696.611486:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361103872/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574721 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574696.611497:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574696.611501:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574696.611506:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361103872:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574696.611515:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361104000:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574696.611540:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574696.611551:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574696/real 1788574696]  req@ffff8dc006712680 x1875453361104000/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574721 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574696.611564:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361104000/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574721 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574696.611574:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574696.611577:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574696.611581:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361104000:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574696.611601:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361104128:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574696.611618:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574696.611627:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574696/real 1788574696]  req@ffff8dc006710380 x1875453361104128/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574721 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574696.611638:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453361104128/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574721 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574696.611648:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574696.611651:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574696.611655:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361104128:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574696.611661:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361104256:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574696.611683:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574696.611694:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574696/real 1788574696]  req@ffff8dc006711c00 x1875453361104256/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574721 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574696.611703:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361104256/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574721 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574696.611709:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574696.611711:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574696.611713:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361104256:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574696.611717:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361104384:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574696.611730:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574696.611737:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574696/real 1788574696]  req@ffff8dc006711880 x1875453361104384/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574721 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574696.611744:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361104384/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574721 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574696.611749:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574696.611751:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574696.611753:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361104384:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574696.994962:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574696.994962:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574696.994986:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574696.994996:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574696.994998:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574696.994999:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574697.634961:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574698.018976:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574698.018976:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574698.018999:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574698.019030:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574698.019041:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788574698.019054:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574698.658974:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574699.042954:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574699.042969:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574699.042973:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574699.042985:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574699.042989:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574699.042997:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574699.682943:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574700.066949:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574700.066960:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788574700.066971:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574700.066976:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574700.066989:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574700.066998:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574700.707002:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574701.091009:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574701.091023:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574701.091023:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574701.091031:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574701.091035:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574701.091108:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1788574701.730958:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574701.730967:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788574701.730971:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574701.730981:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3047
00000100:00100000:3.0:1788574701.730981:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574701.730992:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574701.731001:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574701.731035:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361104512/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574701.731056:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574701.731060:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574701.731061:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574701.731064:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3047
00000100:00080000:1.0:1788574701.731066:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574701.731068:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574701.731076:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574701.731089:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361104640/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574701.731102:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788574701.731107:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361104512:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574701.731108:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574701.731113:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574701.731123:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3047
00000100:00080000:1.0:1788574701.731127:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574701.731132:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574701.731139:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574701.731153:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361104768/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574701.731164:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574701.731167:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574701.731168:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574701.731171:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3047
00000100:00080000:1.0:1788574701.731174:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574701.731179:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:2.0:1788574701.731180:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:1.0:1788574701.731186:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574701.731198:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361104896/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574701.731204:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574701.731207:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574701.731209:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574701.731212:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3047
00000100:00080000:1.0:1788574701.731215:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574701.731218:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574701.731222:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574701/real 1788574701]  req@ffff8dc005dc1c00 x1875453361104512/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574726 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1788574701.731224:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574701.731237:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361105024/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574701.731257:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574701.731260:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574701.731261:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788574701.731265:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361104512/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574726 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574701.731268:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3047
00000100:00080000:1.0:1788574701.731273:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574701.731279:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574701.731285:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1788574701.731286:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574701.731291:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574701.731295:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361105152/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574701.731299:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361104512:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574701.731313:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574701.731315:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574701.731317:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574701.731320:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3047
00000100:00080000:1.0:1788574701.731322:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574701.731325:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574701.731328:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574701.731329:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361104640:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574701.731341:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361105280/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788574701.731354:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574701.731366:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574701/real 1788574701]  req@ffff8dc005dc3800 x1875453361104640/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574726 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574701.731375:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361104640/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574726 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574701.731382:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574701.731385:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574701.731387:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361104640:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574701.731391:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361104768:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574701.731402:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574701.731408:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574701/real 1788574701]  req@ffff8dc005dc0700 x1875453361104768/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574726 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574701.731420:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361104768/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574726 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574701.731426:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574701.731428:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574701.731429:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361104768:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574701.731433:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361104896:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574701.731442:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574701.731448:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574701/real 1788574701]  req@ffff8dc005dc3b80 x1875453361104896/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574726 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574701.731455:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361104896/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574726 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574701.731461:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574701.731463:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574701.731465:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361104896:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574701.731468:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361105024:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574701.731478:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574701.731515:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574701/real 1788574701]  req@ffff8dc005dc2d80 x1875453361105024/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574726 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574701.731523:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361105024/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574726 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574701.731533:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574701.731535:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574701.731537:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361105024:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574701.731541:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361105152:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574701.731555:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574701.731561:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574701/real 1788574701]  req@ffff8dc005dc1180 x1875453361105152/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574726 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574701.731568:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361105152/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574726 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574701.731574:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574701.731575:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574701.731577:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361105152:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574701.731589:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361105280:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574701.731600:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574701.731606:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574701/real 1788574701]  req@ffff8dc005dc0a80 x1875453361105280/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574726 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574701.731614:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361105280/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574726 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574701.731622:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574701.731625:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574701.731629:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361105280:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574702.114973:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574702.114973:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574702.114973:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574702.114991:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574702.115008:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788574702.115056:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574702.754930:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574703.138939:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574703.138946:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574703.138971:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574703.138975:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574703.138989:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574703.138999:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574703.778980:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574704.162986:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574704.162986:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788574704.162991:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574704.163023:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574704.163030:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574704.163042:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574704.802933:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574705.186938:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574705.186944:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574705.186955:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574705.186970:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574705.186982:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788574705.187053:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574705.826988:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574706.210949:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574706.210949:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574706.210963:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574706.210983:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788574706.210991:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574706.210996:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00080000:1.0:1788574706.850929:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574706.850937:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:3.0:1788574706.850938:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574706.850940:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574706.850950:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3052
00000100:00080000:1.0:1788574706.850960:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574706.850966:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574706.850997:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361105408/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574706.851033:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574706.851036:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574706.851038:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574706.851041:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3052
00000100:00080000:1.0:1788574706.851043:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574706.851047:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574706.851055:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574706.851067:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361105536/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574706.851071:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361105408:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574706.851088:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574706.851091:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574706.851092:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574706.851095:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3052
00000100:00080000:1.0:1788574706.851097:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574706.851100:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574706.851103:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574706.851110:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361105664/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574706.851116:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574706.851119:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574706.851120:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574706.851123:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3052
00000100:00080000:1.0:1788574706.851126:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574706.851128:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574706.851131:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574706.851138:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361105792/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574706.851144:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:2.0:1788574706.851145:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788574706.851147:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574706.851150:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574706.851153:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3052
00000100:00080000:1.0:1788574706.851156:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574706.851160:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574706.851163:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574706.851171:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361105920/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574706.851178:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574706.851180:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574706.851182:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574706.851185:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3052
00000100:00080000:1.0:1788574706.851187:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574706.851189:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574706.851192:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574706.851195:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574706/real 1788574706]  req@ffff8dc005dc1500 x1875453361105408/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574731 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574706.851202:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361106048/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574706.851233:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574706.851235:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574706.851237:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574706.851240:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3052
00000100:00100000:2.0:1788574706.851244:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361105408/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574731 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574706.851245:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574706.851251:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574706.851256:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1788574706.851265:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1788574706.851267:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361106176/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574706.851273:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574706.851282:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361105408:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788574706.851307:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361105536:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574706.851328:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574706.851338:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574706/real 1788574706]  req@ffff8dc005dc0a80 x1875453361105536/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574731 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574706.851352:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361105536/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574731 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574706.851360:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574706.851362:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574706.851364:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361105536:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574706.851368:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361105664:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574706.851387:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574706.851399:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574706/real 1788574706]  req@ffff8dc005dc1180 x1875453361105664/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574731 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574706.851412:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361105664/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574731 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574706.851422:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574706.851425:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574706.851429:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361105664:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574706.851434:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361105792:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574706.851449:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574706.851457:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574706/real 1788574706]  req@ffff8dc005dc2d80 x1875453361105792/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574731 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574706.851465:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361105792/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574731 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574706.851475:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574706.851477:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574706.851479:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361105792:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574706.851483:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361105920:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574706.851494:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574706.851500:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574706/real 1788574706]  req@ffff8dc005dc3b80 x1875453361105920/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574731 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574706.851507:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361105920/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574731 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574706.851521:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574706.851524:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574706.851526:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361105920:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574706.851530:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361106048:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574706.851542:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574706.851548:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574706/real 1788574706]  req@ffff8dc005dc0700 x1875453361106048/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574731 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574706.851555:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361106048/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574731 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574706.851561:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574706.851563:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574706.851565:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361106048:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574706.851569:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361106176:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574706.851579:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574706.851585:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574706/real 1788574706]  req@ffff8dc005dc3800 x1875453361106176/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574731 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574706.851592:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361106176/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574731 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574706.851597:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574706.851599:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574706.851601:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361106176:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574707.234965:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574707.235032:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574707.235041:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574707.235046:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574707.235108:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574707.235149:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574707.875020:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574708.258946:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574708.258964:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574708.258964:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574708.258991:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574708.258991:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788574708.259018:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574708.898932:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574709.282938:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574709.282955:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574709.282956:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574709.282985:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574709.282986:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788574709.283003:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574709.922987:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574710.306959:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574710.306962:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574710.306966:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574710.307011:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574710.307039:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788574710.307053:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574710.946946:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574711.330946:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574711.330946:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574711.330950:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574711.330977:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788574711.330983:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574711.330997:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574711.970988:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788574711.971016:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574711.971020:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788574711.971022:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574711.971030:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3057
00000100:00080000:3.0:1788574711.971040:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574711.971046:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788574711.971079:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644dc00 x1875453361106304/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574711.971099:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574711.971102:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574711.971103:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574711.971106:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3057
00000100:00080000:3.0:1788574711.971108:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574711.971111:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574711.971118:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574711.971126:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c000 x1875453361106432/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574711.971137:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574711.971140:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574711.971142:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574711.971145:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3057
00000100:00080000:3.0:1788574711.971147:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574711.971149:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574711.971152:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574711.971161:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f800 x1875453361106560/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574711.971169:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788574711.971171:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361106304:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788574711.971172:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574711.971176:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574711.971182:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3057
00000100:00080000:3.0:1788574711.971184:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574711.971187:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574711.971189:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574711.971198:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ce00 x1875453361106688/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574711.971203:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574711.971205:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574711.971207:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574711.971210:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3057
00000100:00080000:3.0:1788574711.971213:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574711.971215:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574711.971218:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574711.971225:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ca80 x1875453361106816/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574711.971231:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574711.971234:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574711.971235:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574711.971240:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3057
00000800:00000100:2.0:1788574711.971245:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788574711.971248:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574711.971255:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574711.971260:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574711.971274:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ea00 x1875453361106944/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574711.971285:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574711.971289:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:2.0:1788574711.971294:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574711/real 1788574711]  req@ffff8dc00644dc00 x1875453361106304/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574736 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574711.971294:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574711.971303:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3057
00000100:00080000:3.0:1788574711.971310:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574711.971316:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574711.971323:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574711.971337:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644dc00 x1875453361106304/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574736 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574711.971338:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d500 x1875453361107072/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574711.971372:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574711.971379:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574711.971385:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361106304:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788574711.971394:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361106432:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574711.971417:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574711.971427:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574711/real 1788574711]  req@ffff8dc00644c000 x1875453361106432/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574736 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574711.971436:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c000 x1875453361106432/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574736 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574711.971443:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574711.971445:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574711.971448:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361106432:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574711.971465:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361106560:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574711.971478:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574711.971485:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574711/real 1788574711]  req@ffff8dc00644f800 x1875453361106560/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574736 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574711.971493:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f800 x1875453361106560/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574736 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574711.971511:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574711.971514:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574711.971516:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361106560:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574711.971520:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361106688:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574711.971532:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574711.971539:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574711/real 1788574711]  req@ffff8dc00644ce00 x1875453361106688/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574736 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574711.971546:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ce00 x1875453361106688/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574736 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574711.971551:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574711.971566:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574711.971570:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361106688:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574711.971575:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361106816:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574711.971590:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574711.971598:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574711/real 1788574711]  req@ffff8dc00644ca80 x1875453361106816/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574736 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574711.971606:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ca80 x1875453361106816/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574736 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574711.971612:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574711.971613:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574711.971616:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361106816:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574711.971620:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361106944:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574711.971630:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574711.971636:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574711/real 1788574711]  req@ffff8dc00644ea00 x1875453361106944/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574736 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574711.971643:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ea00 x1875453361106944/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574736 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574711.971648:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574711.971649:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574711.971651:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361106944:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574711.971655:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361107072:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574711.971664:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574711.971670:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574711/real 1788574711]  req@ffff8dc00644d500 x1875453361107072/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574736 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574711.971677:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d500 x1875453361107072/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574736 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574711.971682:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574711.971683:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574711.971685:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361107072:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574712.354972:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574712.354972:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574712.354978:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574712.355004:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788574712.355006:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574712.355015:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574712.994994:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574713.379009:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574713.379009:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574713.379018:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788574713.379047:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574713.379051:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574713.379069:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574714.019005:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574714.402923:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574714.402938:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574714.402956:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788574714.402969:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574714.402974:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574714.402987:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574715.042939:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574715.426975:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574715.426975:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574715.426976:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574715.427013:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574715.427013:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788574715.427015:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574716.066940:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574716.450938:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574716.450943:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574716.450952:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574716.450958:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574716.450985:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788574716.451017:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1788574717.090980:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574717.090989:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:3.0:1788574717.090991:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788574717.090994:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574717.091010:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3062
00000100:00080000:2.0:1788574717.091021:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574717.091027:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574717.091062:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453361107200/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574717.091090:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574717.091121:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574717.091123:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574717.091126:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3062
00000100:00080000:2.0:1788574717.091130:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574717.091143:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574717.091154:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574717.091163:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361107200:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788574717.091173:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453361107328/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574717.091188:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574717.091192:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574717.091195:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574717.091200:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3062
00000100:00080000:2.0:1788574717.091206:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574717.091209:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574717.091214:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788574717.091226:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574717.091227:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453361107456/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574717.091237:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574717.091240:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574717.091242:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574717.091246:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3062
00000100:00080000:2.0:1788574717.091249:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574717.091251:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574717.091254:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574717.091262:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361107584/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574717.091269:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788574717.091274:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574717/real 1788574717]  req@ffff8dc020497100 x1875453361107200/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574742 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574717.091274:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574717.091287:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788574717.091292:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453361107200/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574742 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574717.091293:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3062
00000100:00080000:2.0:1788574717.091302:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574717.091307:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574717.091307:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574717.091317:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1788574717.091318:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574717.091325:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361107200:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788574717.091330:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453361107712/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574717.091337:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574717.091340:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574717.091341:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574717.091344:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3062
00000100:00080000:2.0:1788574717.091346:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788574717.091349:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361107328:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788574717.091351:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574717.091359:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574717.091370:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453361107840/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574717.091379:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1788574717.091383:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788574717.091384:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574717.091389:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574717.091393:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3062
00000100:00080000:2.0:1788574717.091397:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574717.091401:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574717.091403:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574717/real 1788574717]  req@ffff8dc020496a00 x1875453361107328/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574742 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1788574717.091406:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574717.091421:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453361107968/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574717.091422:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453361107328/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574742 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574717.091457:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574717.091462:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574717.091468:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361107328:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574717.091475:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361107456:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574717.091499:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574717.091512:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574717/real 1788574717]  req@ffff8dc020494380 x1875453361107456/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574742 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574717.091526:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453361107456/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574742 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574717.091533:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574717.091536:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574717.091538:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361107456:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574717.091543:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361107584:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574717.091559:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574717.091566:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574717/real 1788574717]  req@ffff8dc020494700 x1875453361107584/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574742 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574717.091574:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361107584/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574742 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574717.091580:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574717.091582:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574717.091584:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361107584:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574717.091588:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361107712:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574717.091599:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574717.091605:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574717/real 1788574717]  req@ffff8dc020494e00 x1875453361107712/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574742 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574717.091613:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453361107712/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574742 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574717.091619:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574717.091621:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574717.091623:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361107712:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574717.091635:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361107840:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574717.091647:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574717.091653:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574717/real 1788574717]  req@ffff8dc020497100 x1875453361107840/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574742 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574717.091666:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453361107840/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574742 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574717.091672:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574717.091673:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574717.091675:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361107840:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574717.091679:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361107968:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574717.091689:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574717.091695:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574717/real 1788574717]  req@ffff8dc020496d80 x1875453361107968/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574742 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574717.091702:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453361107968/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574742 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574717.091708:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574717.091709:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574717.091711:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361107968:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574717.474960:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574717.474960:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574717.474960:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788574717.474987:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574717.474996:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574717.475005:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574718.115021:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574718.498943:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574718.498944:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574718.498950:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574718.498992:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574718.498993:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788574718.499037:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574719.138943:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574719.522994:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574719.522995:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574719.522995:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574719.523032:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574719.523041:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574719.523042:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574720.162960:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574720.546939:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574720.546945:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574720.546963:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788574720.546968:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574720.546988:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574720.547008:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574721.186945:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574721.570959:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574721.570959:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574721.570959:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574721.570965:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574721.570997:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574721.571021:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574722.210930:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574722.210959:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574722.210964:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788574722.210968:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574722.210976:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3067
00000100:00080000:1.0:1788574722.210986:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574722.210992:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574722.211023:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361108096/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574722.211045:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574722.211048:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574722.211050:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574722.211055:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3067
00000100:00080000:1.0:1788574722.211058:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574722.211063:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574722.211072:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574722.211088:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361108096:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788574722.211088:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361108224/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574722.211098:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574722.211101:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574722.211103:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574722.211106:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3067
00000100:00080000:1.0:1788574722.211109:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574722.211113:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574722.211117:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574722.211127:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361108352/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574722.211135:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574722.211138:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574722.211139:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574722.211143:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3067
00000800:00000100:0.0:1788574722.211145:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788574722.211146:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574722.211150:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574722.211154:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574722.211163:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361108480/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574722.211171:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574722.211174:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574722.211176:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574722.211180:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3067
00000100:00080000:1.0:1788574722.211182:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788574722.211184:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574722/real 1788574722]  req@ffff8dc005dc1c00 x1875453361108096/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574747 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574722.211187:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574722.211192:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574722.211203:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361108096/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574747 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574722.211203:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361108608/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574722.211213:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574722.211214:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574722.211216:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574722.211218:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788574722.211218:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574722.211221:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3067
00000100:00100000:0.0:1788574722.211223:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361108096:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574722.211224:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574722.211228:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574722.211232:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574722.211246:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361108224:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574722.211253:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361108736/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574722.211263:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574722.211267:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000800:00000100:0.0:1788574722.211268:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788574722.211269:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574722.211272:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3067
00000100:00080000:1.0:1788574722.211275:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574722.211279:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574722.211284:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574722.211289:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574722/real 1788574722]  req@ffff8dc005dc3800 x1875453361108224/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574747 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574722.211294:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361108864/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574722.211303:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361108224/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574747 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574722.211313:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574722.211317:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574722.211321:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361108224:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574722.211328:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361108352:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574722.211347:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574722.211356:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574722/real 1788574722]  req@ffff8dc005dc0700 x1875453361108352/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574747 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574722.211364:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361108352/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574747 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574722.211371:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574722.211374:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574722.211378:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361108352:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574722.211384:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361108480:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574722.211403:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574722.211414:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574722/real 1788574722]  req@ffff8dc005dc3b80 x1875453361108480/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574747 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574722.211427:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361108480/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574747 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574722.211435:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574722.211437:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574722.211440:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361108480:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574722.211444:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361108608:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574722.211457:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574722.211465:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574722/real 1788574722]  req@ffff8dc005dc2d80 x1875453361108608/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574747 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574722.211473:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361108608/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574747 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574722.211478:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574722.211480:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574722.211482:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361108608:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574722.211494:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361108736:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574722.211504:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574722.211510:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574722/real 1788574722]  req@ffff8dc005dc1180 x1875453361108736/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574747 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574722.211517:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361108736/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574747 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574722.211522:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574722.211524:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574722.211526:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361108736:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574722.211529:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361108864:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574722.211539:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574722.211544:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574722/real 1788574722]  req@ffff8dc005dc0a80 x1875453361108864/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574747 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574722.211551:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361108864/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574747 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574722.211560:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574722.211562:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574722.211564:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361108864:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574722.594923:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574722.594935:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574722.594958:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788574722.594968:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574722.594973:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574722.594990:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574723.234960:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574723.618970:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574723.618970:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574723.618971:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574723.618975:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574723.619005:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574723.619041:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574724.258936:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574724.642961:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574724.643004:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574724.643006:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574724.643054:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788574724.643055:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574724.643071:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574725.282988:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574725.666973:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574725.666975:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574725.666990:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574725.667009:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574725.667036:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574725.667086:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574726.306948:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574726.690953:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574726.690956:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574726.690972:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574726.690996:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574726.690997:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788574726.691012:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574727.330962:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574727.330963:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574727.330973:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788574727.330978:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574727.330989:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3072
00000100:00080000:1.0:1788574727.331000:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574727.331009:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574727.331047:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361108992/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574727.331077:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574727.331081:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574727.331084:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574727.331089:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3072
00000100:00080000:1.0:1788574727.331094:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574727.331099:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574727.331105:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361108992:192.168.202.140@tcp:250:kworker.0
00000008:00100000:1.0:1788574727.331110:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574727.331132:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361109120/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574727.331144:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574727.331148:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574727.331150:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574727.331154:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3072
00000800:00000100:0.0:1788574727.331159:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788574727.331160:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574727.331185:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574727.331191:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574727.331207:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361109248/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574727.331214:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574727/real 1788574727]  req@ffff8dc005dc1500 x1875453361108992/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574752 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574727.331223:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574727.331232:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574727.331235:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574727.331240:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3072
00000100:00100000:0.0:1788574727.331245:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361108992/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574752 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574727.331247:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574727.331256:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574727.331260:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1788574727.331272:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1788574727.331277:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361109376/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574727.331278:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574727.331286:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361108992:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574727.331300:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574727.331304:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574727.331306:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574727.331311:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3072
00000100:00100000:0.0:1788574727.331314:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361109120:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788574727.331317:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574727.331324:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574727.331329:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788574727.331340:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574727.331345:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361109504/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574727.331355:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574727/real 1788574727]  req@ffff8dc005dc0a80 x1875453361109120/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574752 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574727.331360:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574727.331367:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574727.331369:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788574727.331370:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361109120/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574752 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574727.331377:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3072
00000100:00080000:1.0:1788574727.331386:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574727.331387:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574727.331394:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788574727.331394:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574727.331401:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361109120:192.168.202.140@tcp:38:kworker.0
00000008:00100000:1.0:1788574727.331404:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574727.331407:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361109248:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574727.331422:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361109632/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1788574727.331426:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574727.331437:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574727/real 1788574727]  req@ffff8dc005dc1180 x1875453361109248/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574752 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574727.331458:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788574727.331461:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361109248/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574752 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574727.331464:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574727.331469:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574727.331478:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3072
00000100:00080000:1.0:1788574727.331484:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574727.331485:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574727.331490:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:0.0:1788574727.331495:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000008:00100000:1.0:1788574727.331498:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574727.331502:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361109248:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574727.331514:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361109760/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574727.331515:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361109376:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574727.331540:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574727.331551:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574727/real 1788574727]  req@ffff8dc005dc2d80 x1875453361109376/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574752 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574727.331560:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361109376/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574752 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574727.331567:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574727.331569:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574727.331571:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361109376:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574727.331583:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361109504:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574727.331594:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574727.331601:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574727/real 1788574727]  req@ffff8dc005dc3b80 x1875453361109504/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574752 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574727.331608:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361109504/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574752 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574727.331614:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574727.331616:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574727.331617:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361109504:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574727.331621:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361109632:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574727.331631:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574727.331636:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574727/real 1788574727]  req@ffff8dc005dc0700 x1875453361109632/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574752 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574727.331643:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361109632/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574752 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574727.331653:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574727.331655:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574727.331656:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361109632:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574727.331669:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361109760:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574727.331688:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574727.331699:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574727/real 1788574727]  req@ffff8dc005dc3800 x1875453361109760/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574752 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574727.331712:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361109760/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574752 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574727.331720:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574727.331723:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574727.331727:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361109760:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574727.714957:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574727.714957:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574727.714959:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574727.714960:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574727.714990:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574727.715022:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574728.354975:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574728.738950:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574728.738953:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574728.738959:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574728.738960:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574728.738981:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788574728.739034:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574729.378972:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574729.762975:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574729.762975:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574729.762975:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574729.762978:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574729.763006:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574729.763051:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574730.402963:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574730.786973:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574730.786973:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574730.786973:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574730.787003:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574730.787005:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788574730.787009:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574731.427016:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574731.810942:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574731.810942:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574731.810943:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574731.810945:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574731.810970:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574731.811011:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1788574732.450954:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574732.450963:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788574732.450966:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788574732.450974:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788574732.450976:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3078
00000100:00080000:2.0:1788574732.450987:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574732.450994:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574732.451025:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453361109888/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574732.451050:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574732.451053:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574732.451054:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574732.451057:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3078
00000100:00080000:2.0:1788574732.451060:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574732.451063:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574732.451072:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574732.451083:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361110016/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788574732.451089:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361109888:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788574732.451093:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574732.451099:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574732.451102:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574732.451106:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3078
00000100:00080000:2.0:1788574732.451109:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574732.451111:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574732.451115:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574732.451125:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361110144/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574732.451131:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574732.451134:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574732.451135:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574732.451138:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3078
00000100:00080000:2.0:1788574732.451152:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574732.451155:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574732.451159:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574732.451170:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453361110272/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788574732.451172:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788574732.451181:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574732.451184:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574732.451186:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574732.451190:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3078
00000100:00080000:2.0:1788574732.451193:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574732.451203:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574732.451208:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574732.451222:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361110400/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574732.451232:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574732.451235:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574732.451238:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574732.451242:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3078
00000100:00080000:2.0:1788574732.451246:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574732.451251:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574732.451256:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574732.451268:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361110528/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574732.451278:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788574732.451279:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574732/real 1788574732]  req@ffff8dc020497480 x1875453361109888/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574757 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574732.451283:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574732.451285:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574732.451290:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3078
00000100:00080000:2.0:1788574732.451293:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574732.451301:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574732.451310:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574732.451320:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453361109888/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574757 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574732.451326:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453361110656/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574732.451330:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574732.451337:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574732.451344:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361109888:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788574732.451366:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361110016:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788574732.451385:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574732.451510:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574732/real 1788574732]  req@ffff8dc020495880 x1875453361110016/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574757 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574732.451523:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361110016/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574757 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574732.451531:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574732.451594:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574732.451599:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361110016:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574732.451605:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361110144:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574732.451625:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574732.451634:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574732/real 1788574732]  req@ffff8dc020495180 x1875453361110144/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574757 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574732.451647:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361110144/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574757 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574732.451653:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574732.451655:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574732.451657:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361110144:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574732.451661:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361110272:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574732.451673:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574732.451679:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574732/real 1788574732]  req@ffff8dc020494a80 x1875453361110272/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574757 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574732.451686:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453361110272/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574757 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574732.451692:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574732.451693:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574732.451695:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361110272:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574732.451699:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361110400:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788574732.451738:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574732.451745:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574732/real 1788574732]  req@ffff8dc020495500 x1875453361110400/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574757 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574732.451753:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361110400/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574757 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574732.451763:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574732.451765:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574732.451767:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361110400:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574732.451771:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361110528:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574732.451782:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574732.451787:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574732/real 1788574732]  req@ffff8dc020494000 x1875453361110528/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574757 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574732.451795:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361110528/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574757 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574732.451800:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574732.451801:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574732.451803:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361110528:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574732.451806:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361110656:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574732.451817:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574732.451822:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574732/real 1788574732]  req@ffff8dc020496d80 x1875453361110656/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574757 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574732.451829:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453361110656/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574757 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574732.451834:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574732.451836:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574732.451838:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361110656:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574732.834971:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574732.834971:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574732.834971:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574732.835005:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574732.835025:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574732.835040:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574733.474988:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574733.858946:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574733.858946:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574733.858955:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574733.858971:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574733.858986:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574733.858987:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574734.498970:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574734.882957:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574734.882958:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574734.882961:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574734.883019:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574734.883123:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574734.883126:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574735.523035:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574735.906949:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574735.906963:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574735.906971:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574735.906981:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574735.906997:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574735.907010:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574736.547000:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574736.930969:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574736.930970:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574736.931001:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574736.931013:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574736.931032:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574736.931044:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00080000:3.0:1788574737.570989:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788574737.570999:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788574737.571004:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788574737.571012:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574737.571026:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3083
00000100:00080000:3.0:1788574737.571039:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574737.571048:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788574737.571094:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c380 x1875453361110784/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574737.571136:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574737.571140:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574737.571141:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574737.571145:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3083
00000100:00080000:3.0:1788574737.571148:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574737.571152:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574737.571165:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574737.571177:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f480 x1875453361110912/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574737.571185:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574737.571188:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574737.571189:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574737.571193:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3083
00000100:00080000:3.0:1788574737.571195:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574737.571197:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574737.571202:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574737.571206:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361110784:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788574737.571213:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d180 x1875453361111040/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574737.571223:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574737.571225:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574737.571226:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574737.571228:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3083
00000100:00080000:3.0:1788574737.571230:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574737.571232:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574737.571234:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574737.571256:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e680 x1875453361111168/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574737.571264:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574737.571267:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574737.571269:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574737.571272:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3083
00000100:00080000:3.0:1788574737.571275:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574737.571278:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574737.571283:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574737.571291:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c700 x1875453361111296/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574737.571298:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574737.571301:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574737.571302:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574737.571305:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3083
00000100:00080000:3.0:1788574737.571307:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574737.571309:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574737.571312:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788574737.571318:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574737.571324:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e300 x1875453361111424/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574737.571331:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574737.571333:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574737.571334:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574737.571337:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3083
00000100:00080000:3.0:1788574737.571339:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574737.571342:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574737.571345:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574737.571352:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644df80 x1875453361111552/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574737.571384:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574737/real 1788574737]  req@ffff8dc00644c380 x1875453361110784/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574762 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574737.571408:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453361110784/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574762 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574737.571421:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574737.571427:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574737.571432:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361110784:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788574737.571440:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361110912:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574737.571468:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574737.571484:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574737/real 1788574737]  req@ffff8dc00644f480 x1875453361110912/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574762 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574737.571499:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453361110912/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574762 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574737.571511:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574737.571514:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574737.571519:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361110912:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574737.571551:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361111040:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574737.571578:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574737.571591:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574737/real 1788574737]  req@ffff8dc00644d180 x1875453361111040/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574762 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574737.571605:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453361111040/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574762 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574737.571615:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574737.571619:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574737.571623:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361111040:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574737.571630:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361111168:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574737.571650:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574737.571663:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574737/real 1788574737]  req@ffff8dc00644e680 x1875453361111168/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574762 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574737.571675:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453361111168/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574762 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574737.571685:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574737.571688:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574737.571692:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361111168:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574737.571699:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361111296:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574737.571717:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574737.571728:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574737/real 1788574737]  req@ffff8dc00644c700 x1875453361111296/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574762 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574737.571741:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453361111296/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574762 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574737.571752:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574737.571755:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574737.571759:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361111296:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574737.571765:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361111424:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574737.571784:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574737.571795:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574737/real 1788574737]  req@ffff8dc00644e300 x1875453361111424/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574762 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574737.571808:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453361111424/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574762 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574737.571816:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574737.571820:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574737.571823:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361111424:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574737.571829:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361111552:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574737.571847:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574737.571858:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574737/real 1788574737]  req@ffff8dc00644df80 x1875453361111552/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574762 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574737.571910:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644df80 x1875453361111552/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574762 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574737.571920:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574737.571924:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574737.571927:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361111552:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574737.955026:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574737.955026:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574737.955044:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574737.955057:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574737.955073:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574737.955076:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574738.595024:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574738.979007:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574738.979030:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574738.979033:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574738.979060:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574738.979075:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574738.979090:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574739.618958:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574740.003012:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574740.003018:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574740.003030:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574740.003061:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574740.003064:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574740.003076:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574740.642979:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574741.027006:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574741.027007:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574741.027037:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574741.027042:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574741.027083:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574741.027127:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574741.666982:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574742.050982:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574742.050985:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574742.050987:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574742.050990:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574742.051040:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788574742.051091:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1788574742.690972:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574742.690982:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788574742.690985:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574742.690999:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3088
00000100:00100000:3.0:1788574742.691007:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574742.691009:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574742.691020:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574742.691061:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361111680/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574742.691091:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574742.691096:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574742.691098:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574742.691103:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3088
00000100:00080000:0.0:1788574742.691110:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574742.691116:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788574742.691125:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361111680:192.168.202.140@tcp:250:kworker.0
00000008:00100000:0.0:1788574742.691127:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574742.691147:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361111808/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574742.691160:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574742.691164:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574742.691166:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574742.691171:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3088
00000100:00080000:0.0:1788574742.691176:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574742.691180:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:3.0:1788574742.691184:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:0.0:1788574742.691190:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574742.691208:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361111936/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574742.691219:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788574742.691223:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574742/real 1788574742]  req@ffff8dc006710e00 x1875453361111680/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574767 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574742.691226:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574742.691232:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574742.691241:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3088
00000100:00080000:0.0:1788574742.691245:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788574742.691246:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361111680/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574767 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574742.691251:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574742.691262:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788574742.691264:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574742.691270:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574742.691274:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361111680:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788574742.691278:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361112064/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574742.691291:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574742.691294:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574742.691297:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788574742.691298:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361111808:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788574742.691304:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3088
00000100:00080000:0.0:1788574742.691308:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574742.691311:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574742.691315:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788574742.691323:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574742.691327:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361112192/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574742.691336:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574742.691341:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:3.0:1788574742.691341:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574742/real 1788574742]  req@ffff8dc006713b80 x1875453361111808/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574767 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574742.691342:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574742.691349:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3088
00000100:00080000:0.0:1788574742.691353:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574742.691360:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574742.691366:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574742.691377:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361111808/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574767 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574742.691378:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361112320/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574742.691402:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574742.691407:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574742.691408:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574742.691410:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574742.691412:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3088
00000100:00080000:0.0:1788574742.691419:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574742.691422:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788574742.691426:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788574742.691431:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361111808:192.168.202.140@tcp:38:kworker.0
00000008:00100000:0.0:1788574742.691432:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574742.691440:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361111936:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574742.691445:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361112448/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788574742.691468:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574742.691477:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574742/real 1788574742]  req@ffff8dc006713100 x1875453361111936/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574767 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574742.691485:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361111936/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574767 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574742.691491:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574742.691494:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574742.691496:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361111936:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574742.691499:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361112064:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574742.691510:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574742.691516:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574742/real 1788574742]  req@ffff8dc006712a00 x1875453361112064/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574767 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574742.691523:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361112064/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574767 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574742.691529:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574742.691530:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574742.691532:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361112064:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574742.691543:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361112192:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788574742.691554:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574742.691561:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574742/real 1788574742]  req@ffff8dc006713800 x1875453361112192/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574767 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574742.691568:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361112192/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574767 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574742.691573:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574742.691575:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574742.691577:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361112192:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574742.691581:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361112320:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574742.691591:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574742.691596:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574742/real 1788574742]  req@ffff8dc006710e00 x1875453361112320/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574767 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574742.691603:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361112320/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574767 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574742.691608:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574742.691610:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574742.691612:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361112320:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574742.691615:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361112448:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574742.691624:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574742.691630:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574742/real 1788574742]  req@ffff8dc006711880 x1875453361112448/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574767 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574742.691641:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361112448/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574767 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574742.691646:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574742.691648:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574742.691650:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361112448:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574743.074995:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574743.074995:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574743.074995:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574743.075007:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574743.075032:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574743.075111:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574743.714968:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574744.099016:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574744.099028:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574744.099029:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574744.099037:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574744.099065:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788574744.099146:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574744.738980:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574745.122967:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574745.122967:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574745.123009:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574745.123031:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574745.123032:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574745.123043:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574745.762944:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574746.146996:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574746.146997:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574746.147023:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574746.147059:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574746.147060:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788574746.147062:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574746.786979:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574747.170960:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574747.170979:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574747.171002:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574747.171027:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574747.171058:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574747.171061:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574747.810935:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574747.810974:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574747.810979:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788574747.810983:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574747.810990:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3093
00000100:00080000:1.0:1788574747.810999:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574747.811005:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574747.811037:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361112576/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574747.811058:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574747.811060:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574747.811062:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574747.811065:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3093
00000100:00080000:1.0:1788574747.811068:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574747.811071:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574747.811079:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574747.811089:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361112576:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788574747.811093:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361112704/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574747.811102:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574747.811104:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574747.811105:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574747.811108:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3093
00000100:00080000:1.0:1788574747.811110:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574747.811112:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574747.811116:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574747.811133:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361112832/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574747.811139:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574747.811142:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574747.811144:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574747.811146:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3093
00000100:00080000:1.0:1788574747.811148:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574747.811150:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574747.811154:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788574747.811156:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574747.811164:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361112960/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574747.811175:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574747.811178:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574747.811179:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574747.811181:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3093
00000100:00080000:1.0:1788574747.811183:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574747.811186:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574747.811188:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574747.811197:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361113088/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788574747.811204:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574747/real 1788574747]  req@ffff8dc005dc1c00 x1875453361112576/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574772 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574747.811205:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574747.811213:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574747.811216:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574747.811224:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3093
00000100:00080000:1.0:1788574747.811228:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574747.811231:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574747.811234:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574747.811239:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361112576/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574772 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574747.811243:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361113216/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574747.811263:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574747.811264:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574747.811266:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574747.811270:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574747.811273:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788574747.811276:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3093
00000100:00080000:1.0:1788574747.811280:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788574747.811283:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361112576:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574747.811285:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574747.811291:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574747.811302:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361113344/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788574747.811329:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361112704:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788574747.811355:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574747.811368:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574747/real 1788574747]  req@ffff8dc005dc3800 x1875453361112704/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574772 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574747.811381:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361112704/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574772 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574747.811392:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574747.811395:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574747.811399:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361112704:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574747.811413:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361112832:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574747.811432:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574747.811444:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574747/real 1788574747]  req@ffff8dc005dc0700 x1875453361112832/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574772 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574747.811456:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361112832/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574772 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574747.811464:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574747.811467:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574747.811471:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361112832:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574747.811477:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361112960:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574747.811494:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574747.811512:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574747/real 1788574747]  req@ffff8dc005dc3b80 x1875453361112960/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574772 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574747.811524:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361112960/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574772 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574747.811533:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574747.811536:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574747.811539:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361112960:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574747.811545:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361113088:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788574747.811564:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574747.811575:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574747/real 1788574747]  req@ffff8dc005dc2d80 x1875453361113088/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574772 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574747.811585:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361113088/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574772 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574747.811591:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574747.811594:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574747.811596:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361113088:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574747.811600:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361113216:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574747.811613:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574747.811620:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574747/real 1788574747]  req@ffff8dc005dc1180 x1875453361113216/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574772 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574747.811634:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361113216/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574772 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574747.811644:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574747.811646:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574747.811648:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361113216:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574747.811651:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361113344:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574747.811662:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574747.811668:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574747/real 1788574747]  req@ffff8dc005dc0a80 x1875453361113344/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574772 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574747.811675:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361113344/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574772 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574747.811680:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574747.811682:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574747.811684:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361113344:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574748.194977:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574748.194978:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574748.194987:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574748.195007:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574748.195024:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788574748.195031:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574748.834970:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574749.218983:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574749.218989:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574749.219006:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574749.219029:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574749.219067:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574749.219084:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574749.858998:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574750.242963:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574750.242978:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788574750.243011:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574750.243021:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574750.243025:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574750.243029:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574750.882972:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574751.266973:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574751.266973:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574751.266984:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574751.267009:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574751.267041:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788574751.267092:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574751.906965:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574752.291029:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574752.291030:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574752.291057:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574752.291064:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574752.291073:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788574752.291161:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574752.931052:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788574752.931053:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574752.931072:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788574752.931076:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574752.931087:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3098
00000100:00080000:2.0:1788574752.931098:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574752.931107:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574752.931170:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453361113472/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574752.931200:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574752.931204:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574752.931206:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574752.931211:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3098
00000100:00080000:2.0:1788574752.931216:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574752.931221:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574752.931231:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574752.931242:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361113472:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788574752.931246:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453361113600/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574752.931256:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574752.931259:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574752.931261:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574752.931264:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3098
00000100:00080000:2.0:1788574752.931267:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574752.931270:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574752.931274:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574752.931283:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361113728/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574752.931290:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574752.931293:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574752.931294:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574752.931296:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3098
00000100:00080000:2.0:1788574752.931299:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574752.931301:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574752.931304:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574752.931311:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453361113856/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574752.931316:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574752.931318:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574752.931319:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574752.931322:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3098
00000100:00080000:2.0:1788574752.931323:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574752.931326:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574752.931329:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574752.931351:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453361113984/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788574752.931359:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361113600:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788574752.931362:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574752.931372:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574752.931374:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574752.931377:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3098
00000100:00080000:2.0:1788574752.931380:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574752.931383:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574752.931387:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574752.931398:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453361114112/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788574752.931405:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361113728:192.168.202.140@tcp:8:kworker.0
00000100:00080000:2.0:1788574752.931406:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574752.931415:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574752.931417:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574752.931420:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3098
00000100:00080000:2.0:1788574752.931423:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574752.931425:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574752.931429:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574752.931439:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361114240/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788574752.931443:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361113856:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574752.931482:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361113984:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574752.931505:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361114112:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574752.931555:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361114240:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574753.314936:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574753.314960:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574753.314963:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574753.314967:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574753.314985:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788574753.315058:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574753.954995:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574754.339012:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574754.339012:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574754.339012:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574754.339012:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574754.339048:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788574754.339109:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574754.978986:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574755.362965:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574755.362991:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574755.363019:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574755.363021:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574755.363047:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788574755.363079:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574756.002933:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000400:00000100:1.0:1788574756.003153:0:2337:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.140:988
00000400:00000100:1.0:1788574756.003191:0:2337:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.140@tcp at host 192.168.202.140 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:1.0:1788574756.003209:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788574756.003248:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788574756.003258:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788574756.003266:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788574756.003273:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788574756.003291:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:3.0:1788574756.003296:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574752/real 1788574756]  req@ffff8dc020494e00 x1875453361113600/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574777 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:1.0:1788574756.003299:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:3.0:1788574756.003320:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453361113600/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574777 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574756.003336:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574756.003341:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574756.003346:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361113600:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574756.003354:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574752/real 1788574756]  req@ffff8dc020494700 x1875453361113728/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574777 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574756.003375:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361113728/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574777 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574756.003385:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574756.003389:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574756.003393:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361113728:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574756.003399:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574752/real 1788574756]  req@ffff8dc020494380 x1875453361113856/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574777 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574756.003418:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453361113856/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574777 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574756.003428:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574756.003431:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574756.003434:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361113856:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574756.003441:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574752/real 1788574756]  req@ffff8dc020497100 x1875453361113472/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574777 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574756.003452:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453361113472/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574777 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574756.003459:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574756.003462:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574756.003466:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361113472:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788574756.003496:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574752/real 1788574756]  req@ffff8dc020496a00 x1875453361113984/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574777 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574756.003509:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453361113984/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574777 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574756.003518:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574756.003521:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574756.003526:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361113984:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574756.003532:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574752/real 1788574756]  req@ffff8dc020496d80 x1875453361114112/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574777 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574756.003543:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453361114112/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574777 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574756.003550:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574756.003553:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574756.003556:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361114112:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574756.003562:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574752/real 1788574756]  req@ffff8dc020494000 x1875453361114240/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574777 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574756.003573:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361114240/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574777 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574756.003580:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574756.003583:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574756.003586:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361114240:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574756.386971:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574756.386973:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574756.386978:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574756.387001:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574756.387003:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574756.387010:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574757.026975:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574757.410964:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574757.410964:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574757.410964:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574757.411010:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574757.411021:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788574757.411034:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574758.051004:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788574758.051030:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574758.051040:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788574758.051046:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574758.051060:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3103
00000100:00080000:3.0:1788574758.051073:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574758.051081:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788574758.051129:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ed80 x1875453361114368/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574758.051167:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574758.051170:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574758.051172:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574758.051176:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3103
00000100:00080000:3.0:1788574758.051179:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574758.051183:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574758.051195:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574758.051209:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644fb80 x1875453361114496/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574758.051218:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574758.051222:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574758.051225:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574758.051231:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3103
00000100:00100000:0.0:1788574758.051232:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361114368:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788574758.051237:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574758.051245:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574758.051250:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574758.051272:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d880 x1875453361114624/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574758.051301:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574758.051309:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574758.051312:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1788574758.051318:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788574758.051324:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3103
00000100:00080000:3.0:1788574758.051332:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574758.051338:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574758.051346:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574758.051368:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f100 x1875453361114752/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574758.051373:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574758/real 1788574758]  req@ffff8dc00644ed80 x1875453361114368/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574783 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574758.051401:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574758.051409:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574758.051412:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574758.051419:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3103
00000100:00100000:0.0:1788574758.051426:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ed80 x1875453361114368/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574783 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574758.051433:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574758.051445:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574758.051455:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574758.051472:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644df80 x1875453361114880/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574758.051482:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574758.051486:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574758.051487:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574758.051492:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3103
00000100:00080000:3.0:1788574758.051500:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574758.051504:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574758.051509:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1788574758.051519:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1788574758.051523:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e300 x1875453361115008/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574758.051533:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788574758.051544:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574758.051549:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574758.051551:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574758.051565:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3103
00000100:00100000:0.0:1788574758.051568:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361114368:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788574758.051572:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574758.051580:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574758.051587:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574758.051610:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c700 x1875453361115136/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574758.051669:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361114496:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574758.051758:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574758.051791:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574758/real 1788574758]  req@ffff8dc00644fb80 x1875453361114496/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574783 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574758.051820:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644fb80 x1875453361114496/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574783 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574758.051848:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574758.051853:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574758.051857:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361114496:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574758.051956:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361114624:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574758.052024:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574758.052038:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574758/real 1788574758]  req@ffff8dc00644d880 x1875453361114624/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574783 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574758.052050:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d880 x1875453361114624/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574783 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574758.052073:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574758.052077:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574758.052080:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361114624:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574758.052102:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361114752:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574758.052142:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574758.052169:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574758/real 1788574758]  req@ffff8dc00644f100 x1875453361114752/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574783 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574758.052193:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f100 x1875453361114752/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574783 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574758.052202:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574758.052222:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574758.052226:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361114752:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574758.052233:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361114880:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574758.052287:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574758.052302:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574758/real 1788574758]  req@ffff8dc00644df80 x1875453361114880/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574783 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574758.052331:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644df80 x1875453361114880/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574783 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574758.052359:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574758.052364:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574758.052384:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361114880:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574758.052393:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361115008:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574758.052450:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574758.052464:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574758/real 1788574758]  req@ffff8dc00644e300 x1875453361115008/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574783 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574758.052492:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453361115008/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574783 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574758.052516:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574758.052520:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574758.052524:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361115008:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574758.052531:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361115136:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574758.052569:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574758.052581:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574758/real 1788574758]  req@ffff8dc00644c700 x1875453361115136/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574783 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574758.052607:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453361115136/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574783 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574758.052615:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574758.052632:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574758.052637:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361115136:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574758.435032:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574758.435040:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574758.435040:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574758.435074:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574758.435092:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788574758.435110:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574759.075007:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574759.459020:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574759.459038:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574759.459064:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574759.459077:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574759.459113:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574759.459134:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574760.098965:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574760.483005:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574760.483026:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574760.483026:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788574760.483054:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574760.483068:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574760.483077:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574761.122951:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574761.506995:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574761.507017:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574761.507022:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574761.507032:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574761.507085:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574761.507133:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574762.146998:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574762.530983:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574762.531024:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574762.531031:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574762.531038:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574762.531039:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574762.531067:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00080000:2.0:1788574763.170998:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788574763.170998:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788574763.171010:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788574763.171021:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574763.171031:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3108
00000100:00080000:2.0:1788574763.171041:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574763.171048:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574763.171084:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361115264/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574763.171112:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574763.171118:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574763.171120:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574763.171124:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3108
00000100:00080000:2.0:1788574763.171127:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574763.171132:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574763.171142:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574763.171158:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361115264:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788574763.171158:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453361115392/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574763.171175:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574763.171179:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574763.171181:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574763.171185:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3108
00000100:00080000:2.0:1788574763.171189:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574763.171193:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574763.171198:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574763.171211:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361115520/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574763.171220:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574763.171224:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574763.171226:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574763.171232:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3108
00000800:00000100:0.0:1788574763.171235:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788574763.171238:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574763.171244:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574763.171250:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574763.171262:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361115648/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574763.171272:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574763.171276:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574763.171278:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574763.171284:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3108
00000100:00100000:0.0:1788574763.171285:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574763/real 1788574763]  req@ffff8dc020495500 x1875453361115264/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574788 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574763.171288:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574763.171298:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574763.171307:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574763.171321:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453361115776/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574763.171323:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361115264/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574788 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574763.171349:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574763.171351:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574763.171356:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574763.171360:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788574763.171362:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788574763.171369:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361115264:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788574763.171370:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3108
00000100:00080000:2.0:1788574763.171379:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574763.171385:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574763.171389:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574763.171401:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361115392:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574763.171403:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361115904/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574763.171419:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574763.171422:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574763.171425:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574763.171430:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3108
00000100:00080000:2.0:1788574763.171434:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1788574763.171436:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788574763.171443:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574763.171449:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574763.171454:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574763/real 1788574763]  req@ffff8dc020494a80 x1875453361115392/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574788 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574763.171464:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361116032/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574763.171466:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453361115392/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574788 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574763.171500:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574763.171506:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574763.171511:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361115392:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574763.171519:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361115520:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574763.171543:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574763.171556:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574763/real 1788574763]  req@ffff8dc020495180 x1875453361115520/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574788 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574763.171567:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361115520/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574788 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574763.171573:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574763.171575:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574763.171578:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361115520:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574763.171582:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361115648:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574763.171597:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574763.171604:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574763/real 1788574763]  req@ffff8dc020495880 x1875453361115648/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574788 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574763.171611:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361115648/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574788 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574763.171617:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574763.171618:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574763.171620:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361115648:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574763.171624:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361115776:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574763.171635:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574763.171641:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574763/real 1788574763]  req@ffff8dc020497480 x1875453361115776/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574788 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574763.171648:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453361115776/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574788 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574763.171653:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574763.171655:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574763.171657:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361115776:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574763.171669:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361115904:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574763.171679:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574763.171685:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574763/real 1788574763]  req@ffff8dc020495500 x1875453361115904/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574788 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574763.171692:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361115904/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574788 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574763.171697:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574763.171699:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574763.171701:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361115904:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574763.171704:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361116032:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574763.171714:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574763.171719:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574763/real 1788574763]  req@ffff8dc020494000 x1875453361116032/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574788 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574763.171731:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361116032/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574788 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574763.171736:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574763.171737:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574763.171739:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361116032:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574763.554943:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574763.554949:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574763.554969:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574763.554996:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574763.555014:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574763.555019:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574764.194963:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574764.578963:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574764.578963:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574764.578964:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574764.578997:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574764.579000:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574764.579013:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574765.218945:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574765.602927:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574765.602948:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788574765.602976:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574765.602979:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574765.603062:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574765.603074:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574766.242989:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574766.626971:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574766.626971:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574766.626972:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574766.626975:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574766.627009:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574766.627040:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574767.266977:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574767.650988:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574767.650988:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574767.650988:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574767.651024:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574767.651034:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574767.651059:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00080000:2.0:1788574768.290982:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574768.290990:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788574768.290995:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574768.291004:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3113
00000100:00100000:0.0:1788574768.291005:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788574768.291014:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574768.291022:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574768.291055:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453361116160/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574768.291086:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574768.291090:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574768.291092:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574768.291098:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3113
00000100:00080000:2.0:1788574768.291103:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574768.291109:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574768.291121:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574768.291123:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361116160:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788574768.291141:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453361116288/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574768.291154:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574768.291158:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574768.291161:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574768.291166:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3113
00000100:00080000:2.0:1788574768.291180:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574768.291185:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574768.291192:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788574768.291192:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574768.291210:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453361116416/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574768.291220:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574768.291223:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574768.291225:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574768.291230:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3113
00000100:00100000:3.0:1788574768.291235:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574768/real 1788574768]  req@ffff8dc020496d80 x1875453361116160/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574793 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574768.291245:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788574768.291253:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453361116160/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574793 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574768.291254:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574768.291264:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788574768.291267:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574768.291272:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574768.291275:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361116160:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788574768.291282:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453361116544/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574768.291294:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788574768.291298:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361116288:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788574768.291300:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574768.291306:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574768.291313:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3113
00000100:00080000:2.0:1788574768.291318:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574768.291323:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:3.0:1788574768.291328:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:2.0:1788574768.291333:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574768.291341:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574768/real 1788574768]  req@ffff8dc020496a00 x1875453361116288/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574793 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574768.291357:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361116672/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574768.291367:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574768.291369:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574768.291371:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574768.291374:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3113
00000100:00080000:2.0:1788574768.291376:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574768.291379:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574768.291382:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574768.291390:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453361116800/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574768.291407:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574768.291419:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574768.291421:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574768.291426:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3113
00000100:00100000:3.0:1788574768.291429:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453361116288/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574793 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574768.291432:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574768.291441:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:3.0:1788574768.291444:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:2.0:1788574768.291449:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788574768.291450:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574768.291455:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361116288:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574768.291467:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453361116928/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788574768.291566:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361116416:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574768.291590:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574768.291604:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574768/real 1788574768]  req@ffff8dc020497100 x1875453361116416/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574793 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574768.291686:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453361116416/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574793 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574768.291693:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574768.291695:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574768.291698:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361116416:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574768.291703:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361116544:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574768.291720:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574768.291729:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574768/real 1788574768]  req@ffff8dc020494380 x1875453361116544/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574793 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574768.291736:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453361116544/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574793 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574768.291742:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574768.291745:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574768.291747:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361116544:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574768.291758:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361116672:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788574768.291769:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574768.291775:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574768/real 1788574768]  req@ffff8dc020494700 x1875453361116672/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574793 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574768.291783:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361116672/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574793 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574768.291792:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574768.291795:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574768.291797:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361116672:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574768.291800:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361116800:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574768.291812:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574768.291822:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574768/real 1788574768]  req@ffff8dc020494e00 x1875453361116800/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574793 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574768.291834:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453361116800/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574793 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574768.291842:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574768.291846:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574768.291850:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361116800:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574768.291856:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361116928:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574768.291901:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574768.291912:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574768/real 1788574768]  req@ffff8dc020496d80 x1875453361116928/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574793 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574768.291921:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453361116928/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574793 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574768.291928:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574768.291930:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574768.291934:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361116928:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574768.674995:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574768.675008:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574768.675031:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574768.675057:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574768.675060:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574768.675078:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574769.316972:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574769.699027:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574769.699034:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574769.699034:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574769.699045:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574769.699080:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574769.699091:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574770.339039:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574770.722954:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574770.722954:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574770.722955:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574770.722960:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574770.722988:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574770.723022:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574771.362962:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574771.746972:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574771.746976:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574771.747001:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574771.747018:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574771.747020:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574771.747032:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574772.387018:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574772.770951:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574772.770956:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574772.770958:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574772.770976:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574772.770986:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574772.770994:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574773.411051:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574773.411059:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574773.411073:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788574773.411078:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574773.411104:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3119
00000100:00080000:0.0:1788574773.411115:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574773.411143:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574773.411206:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361117056/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574773.411233:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574773.411236:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574773.411238:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574773.411246:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3119
00000100:00080000:0.0:1788574773.411250:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574773.411262:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574773.411272:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574773.411281:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361117056:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788574773.411284:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453361117184/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574773.411296:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574773.411298:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574773.411300:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574773.411303:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3119
00000100:00080000:0.0:1788574773.411306:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574773.411319:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574773.411323:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574773.411332:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361117312/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574773.411340:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574773.411343:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574773.411345:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574773.411347:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3119
00000100:00080000:0.0:1788574773.411350:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574773.411356:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:3.0:1788574773.411356:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:0.0:1788574773.411373:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574773.411383:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361117440/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788574773.411399:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574773/real 1788574773]  req@ffff8dc006711c00 x1875453361117056/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574798 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574773.411403:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574773.411412:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574773.411423:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574773.411429:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3119
00000100:00080000:0.0:1788574773.411432:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788574773.411433:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361117056/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574798 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574773.411438:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574773.411445:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574773.411456:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361117568/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574773.411469:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574773.411476:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788574773.411481:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788574773.411484:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361117056:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788574773.411485:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574773.411494:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574773.411498:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3119
00000100:00100000:3.0:1788574773.411524:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361117184:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788574773.411527:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574773.411536:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574773.411541:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574773.411557:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361117696/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788574773.411563:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574773.411580:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574773/real 1788574773]  req@ffff8dc006710380 x1875453361117184/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574798 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574773.411597:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453361117184/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574798 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574773.411603:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574773.411610:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574773.411613:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574773.411630:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3119
00000100:00080000:3.0:1788574773.411631:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574773.411634:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574773.411639:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574773.411645:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361117184:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788574773.411653:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788574773.411657:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361117312:192.168.202.140@tcp:8:kworker.0
00000008:00100000:0.0:1788574773.411661:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788574773.411683:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574773.411700:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574773/real 1788574773]  req@ffff8dc006712680 x1875453361117312/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574798 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574773.411709:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361117824/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788574773.411714:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361117312/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574798 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574773.411729:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574773.411732:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574773.411734:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361117312:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574773.411743:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361117440:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574773.411762:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574773.411773:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574773/real 1788574773]  req@ffff8dc006713480 x1875453361117440/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574798 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574773.411780:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361117440/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574798 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574773.411787:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574773.411788:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574773.411791:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361117440:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574773.411795:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361117568:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788574773.411810:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574773.411820:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574773/real 1788574773]  req@ffff8dc006711500 x1875453361117568/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574798 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574773.411832:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361117568/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574798 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574773.411841:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574773.411846:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574773.411850:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361117568:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574773.411903:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361117696:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574773.411927:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574773.411937:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574773/real 1788574773]  req@ffff8dc006712300 x1875453361117696/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574798 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574773.411945:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361117696/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574798 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574773.411951:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574773.411953:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574773.411955:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361117696:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574773.411959:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361117824:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574773.411971:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574773.411978:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574773/real 1788574773]  req@ffff8dc006711c00 x1875453361117824/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574798 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574773.411985:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361117824/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574798 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574773.411990:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574773.411991:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574773.411993:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361117824:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574773.794993:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574773.794994:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574773.794995:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574773.795026:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574773.795046:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574773.795050:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574774.435043:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574774.819011:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574774.819012:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574774.819019:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574774.819063:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574774.819082:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788574774.819090:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574775.459004:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574775.842998:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574775.842998:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574775.842998:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574775.843030:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574775.843033:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574775.843039:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574776.483016:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574776.867019:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574776.867019:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574776.867020:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574776.867077:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574776.867085:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574776.867095:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574777.506961:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574777.890978:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574777.890978:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574777.891008:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574777.891009:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574777.891044:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574777.891079:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574778.530949:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574778.530970:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574778.530977:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788574778.530981:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574778.530990:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3124
00000100:00080000:1.0:1788574778.530999:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574778.531005:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574778.531044:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361117952/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574778.531069:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574778.531073:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574778.531075:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574778.531078:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3124
00000100:00080000:1.0:1788574778.531082:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574778.531086:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574778.531095:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574778.531102:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361117952:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788574778.531111:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361118080/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574778.531128:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574778.531131:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574778.531133:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574778.531136:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3124
00000100:00080000:1.0:1788574778.531139:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574778.531142:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574778.531146:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574778.531157:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361118208/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574778.531166:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1788574778.531167:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788574778.531172:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574778.531174:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574778.531178:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3124
00000100:00080000:1.0:1788574778.531182:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574778.531186:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574778.531190:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574778.531200:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361118336/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788574778.531208:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574778/real 1788574778]  req@ffff8dc005dc1500 x1875453361117952/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574803 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574778.531212:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574778.531221:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574778.531225:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574778.531231:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3124
00000100:00080000:1.0:1788574778.531236:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788574778.531236:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361117952/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574803 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574778.531244:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574778.531252:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788574778.531253:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574778.531260:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574778.531263:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361117952:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788574778.531272:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361118464/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574778.531284:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788574778.531285:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361118080:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788574778.531291:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574778.531295:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574778.531299:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3124
00000100:00080000:1.0:1788574778.531303:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574778.531307:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574778.531312:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788574778.531312:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574778.531327:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361118592/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788574778.531328:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574778/real 1788574778]  req@ffff8dc005dc0a80 x1875453361118080/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574803 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574778.531361:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361118080/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574803 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574778.531376:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574778.531377:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574778.531383:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574778.531385:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574778.531389:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788574778.531391:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3124
00000100:00080000:1.0:1788574778.531395:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788574778.531395:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361118080:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788574778.531402:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788574778.531406:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361118208:192.168.202.140@tcp:8:kworker.0
00000008:00100000:1.0:1788574778.531409:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574778.531424:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361118720/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788574778.531430:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574778.531442:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574778/real 1788574778]  req@ffff8dc005dc1180 x1875453361118208/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574803 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574778.531453:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361118208/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574803 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574778.531461:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574778.531464:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574778.531466:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361118208:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574778.531472:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361118336:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574778.531485:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574778.531493:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574778/real 1788574778]  req@ffff8dc005dc2d80 x1875453361118336/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574803 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574778.531511:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361118336/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574803 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574778.531518:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574778.531521:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574778.531523:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361118336:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574778.531536:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361118464:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788574778.531550:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574778.531558:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574778/real 1788574778]  req@ffff8dc005dc3b80 x1875453361118464/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574803 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574778.531568:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361118464/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574803 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574778.531574:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574778.531577:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574778.531580:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361118464:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574778.531585:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361118592:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574778.531597:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574778.531604:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574778/real 1788574778]  req@ffff8dc005dc0700 x1875453361118592/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574803 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574778.531612:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361118592/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574803 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574778.531623:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574778.531625:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574778.531628:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361118592:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574778.531632:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361118720:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574778.531643:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574778.531651:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574778/real 1788574778]  req@ffff8dc005dc3800 x1875453361118720/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574803 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574778.531659:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361118720/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574803 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574778.531665:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574778.531668:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574778.531670:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361118720:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574778.914985:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574778.914985:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574778.915010:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574778.915042:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574778.915055:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788574778.915070:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574779.554974:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574779.939027:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574779.939027:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574779.939034:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574779.939062:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574779.939080:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788574779.939086:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574780.578970:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574780.962969:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574780.963084:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574780.963180:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788574780.963454:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574780.963951:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574780.964007:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574781.602974:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574781.986975:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574781.986975:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574781.986982:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574781.987005:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574781.987024:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574781.987043:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574782.626938:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574783.010937:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574783.010949:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574783.010969:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574783.011035:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574783.011043:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574783.011048:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00080000:1.0:1788574783.650947:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788574783.650950:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574783.650958:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788574783.650963:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574783.650972:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3129
00000100:00080000:1.0:1788574783.650982:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574783.650995:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574783.651031:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361118848/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574783.651052:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574783.651054:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574783.651056:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574783.651058:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3129
00000100:00080000:1.0:1788574783.651061:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574783.651063:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574783.651071:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574783.651080:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361118976/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574783.651090:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574783.651092:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574783.651094:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574783.651096:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3129
00000100:00080000:1.0:1788574783.651098:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574783.651100:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574783.651105:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574783.651107:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361118848:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788574783.651113:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361119104/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574783.651120:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574783.651122:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574783.651123:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574783.651125:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3129
00000100:00080000:1.0:1788574783.651127:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574783.651129:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574783.651131:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574783.651140:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361119232/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574783.651146:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574783.651147:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574783.651148:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574783.651150:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3129
00000100:00080000:1.0:1788574783.651153:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574783.651155:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574783.651158:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574783.651163:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361119360/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574783.651169:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1788574783.651173:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788574783.651174:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574783.651177:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574783.651181:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3129
00000100:00080000:1.0:1788574783.651183:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574783.651185:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574783.651205:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574783.651217:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361119488/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574783.651226:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574783.651230:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:3.0:1788574783.651232:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574783/real 1788574783]  req@ffff8dc005dc1c00 x1875453361118848/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574808 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574783.651233:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574783.651241:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3129
00000100:00080000:1.0:1788574783.651247:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574783.651254:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574783.651261:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574783.651269:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361118848/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574808 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574783.651273:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361119616/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574783.651299:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574783.651306:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574783.651310:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361118848:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788574783.651319:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361118976:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788574783.651343:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574783.651354:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574783/real 1788574783]  req@ffff8dc005dc3800 x1875453361118976/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574808 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574783.651366:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361118976/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574808 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574783.651375:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574783.651378:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574783.651382:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361118976:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574783.651403:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361119104:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574783.651418:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574783.651425:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574783/real 1788574783]  req@ffff8dc005dc0700 x1875453361119104/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574808 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574783.651433:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361119104/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574808 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574783.651442:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574783.651443:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574783.651445:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361119104:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574783.651449:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361119232:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574783.651458:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574783.651463:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574783/real 1788574783]  req@ffff8dc005dc3b80 x1875453361119232/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574808 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574783.651469:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361119232/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574808 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574783.651475:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574783.651476:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574783.651478:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361119232:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574783.651481:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361119360:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788574783.651490:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574783.651495:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574783/real 1788574783]  req@ffff8dc005dc2d80 x1875453361119360/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574808 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574783.651502:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361119360/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574808 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574783.651506:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574783.651508:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574783.651510:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361119360:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574783.651513:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361119488:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574783.651522:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574783.651527:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574783/real 1788574783]  req@ffff8dc005dc1180 x1875453361119488/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574808 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574783.651536:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361119488/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574808 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574783.651543:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574783.651546:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574783.651549:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361119488:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574783.651554:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361119616:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574783.651571:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574783.651580:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574783/real 1788574783]  req@ffff8dc005dc0a80 x1875453361119616/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574808 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574783.651590:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361119616/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574808 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574783.651596:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574783.651598:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574783.651601:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361119616:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574784.034973:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574784.034977:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574784.034978:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574784.034981:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574784.035021:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788574784.035041:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574784.674961:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574785.058955:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574785.058955:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574785.058958:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574785.058961:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574785.058989:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788574785.059052:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574785.698978:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574786.082955:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574786.082955:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574786.082957:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574786.082958:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574786.082982:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788574786.083039:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574786.722940:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574787.106942:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574787.106942:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574787.106953:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574787.106962:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574787.106977:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788574787.107034:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574787.746972:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574788.130943:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574788.130943:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574788.130944:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574788.130954:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574788.130974:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788574788.131032:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574788.770961:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788574788.770971:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574788.770978:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788574788.770982:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574788.770991:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3134
00000100:00080000:2.0:1788574788.770999:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574788.771006:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574788.771053:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361119744/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574788.771076:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574788.771080:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574788.771082:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574788.771085:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3134
00000100:00080000:2.0:1788574788.771088:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574788.771092:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574788.771101:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574788.771113:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361119872/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788574788.771127:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361119744:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788574788.771132:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574788.771136:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574788.771138:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574788.771142:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3134
00000100:00080000:2.0:1788574788.771145:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574788.771149:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574788.771153:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574788.771164:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453361120000/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574788.771172:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574788.771176:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574788.771177:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574788.771181:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3134
00000100:00080000:2.0:1788574788.771184:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574788.771189:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:3.0:1788574788.771189:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:2.0:1788574788.771195:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574788.771207:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361120128/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574788.771215:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574788.771218:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574788.771220:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574788.771224:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3134
00000100:00080000:2.0:1788574788.771229:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788574788.771234:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574788/real 1788574788]  req@ffff8dc020494000 x1875453361119744/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574813 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574788.771236:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574788.771244:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574788.771260:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361119744/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574813 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574788.771270:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361120256/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574788.771273:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574788.771282:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788574788.771286:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788574788.771289:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361119744:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788574788.771291:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574788.771296:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574788.771302:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3134
00000100:00080000:2.0:1788574788.771305:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574788.771308:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574788.771312:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574788.771317:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361119872:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574788.771323:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453361120384/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574788.771334:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574788.771338:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574788.771340:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1788574788.771343:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788574788.771347:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3134
00000100:00080000:2.0:1788574788.771352:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574788.771356:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574788.771361:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574788.771361:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574788/real 1788574788]  req@ffff8dc020495500 x1875453361119872/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574813 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574788.771376:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361120512/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788574788.771379:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361119872/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574813 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574788.771408:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574788.771413:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574788.771418:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361119872:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574788.771425:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361120000:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574788.771443:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574788.771451:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574788/real 1788574788]  req@ffff8dc020497480 x1875453361120000/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574813 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574788.771461:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453361120000/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574813 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574788.771470:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574788.771472:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574788.771475:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361120000:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574788.771481:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361120128:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574788.771495:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574788.771503:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574788/real 1788574788]  req@ffff8dc020495880 x1875453361120128/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574813 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574788.771513:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361120128/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574813 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574788.771521:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574788.771524:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574788.771527:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361120128:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574788.771540:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361120256:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788574788.771555:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574788.771564:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574788/real 1788574788]  req@ffff8dc020495180 x1875453361120256/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574813 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574788.771574:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361120256/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574813 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574788.771583:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574788.771585:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574788.771588:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361120256:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574788.771603:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361120384:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574788.771618:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574788.771626:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574788/real 1788574788]  req@ffff8dc020494a80 x1875453361120384/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574813 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574788.771643:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453361120384/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574813 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574788.771650:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574788.771653:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574788.771656:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361120384:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574788.771662:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361120512:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574788.771677:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574788.771685:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574788/real 1788574788]  req@ffff8dc020494000 x1875453361120512/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574813 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574788.771696:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361120512/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574813 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574788.771703:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574788.771706:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574788.771709:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361120512:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574789.154961:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574789.154961:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574789.154961:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574789.154961:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574789.154989:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574789.155049:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574789.794990:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574790.179006:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574790.179006:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574790.179025:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574790.179027:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574790.179041:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574790.179116:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574790.818989:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574791.203008:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574791.203008:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574791.203008:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574791.203021:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574791.203049:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574791.203136:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574791.843024:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574792.226938:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574792.226971:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574792.226972:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574792.226994:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574792.227021:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574792.227059:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574792.866943:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574793.250952:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574793.250972:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574793.250992:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788574793.251004:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574793.251032:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574793.251034:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574793.890973:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788574793.890975:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574793.890985:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788574793.890989:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574793.890999:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3139
00000100:00080000:2.0:1788574793.891012:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574793.891021:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574793.891060:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453361120640/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574793.891090:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574793.891095:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574793.891097:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574793.891101:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3139
00000100:00080000:2.0:1788574793.891106:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574793.891112:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574793.891122:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574793.891129:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361120640:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788574793.891141:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453361120768/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574793.891154:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574793.891158:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574793.891160:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574793.891164:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3139
00000100:00080000:2.0:1788574793.891179:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574793.891184:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574793.891191:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788574793.891196:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574793.891209:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361120896/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574793.891220:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574793.891223:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574793.891225:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574793.891230:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3139
00000100:00080000:2.0:1788574793.891234:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574793.891239:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788574793.891243:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574793/real 1788574793]  req@ffff8dc020496d80 x1875453361120640/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574818 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1788574793.891247:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574793.891266:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453361121024/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788574793.891267:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453361120640/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574818 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574793.891283:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574793.891291:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788574793.891295:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788574793.891300:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361120640:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788574793.891302:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574793.891307:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574793.891314:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3139
00000100:00080000:2.0:1788574793.891318:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574793.891322:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574793.891329:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574793.891330:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361120768:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574793.891354:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453361121152/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788574793.891364:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788574793.891372:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574793.891377:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574793.891379:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788574793.891384:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574793/real 1788574793]  req@ffff8dc020494e00 x1875453361120768/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574818 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574793.891387:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3139
00000100:00080000:2.0:1788574793.891393:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574793.891401:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574793.891408:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574793.891410:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453361120768/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574818 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574793.891423:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453361121280/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574793.891425:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574793.891435:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788574793.891440:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788574793.891441:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361120768:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788574793.891447:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574793.891451:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788574793.891453:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361120896:192.168.202.140@tcp:8:kworker.0
00000100:00080000:2.0:1788574793.891459:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3139
00000100:00080000:2.0:1788574793.891464:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574793.891469:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574793.891476:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788574793.891485:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574793.891491:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453361121408/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788574793.891497:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574793/real 1788574793]  req@ffff8dc020494700 x1875453361120896/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574818 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574793.891516:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361120896/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574818 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574793.891523:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574793.891526:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574793.891529:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361120896:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574793.891534:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361121024:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574793.891548:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574793.891559:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574793/real 1788574793]  req@ffff8dc020494380 x1875453361121024/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574818 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574793.891579:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453361121024/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574818 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574793.891588:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574793.891592:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574793.891595:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361121024:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574793.891613:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361121152:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788574793.891635:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574793.891648:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574793/real 1788574793]  req@ffff8dc020497100 x1875453361121152/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574818 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574793.891657:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453361121152/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574818 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574793.891663:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574793.891665:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574793.891668:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361121152:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574793.891672:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361121280:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574793.891685:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574793.891691:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574793/real 1788574793]  req@ffff8dc020496a00 x1875453361121280/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574818 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574793.891698:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453361121280/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574818 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574793.891707:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574793.891709:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574793.891711:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361121280:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574793.891714:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361121408:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574793.891724:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574793.891730:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574793/real 1788574793]  req@ffff8dc020496d80 x1875453361121408/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574818 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574793.891737:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453361121408/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574818 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574793.891742:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574793.891743:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574793.891745:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361121408:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574794.274986:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574794.274986:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574794.275012:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574794.275015:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574794.275045:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574794.275103:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574794.914988:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574795.299050:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574795.299050:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574795.299051:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574795.299055:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574795.299101:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574795.299161:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574795.939017:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574796.323014:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574796.323015:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574796.323024:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574796.323060:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574796.323074:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574796.323095:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574796.962985:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574797.347025:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574797.347026:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574797.347659:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574797.347661:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574797.347698:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574797.347700:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574797.986975:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574798.370961:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574798.370979:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574798.370995:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574798.371034:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574798.371056:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574798.371070:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00080000:1.0:1788574799.010982:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788574799.010985:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574799.010994:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788574799.010999:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574799.011008:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3144
00000100:00080000:1.0:1788574799.011019:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574799.011025:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574799.011066:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361121536/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574799.011098:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574799.011102:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574799.011104:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574799.011108:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3144
00000100:00080000:1.0:1788574799.011112:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574799.011117:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574799.011127:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574799.011139:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361121536:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788574799.011142:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361121664/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574799.011151:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574799.011154:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574799.011156:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574799.011159:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3144
00000100:00080000:1.0:1788574799.011162:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574799.011166:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574799.011170:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574799.011179:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361121792/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574799.011187:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574799.011191:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574799.011192:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574799.011196:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3144
00000100:00080000:1.0:1788574799.011199:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1788574799.011199:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788574799.011203:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574799.011207:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574799.011216:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361121920/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574799.011224:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574799.011227:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574799.011229:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574799.011232:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3144
00000100:00080000:1.0:1788574799.011235:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574799.011239:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574799.011244:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574799.011245:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574799/real 1788574799]  req@ffff8dc005dc1500 x1875453361121536/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574824 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574799.011254:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361122048/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574799.011262:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788574799.011264:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361121536/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574824 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574799.011265:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574799.011267:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574799.011271:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3144
00000100:00080000:1.0:1788574799.011273:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574799.011275:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574799.011277:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:3.0:1788574799.011279:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000008:00100000:1.0:1788574799.011281:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574799.011284:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361121536:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788574799.011289:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361122176/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574799.011302:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574799.011305:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:3.0:1788574799.011305:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361121664:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788574799.011307:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574799.011311:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3144
00000100:00080000:1.0:1788574799.011314:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574799.011318:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574799.011322:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788574799.011327:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574799.011331:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361122304/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788574799.011348:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574799/real 1788574799]  req@ffff8dc005dc0a80 x1875453361121664/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574824 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574799.011362:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361121664/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574824 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574799.011373:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574799.011376:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574799.011380:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361121664:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574799.011385:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361121792:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574799.011402:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574799.011410:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574799/real 1788574799]  req@ffff8dc005dc1180 x1875453361121792/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574824 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574799.011423:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361121792/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574824 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574799.011433:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574799.011435:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574799.011437:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361121792:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574799.011441:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361121920:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574799.011452:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574799.011458:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574799/real 1788574799]  req@ffff8dc005dc2d80 x1875453361121920/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574824 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574799.011465:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361121920/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574824 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574799.011477:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574799.011479:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574799.011481:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361121920:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574799.011485:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361122048:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788574799.011496:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574799.011503:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574799/real 1788574799]  req@ffff8dc005dc3b80 x1875453361122048/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574824 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574799.011511:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361122048/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574824 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574799.011516:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574799.011518:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574799.011521:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361122048:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574799.011525:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361122176:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574799.011535:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574799.011540:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574799/real 1788574799]  req@ffff8dc005dc0700 x1875453361122176/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574824 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574799.011547:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361122176/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574824 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574799.011552:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574799.011554:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574799.011555:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361122176:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574799.011567:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361122304:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574799.011578:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574799.011584:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574799/real 1788574799]  req@ffff8dc005dc3800 x1875453361122304/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574824 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574799.011591:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361122304/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574824 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574799.011596:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574799.011597:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574799.011599:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361122304:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574799.394980:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574799.394980:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574799.395018:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574799.395035:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574799.395057:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574799.395118:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574800.035001:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574800.418973:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574800.418974:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574800.418974:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574800.419006:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574800.419008:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574800.419017:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574801.058980:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574801.442973:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574801.442973:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574801.442978:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574801.443008:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574801.443010:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574801.443010:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574802.082945:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574802.466953:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574802.466956:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574802.466956:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574802.466957:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574802.466982:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574802.467023:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574803.106920:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574803.490961:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574803.490962:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574803.490968:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574803.490968:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574803.490998:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574803.491041:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1788574804.130959:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574804.130968:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:0.0:1788574804.130973:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574804.130974:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574804.130988:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3149
00000100:00080000:1.0:1788574804.131000:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574804.131007:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574804.131041:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361122432/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574804.131061:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574804.131064:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574804.131066:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574804.131071:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3149
00000100:00080000:1.0:1788574804.131074:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574804.131078:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574804.131087:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574804.131089:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361122432:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788574804.131102:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361122560/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574804.131112:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574804.131114:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574804.131115:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574804.131119:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3149
00000100:00080000:1.0:1788574804.131122:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574804.131125:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574804.131128:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574804.131137:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361122688/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574804.131144:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574804.131147:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574804.131148:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574804.131150:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3149
00000100:00080000:1.0:1788574804.131152:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574804.131155:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574804.131159:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788574804.131160:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574804.131177:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361122816/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574804.131184:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574804.131186:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574804.131187:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574804.131190:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3149
00000100:00080000:1.0:1788574804.131192:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574804.131195:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574804.131198:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574804.131207:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574804/real 1788574804]  req@ffff8dc005dc1c00 x1875453361122432/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574829 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574804.131213:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361122944/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574804.131249:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574804.131253:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574804.131258:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788574804.131258:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361122432/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574829 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574804.131267:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3149
00000100:00080000:1.0:1788574804.131272:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574804.131275:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574804.131285:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1788574804.131288:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574804.131294:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574804.131300:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361123072/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574804.131301:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361122432:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574804.131315:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574804.131317:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574804.131320:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574804.131323:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3149
00000100:00080000:1.0:1788574804.131326:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574804.131331:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574804.131331:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361122560:192.168.202.140@tcp:38:kworker.0
00000008:00100000:1.0:1788574804.131338:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574804.131348:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361123200/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788574804.131363:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574804.131376:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574804/real 1788574804]  req@ffff8dc005dc3800 x1875453361122560/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574829 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574804.131386:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361122560/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574829 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574804.131395:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574804.131399:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574804.131403:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361122560:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574804.131408:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361122688:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574804.131426:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574804.131433:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574804/real 1788574804]  req@ffff8dc005dc0700 x1875453361122688/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574829 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574804.131441:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361122688/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574829 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574804.131453:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574804.131456:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574804.131458:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361122688:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574804.131462:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361122816:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574804.131474:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574804.131480:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574804/real 1788574804]  req@ffff8dc005dc3b80 x1875453361122816/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574829 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574804.131487:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361122816/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574829 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574804.131493:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574804.131495:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574804.131497:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361122816:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574804.131501:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361122944:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574804.131514:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574804.131521:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574804/real 1788574804]  req@ffff8dc005dc2d80 x1875453361122944/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574829 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574804.131528:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361122944/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574829 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574804.131534:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574804.131537:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574804.131539:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361122944:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574804.131544:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361123072:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574804.131557:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574804.131582:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574804/real 1788574804]  req@ffff8dc005dc1180 x1875453361123072/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574829 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574804.131591:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361123072/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574829 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574804.131597:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574804.131600:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574804.131604:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361123072:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574804.131629:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361123200:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574804.131658:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574804.131677:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574804/real 1788574804]  req@ffff8dc005dc0a80 x1875453361123200/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574829 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574804.131687:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361123200/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574829 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574804.131692:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574804.131695:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574804.131698:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361123200:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574804.514943:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574804.514950:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574804.514991:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574804.515035:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574804.515038:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574804.515162:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574805.155030:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574805.538977:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574805.538980:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574805.539051:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574805.539053:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574805.539054:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574805.539056:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574806.179055:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574806.563020:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574806.563021:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574806.563039:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574806.563066:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574806.563073:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574806.563106:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574807.203069:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574807.587038:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574807.587038:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574807.587040:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574807.587079:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574807.587081:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574807.587089:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574808.227041:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574808.610957:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574808.610972:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574808.610987:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574808.610994:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574808.611074:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574808.611086:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574809.250971:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788574809.250978:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574809.250980:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788574809.250987:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574809.250999:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3154
00000100:00080000:1.0:1788574809.251010:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574809.251018:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574809.251052:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361123328/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574809.251079:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574809.251082:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574809.251085:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574809.251089:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3154
00000100:00080000:1.0:1788574809.251092:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574809.251095:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574809.251105:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574809.251120:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361123456/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574809.251127:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361123328:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574809.251132:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574809.251136:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574809.251138:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574809.251143:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3154
00000100:00080000:1.0:1788574809.251146:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574809.251150:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574809.251155:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574809.251177:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361123584/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574809.251185:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574809.251189:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574809.251192:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:2.0:1788574809.251193:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788574809.251199:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3154
00000100:00080000:1.0:1788574809.251203:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574809.251207:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574809.251212:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574809.251226:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361123712/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574809.251235:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788574809.251237:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574809/real 1788574809]  req@ffff8dc005dc1500 x1875453361123328/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574834 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574809.251239:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574809.251243:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574809.251253:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3154
00000100:00080000:1.0:1788574809.251258:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1788574809.251263:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361123328/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574834 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574809.251264:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574809.251273:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1788574809.251280:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574809.251285:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574809.251289:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361123840/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574809.251293:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361123328:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574809.251306:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574809.251310:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574809.251311:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574809.251316:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3154
00000100:00100000:2.0:1788574809.251320:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361123456:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788574809.251322:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574809.251330:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574809.251335:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574809.251346:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361123968/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788574809.251349:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788574809.251360:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574809.251365:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:2.0:1788574809.251365:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574809/real 1788574809]  req@ffff8dc005dc0a80 x1875453361123456/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574834 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574809.251369:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574809.251377:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3154
00000100:00080000:1.0:1788574809.251383:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1788574809.251387:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361123456/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574834 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574809.251390:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574809.251398:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1788574809.251404:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574809.251423:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574809.251430:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361123456:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574809.251431:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361124096/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574809.251440:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361123584:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574809.251465:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574809.251477:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574809/real 1788574809]  req@ffff8dc005dc1180 x1875453361123584/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574834 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574809.251489:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361123584/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574834 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574809.251497:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574809.251501:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574809.251504:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361123584:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574809.251510:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361123712:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574809.251524:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574809.251533:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574809/real 1788574809]  req@ffff8dc005dc2d80 x1875453361123712/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574834 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574809.251543:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361123712/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574834 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574809.251552:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574809.251555:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574809.251558:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361123712:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574809.251563:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361123840:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574809.251579:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574809.251589:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574809/real 1788574809]  req@ffff8dc005dc3b80 x1875453361123840/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574834 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574809.251607:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361123840/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574834 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574809.251616:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574809.251619:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574809.251622:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361123840:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574809.251637:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361123968:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574809.251653:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574809.251662:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574809/real 1788574809]  req@ffff8dc005dc0700 x1875453361123968/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574834 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574809.251673:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361123968/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574834 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574809.251681:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574809.251683:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574809.251686:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361123968:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574809.251691:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361124096:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574809.251705:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574809.251713:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574809/real 1788574809]  req@ffff8dc005dc3800 x1875453361124096/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574834 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574809.251723:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361124096/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574834 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574809.251737:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574809.251740:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574809.251743:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361124096:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574809.634946:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574809.634946:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574809.634949:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574809.634985:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574809.634988:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574809.635002:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574810.274983:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574810.658964:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574810.658964:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574810.658986:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574810.658987:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574810.658991:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788574810.659018:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574811.298999:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574811.682954:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574811.682955:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574811.682965:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574811.682977:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574811.682986:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574811.682989:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574812.322977:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574812.706978:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574812.706982:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788574812.707022:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574812.707030:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574812.707049:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574812.707071:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574813.347036:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574813.730972:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574813.730972:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574813.730974:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574813.730980:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574813.731006:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574813.731041:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574814.371009:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788574814.371038:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574814.371045:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788574814.371050:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574814.371060:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3160
00000100:00080000:2.0:1788574814.371068:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574814.371075:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574814.371112:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361124224/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574814.371143:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574814.371146:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574814.371148:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574814.371158:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3160
00000100:00080000:2.0:1788574814.371161:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574814.371166:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574814.371175:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574814.371187:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453361124352/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788574814.371200:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361124224:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788574814.371202:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574814.371211:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574814.371213:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574814.371218:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3160
00000100:00080000:2.0:1788574814.371222:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574814.371227:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574814.371232:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574814.371244:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361124480/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574814.371270:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574814.371273:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574814.371275:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1788574814.371280:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788574814.371281:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3160
00000100:00080000:2.0:1788574814.371288:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574814.371292:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574814.371298:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574814.371310:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361124608/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574814.371318:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574814.371322:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574814.371325:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788574814.371326:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574814/real 1788574814]  req@ffff8dc020494000 x1875453361124224/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574839 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574814.371331:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3160
00000100:00080000:2.0:1788574814.371337:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574814.371344:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574814.371348:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574814.371352:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361124224/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574839 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574814.371361:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453361124736/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574814.371368:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574814.371371:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574814.371375:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788574814.371376:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574814.371381:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788574814.371384:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361124224:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788574814.371395:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3160
00000100:00080000:2.0:1788574814.371401:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574814.371404:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574814.371410:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574814.371410:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361124352:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574814.371428:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361124864/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574814.371438:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1788574814.371442:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788574814.371445:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574814.371448:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574814.371452:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3160
00000100:00080000:2.0:1788574814.371456:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788574814.371459:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574814/real 1788574814]  req@ffff8dc020494a80 x1875453361124352/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574839 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574814.371462:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574814.371470:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574814.371481:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453361124352/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574839 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574814.371484:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361124992/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574814.371508:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574814.371513:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574814.371517:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361124352:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574814.371526:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361124480:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574814.371546:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574814.371556:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574814/real 1788574814]  req@ffff8dc020495180 x1875453361124480/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574839 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574814.371567:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361124480/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574839 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574814.371575:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574814.371578:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574814.371581:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361124480:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574814.371587:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361124608:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574814.371604:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574814.371614:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574814/real 1788574814]  req@ffff8dc020495880 x1875453361124608/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574839 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574814.371624:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361124608/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574839 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574814.371637:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574814.371640:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574814.371643:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361124608:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574814.371648:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361124736:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788574814.371679:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574814.371689:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574814/real 1788574814]  req@ffff8dc020497480 x1875453361124736/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574839 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574814.371700:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453361124736/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574839 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574814.371708:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574814.371711:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574814.371714:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361124736:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574814.371730:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361124864:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574814.371747:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574814.371757:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574814/real 1788574814]  req@ffff8dc020495500 x1875453361124864/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574839 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574814.371767:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361124864/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574839 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574814.371774:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574814.371776:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574814.371779:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361124864:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574814.371784:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361124992:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574814.371798:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574814.371807:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574814/real 1788574814]  req@ffff8dc020494000 x1875453361124992/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574839 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574814.371817:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361124992/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574839 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574814.371823:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574814.371826:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574814.371828:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361124992:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574814.755041:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574814.755042:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574814.755042:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788574814.755094:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574814.755097:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574814.755112:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574815.394979:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574815.778960:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574815.778960:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574815.778960:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574815.778991:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574815.778994:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788574815.779006:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574816.418939:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574816.802972:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574816.802973:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574816.802973:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574816.802999:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788574816.803004:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574816.803004:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574817.443026:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574817.827002:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574817.827002:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574817.827007:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788574817.827046:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574817.827051:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574817.827062:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574818.467096:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574818.850969:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574818.850976:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574818.850982:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574818.851009:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574818.851040:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788574818.851060:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574819.490951:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574819.490993:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574819.490998:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788574819.491001:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574819.491008:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3165
00000100:00080000:0.0:1788574819.491016:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574819.491021:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574819.491052:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361125120/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574819.491072:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574819.491074:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574819.491075:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574819.491078:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3165
00000100:00080000:0.0:1788574819.491080:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574819.491082:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574819.491089:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574819.491100:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361125248/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574819.491107:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574819.491110:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574819.491112:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788574819.491112:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361125120:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788574819.491119:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3165
00000100:00080000:0.0:1788574819.491121:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574819.491124:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574819.491138:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574819.491147:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361125376/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574819.491154:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574819.491156:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574819.491157:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574819.491160:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3165
00000100:00080000:0.0:1788574819.491163:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574819.491165:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574819.491173:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574819.491180:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361125504/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574819.491186:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574819.491188:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574819.491189:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574819.491193:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3165
00000100:00080000:0.0:1788574819.491196:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574819.491200:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574819.491205:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574819.491216:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361125632/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788574819.491222:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361125248:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788574819.491231:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574819.491235:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574819.491238:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574819.491243:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3165
00000100:00080000:0.0:1788574819.491247:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574819.491250:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574819.491255:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574819.491260:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361125376:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574819.491266:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361125760/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574819.491274:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574819.491276:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574819.491277:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574819.491280:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3165
00000100:00080000:0.0:1788574819.491282:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788574819.491283:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361125504:192.168.202.140@tcp:8:kworker.0
00000100:00080000:0.0:1788574819.491287:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574819.491292:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574819.491301:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361125888/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788574819.491309:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361125632:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574819.491324:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361125760:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574819.491338:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361125888:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574819.874946:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574819.874957:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574819.874958:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788574819.874994:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574819.874994:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574819.874996:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574820.515029:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574820.898992:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574820.898992:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574820.898992:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574820.898992:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574820.899026:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788574820.899124:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574821.539045:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574821.922945:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574821.922945:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574821.922945:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574821.922994:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788574821.923008:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574821.923008:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574822.563259:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000400:00000100:3.0:1788574822.563272:0:2336:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.140:988
00000400:00000100:3.0:1788574822.563331:0:2336:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.140@tcp at host 192.168.202.140 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:3.0:1788574822.563352:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788574822.563398:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788574822.563413:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788574822.563423:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788574822.563434:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788574822.563446:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:2.0:1788574822.563450:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574819/real 1788574822]  req@ffff8dc006710e00 x1875453361125248/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574844 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:3.0:1788574822.563459:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:2.0:1788574822.563491:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361125248/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574844 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574822.563506:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574822.563527:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574822.563531:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361125248:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574822.563540:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574819/real 1788574822]  req@ffff8dc006713800 x1875453361125376/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574844 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574822.563552:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361125376/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574844 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574822.563561:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574822.563565:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574822.563568:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361125376:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574822.563575:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574819/real 1788574822]  req@ffff8dc006712a00 x1875453361125504/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574844 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574822.563586:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361125504/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574844 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574822.563613:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574822.563617:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574822.563620:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361125504:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574822.563628:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574819/real 1788574822]  req@ffff8dc006711880 x1875453361125120/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574844 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574822.563642:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361125120/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574844 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574822.563649:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574822.563653:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574822.563656:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361125120:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788574822.563705:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574819/real 1788574822]  req@ffff8dc006711c00 x1875453361125888/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574844 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574822.563720:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361125888/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574844 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574822.563729:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574822.563734:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574822.563737:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361125888:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574822.563744:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574819/real 1788574822]  req@ffff8dc006713100 x1875453361125632/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574844 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574822.563757:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361125632/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574844 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574822.563766:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574822.563769:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574822.563772:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361125632:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574822.563778:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574819/real 1788574822]  req@ffff8dc006713b80 x1875453361125760/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574844 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574822.563788:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361125760/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574844 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574822.563795:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574822.563799:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574822.563802:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361125760:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574822.947022:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574822.947023:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574822.947039:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574822.947082:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574822.947084:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574822.947116:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574823.587073:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574823.970981:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574823.970981:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788574823.971028:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574823.971037:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574823.971050:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574823.971069:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00080000:3.0:1788574824.610983:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574824.610991:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788574824.610994:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574824.611017:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3170
00000100:00100000:1.0:1788574824.611026:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788574824.611029:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574824.611039:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788574824.611070:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e680 x1875453361126016/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574824.611093:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574824.611096:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574824.611098:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574824.611100:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3170
00000100:00080000:3.0:1788574824.611103:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574824.611106:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574824.611114:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574824.611124:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d180 x1875453361126144/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574824.611131:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574824.611133:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574824.611134:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574824.611137:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3170
00000100:00080000:3.0:1788574824.611140:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1788574824.611143:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361126016:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788574824.611145:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574824.611153:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574824.611162:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f480 x1875453361126272/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574824.611169:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574824.611171:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574824.611173:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574824.611176:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3170
00000100:00080000:3.0:1788574824.611178:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574824.611180:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574824.611183:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574824.611189:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c380 x1875453361126400/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574824.611196:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574824.611199:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574824.611202:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574824.611207:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3170
00000100:00080000:3.0:1788574824.611211:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1788574824.611215:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788574824.611219:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574824.611227:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574824.611241:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d500 x1875453361126528/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574824.611252:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574824.611256:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574824.611258:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788574824.611264:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574824/real 1788574824]  req@ffff8dc00644e680 x1875453361126016/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574849 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574824.611266:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3170
00000100:00080000:3.0:1788574824.611273:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574824.611280:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574824.611288:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574824.611295:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453361126016/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574849 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574824.611303:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ea00 x1875453361126656/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574824.611311:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574824.611318:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574824.611320:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788574824.611327:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:2.0:1788574824.611330:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361126016:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788574824.611332:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574824.611341:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3170
00000100:00100000:2.0:1788574824.611346:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361126144:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788574824.611346:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574824.611355:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574824.611362:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574824.611376:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ca80 x1875453361126784/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788574824.611383:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574824.611422:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574824/real 1788574824]  req@ffff8dc00644d180 x1875453361126144/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574849 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574824.611438:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453361126144/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574849 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574824.611449:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574824.611453:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574824.611457:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361126144:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574824.611483:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361126272:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574824.611509:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574824.611522:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574824/real 1788574824]  req@ffff8dc00644f480 x1875453361126272/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574849 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574824.611540:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453361126272/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574849 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574824.611549:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574824.611552:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574824.611555:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361126272:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574824.611561:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361126400:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574824.611597:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574824.611609:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574824/real 1788574824]  req@ffff8dc00644c380 x1875453361126400/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574849 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574824.611620:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453361126400/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574849 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574824.611630:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574824.611633:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574824.611636:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361126400:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574824.611642:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361126528:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574824.611662:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574824.611674:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574824/real 1788574824]  req@ffff8dc00644d500 x1875453361126528/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574849 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574824.611685:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d500 x1875453361126528/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574849 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574824.611703:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574824.611707:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574824.611710:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361126528:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574824.611717:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361126656:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574824.611739:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574824.611752:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574824/real 1788574824]  req@ffff8dc00644ea00 x1875453361126656/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574849 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574824.611764:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ea00 x1875453361126656/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574849 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574824.611773:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574824.611776:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574824.611779:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361126656:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574824.611786:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361126784:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574824.611807:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574824.611819:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574824/real 1788574824]  req@ffff8dc00644ca80 x1875453361126784/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574849 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574824.611831:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ca80 x1875453361126784/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574849 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574824.611841:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574824.611844:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574824.611849:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361126784:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574824.994985:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574824.994985:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574824.994985:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574824.994986:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574824.995030:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574824.995088:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574825.635097:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574826.019000:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574826.019000:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574826.019000:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574826.019036:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574826.019036:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788574826.019038:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574826.659004:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574827.042980:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574827.042980:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574827.042980:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574827.042981:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574827.043012:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574827.043065:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574827.683000:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574828.066994:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574828.066994:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574828.066994:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574828.067024:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788574828.067028:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574828.067036:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574828.707009:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574829.090996:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574829.091001:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574829.091001:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574829.091034:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574829.091045:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574829.091128:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1788574829.731014:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574829.731029:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788574829.731034:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788574829.731038:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574829.731049:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3175
00000100:00080000:1.0:1788574829.731064:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574829.731074:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574829.731125:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361126912/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574829.731149:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574829.731152:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574829.731153:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574829.731156:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3175
00000100:00080000:1.0:1788574829.731159:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574829.731162:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574829.731172:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574829.731188:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361127040/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574829.731200:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574829.731208:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:2.0:1788574829.731210:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361126912:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574829.731212:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574829.731230:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3175
00000100:00080000:1.0:1788574829.731233:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574829.731237:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574829.731244:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574829.731258:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361127168/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574829.731265:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574829.731268:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574829.731270:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574829.731273:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3175
00000100:00080000:1.0:1788574829.731282:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574829.731285:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574829.731289:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788574829.731294:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574829.731300:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361127296/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574829.731308:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574829.731311:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574829.731312:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574829.731318:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3175
00000100:00080000:1.0:1788574829.731326:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574829.731328:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574829.731332:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574829.731343:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361127424/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574829.731349:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574829.731352:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574829.731356:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788574829.731357:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574829/real 1788574829]  req@ffff8dc005dc1c00 x1875453361126912/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574854 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574829.731362:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3175
00000100:00080000:1.0:1788574829.731373:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574829.731382:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574829.731393:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574829.731403:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361126912/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574854 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574829.731405:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361127552/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574829.731466:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574829.731471:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574829.731473:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574829.731477:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3175
00000100:00080000:2.0:1788574829.731478:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574829.731486:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574829.731486:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788574829.731496:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574829.731497:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361126912:192.168.202.140@tcp:250:kworker.0
00000008:00100000:1.0:1788574829.731501:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574829.731513:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361127680/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574829.731528:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361127040:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574829.731552:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574829.731562:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574829/real 1788574829]  req@ffff8dc005dc3800 x1875453361127040/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574854 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574829.731571:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361127040/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574854 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574829.731579:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574829.731582:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574829.731584:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361127040:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574829.731589:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361127168:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574829.731602:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574829.731608:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574829/real 1788574829]  req@ffff8dc005dc0700 x1875453361127168/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574854 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574829.731616:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361127168/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574854 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574829.731622:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574829.731624:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574829.731626:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361127168:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574829.731629:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361127296:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574829.731655:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574829.731663:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574829/real 1788574829]  req@ffff8dc005dc3b80 x1875453361127296/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574854 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574829.731670:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361127296/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574854 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574829.731676:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574829.731679:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574829.731681:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361127296:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574829.731685:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361127424:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574829.731704:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574829.731715:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574829/real 1788574829]  req@ffff8dc005dc2d80 x1875453361127424/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574854 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574829.731728:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361127424/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574854 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574829.731738:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574829.731742:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574829.731745:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361127424:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574829.731752:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361127552:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574829.731773:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574829.731784:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574829/real 1788574829]  req@ffff8dc005dc1180 x1875453361127552/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574854 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574829.731795:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361127552/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574854 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574829.731803:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574829.731806:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574829.731809:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361127552:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574829.731816:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361127680:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574829.731837:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574829.731848:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574829/real 1788574829]  req@ffff8dc005dc0a80 x1875453361127680/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574854 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574829.731901:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361127680/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574854 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574829.731908:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574829.731910:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574829.731913:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361127680:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574830.114968:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574830.114999:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574830.114999:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574830.115005:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788574830.115051:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574830.115062:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574830.754977:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574831.138942:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574831.138950:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574831.138968:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574831.138989:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574831.139002:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574831.139006:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574831.778946:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574832.162980:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574832.162980:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574832.162980:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574832.163007:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574832.163010:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574832.163016:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574832.802990:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574833.186989:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574833.186999:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574833.187019:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574833.187030:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574833.187047:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574833.187071:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574833.826940:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574834.210978:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574834.210978:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574834.210978:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574834.210979:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574834.211011:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574834.211059:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1788574834.850966:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788574834.850974:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574834.850976:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788574834.850980:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574834.850990:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3180
00000100:00080000:1.0:1788574834.850999:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574834.851006:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574834.851044:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361127808/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574834.851072:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574834.851076:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574834.851078:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574834.851082:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3180
00000100:00080000:1.0:1788574834.851086:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574834.851090:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574834.851101:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574834.851117:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361127936/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574834.851125:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361127808:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574834.851133:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574834.851138:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574834.851140:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574834.851144:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3180
00000100:00080000:1.0:1788574834.851149:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574834.851153:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574834.851159:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574834.851174:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361128064/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574834.851185:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574834.851189:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000800:00000100:2.0:1788574834.851192:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788574834.851194:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574834.851201:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3180
00000100:00080000:1.0:1788574834.851206:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574834.851212:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574834.851218:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574834.851233:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361128192/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574834.851246:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574834.851250:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574834.851251:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788574834.851255:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574834/real 1788574834]  req@ffff8dc005dc1500 x1875453361127808/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574859 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574834.851258:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3180
00000100:00080000:1.0:1788574834.851265:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574834.851273:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574834.851280:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574834.851287:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361127808/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574859 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574834.851296:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361128320/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574834.851299:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574834.851307:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574834.851315:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361127808:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574834.851319:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574834.851325:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574834.851327:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574834.851333:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3180
00000100:00100000:2.0:1788574834.851338:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361127936:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788574834.851339:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574834.851349:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574834.851354:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574834.851370:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361128448/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788574834.851377:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574834.851391:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574834/real 1788574834]  req@ffff8dc005dc0a80 x1875453361127936/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574859 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574834.851399:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574834.851404:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:2.0:1788574834.851405:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361127936/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574859 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574834.851408:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574834.851419:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3180
00000100:00080000:2.0:1788574834.851422:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574834.851427:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574834.851429:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361127936:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574834.851434:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361128064:192.168.202.140@tcp:8:kworker.0
00000100:00080000:1.0:1788574834.851435:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574834.851444:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574834.851451:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788574834.851456:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574834.851470:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361128576/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574834.851475:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574834/real 1788574834]  req@ffff8dc005dc1180 x1875453361128064/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574859 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574834.851498:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361128064/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574859 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574834.851510:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574834.851514:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574834.851518:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361128064:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574834.851525:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361128192:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574834.851546:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574834.851560:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574834/real 1788574834]  req@ffff8dc005dc2d80 x1875453361128192/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574859 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574834.851572:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361128192/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574859 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574834.851582:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574834.851585:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574834.851589:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361128192:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574834.851595:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361128320:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574834.851615:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574834.851625:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574834/real 1788574834]  req@ffff8dc005dc3b80 x1875453361128320/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574859 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574834.851633:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361128320/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574859 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574834.851639:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574834.851641:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574834.851643:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361128320:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574834.851656:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361128448:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574834.851668:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574834.851675:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574834/real 1788574834]  req@ffff8dc005dc0700 x1875453361128448/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574859 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574834.851682:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361128448/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574859 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574834.851688:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574834.851690:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574834.851692:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361128448:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574834.851695:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361128576:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574834.851705:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574834.851710:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574834/real 1788574834]  req@ffff8dc005dc3800 x1875453361128576/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574859 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574834.851717:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361128576/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574859 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574834.851723:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574834.851725:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574834.851727:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361128576:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574835.234987:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574835.234997:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574835.235002:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574835.235027:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574835.235127:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574835.235151:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574835.874981:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574836.258945:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574836.258945:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574836.258950:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574836.258952:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574836.258979:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574836.259009:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574836.899017:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574837.282946:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574837.282947:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574837.282957:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574837.282993:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574837.283011:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574837.283035:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574837.922966:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574838.307008:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574838.307014:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574838.307019:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574838.307052:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574838.307057:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788574838.307091:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574838.947005:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574839.330972:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574839.331000:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574839.331026:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574839.331037:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574839.331043:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574839.331069:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00080000:0.0:1788574839.971024:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574839.971035:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788574839.971042:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574839.971054:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3185
00000100:00080000:0.0:1788574839.971067:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574839.971075:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574839.971108:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574839.971128:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361128704/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574839.971154:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574839.971157:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574839.971160:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574839.971167:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3185
00000100:00080000:0.0:1788574839.971173:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574839.971178:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574839.971188:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574839.971203:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361128832/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574839.971204:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361128704:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788574839.971242:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574839.971246:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574839.971248:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574839.971256:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3185
00000100:00080000:0.0:1788574839.971259:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574839.971262:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574839.971268:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574839.971281:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361128960/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788574839.971289:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788574839.971290:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574839.971297:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574839.971299:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574839.971313:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3185
00000100:00080000:0.0:1788574839.971320:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574839.971326:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574839.971332:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574839/real 1788574839]  req@ffff8dc006712300 x1875453361128704/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574864 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1788574839.971334:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574839.971360:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361129088/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574839.971366:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361128704/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574864 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574839.971401:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574839.971415:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574839.971417:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574839.971422:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574839.971428:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788574839.971432:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3185
00000100:00100000:1.0:1788574839.971436:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361128704:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788574839.971439:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574839.971451:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574839.971458:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574839.971470:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453361129216/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574839.971476:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361128832:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788574839.971480:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574839.971484:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574839.971486:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574839.971492:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3185
00000100:00080000:0.0:1788574839.971497:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574839.971501:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:1.0:1788574839.971505:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:0.0:1788574839.971509:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574839.971526:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361129344/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574839.971527:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574839/real 1788574839]  req@ffff8dc006711500 x1875453361128832/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574864 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574839.971594:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574839.971600:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1788574839.971602:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361128832/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574864 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574839.971603:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574839.971615:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3185
00000100:00080000:0.0:1788574839.971644:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574839.971647:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574839.971651:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:1.0:1788574839.971656:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574839.971661:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361128832:192.168.202.140@tcp:38:kworker.0
00000008:00100000:0.0:1788574839.971662:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574839.971674:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361128960:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574839.971685:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361129472/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788574839.971699:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574839.971719:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574839/real 1788574839]  req@ffff8dc006713480 x1875453361128960/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574864 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574839.971733:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361128960/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574864 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574839.971743:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574839.971745:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574839.971749:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361128960:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574839.971758:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361129088:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574839.971783:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574839.971801:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574839/real 1788574839]  req@ffff8dc006712680 x1875453361129088/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574864 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574839.971814:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361129088/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574864 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574839.971821:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574839.971824:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574839.971826:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361129088:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574839.971838:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361129216:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574839.971849:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574839.971856:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574839/real 1788574839]  req@ffff8dc006710380 x1875453361129216/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574864 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574839.971864:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453361129216/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574864 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574839.971897:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574839.971900:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574839.971904:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361129216:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574839.971913:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361129344:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574839.971933:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574839.971941:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574839/real 1788574839]  req@ffff8dc006712300 x1875453361129344/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574864 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574839.971953:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361129344/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574864 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574839.971959:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574839.971961:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574839.971963:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361129344:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574839.971967:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361129472:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574839.971977:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574839.971983:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574839/real 1788574839]  req@ffff8dc006713b80 x1875453361129472/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574864 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574839.971990:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361129472/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574864 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574839.971995:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574839.971997:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574839.971999:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361129472:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574840.354977:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574840.354977:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574840.354977:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574840.355012:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574840.355028:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788574840.355030:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574840.994925:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574841.378962:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574841.378962:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574841.378964:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574841.378968:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574841.378994:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574841.379052:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574842.018977:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574842.402978:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574842.402978:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574842.402978:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574842.402980:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574842.403014:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788574842.403096:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574843.042934:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574843.426973:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574843.426990:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574843.426993:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574843.427042:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574843.427066:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574843.427073:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574844.067007:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574844.451014:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574844.451014:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574844.451016:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574844.451045:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574844.451082:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788574844.451130:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1788574845.091013:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574845.091026:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788574845.091031:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574845.091042:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3190
00000100:00100000:3.0:1788574845.091056:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574845.091063:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574845.091076:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574845.091120:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361129600/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574845.091151:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574845.091156:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574845.091158:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574845.091171:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3190
00000100:00080000:1.0:1788574845.091176:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574845.091182:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574845.091192:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574845.091203:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361129600:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788574845.091214:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361129728/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574845.091238:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574845.091246:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574845.091248:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574845.091253:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3190
00000100:00080000:1.0:1788574845.091258:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574845.091263:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574845.091270:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574845.091285:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361129856/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574845.091297:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574845.091301:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574845.091304:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574845.091308:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3190
00000100:00080000:1.0:1788574845.091312:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574845.091321:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:2.0:1788574845.091321:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:1.0:1788574845.091334:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574845.091350:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361129984/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574845.091361:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574845.091365:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574845.091366:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574845.091371:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3190
00000100:00080000:1.0:1788574845.091376:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574845.091381:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574845.091386:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574845.091392:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574845/real 1788574845]  req@ffff8dc005dc1c00 x1875453361129600/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574870 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574845.091402:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361130112/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574845.091424:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574845.091428:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:2.0:1788574845.091432:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361129600/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574870 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574845.091433:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574845.091448:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3190
00000100:00080000:2.0:1788574845.091467:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574845.091470:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574845.091477:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788574845.091482:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574845.091488:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361129600:192.168.202.140@tcp:250:kworker.0
00000008:00100000:1.0:1788574845.091508:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574845.091528:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361130240/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574845.091547:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574845.091551:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:2.0:1788574845.091555:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361129728:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788574845.091556:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574845.091571:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3190
00000100:00080000:1.0:1788574845.091578:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574845.091583:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574845.091589:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788574845.091600:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574845.091609:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361130368/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574845.091621:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574845/real 1788574845]  req@ffff8dc005dc3800 x1875453361129728/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574870 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574845.091639:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361129728/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574870 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574845.091651:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574845.091655:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574845.091658:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361129728:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574845.091665:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361129856:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574845.091691:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574845.091703:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574845/real 1788574845]  req@ffff8dc005dc0700 x1875453361129856/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574870 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574845.091715:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361129856/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574870 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574845.091724:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574845.091727:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574845.091731:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361129856:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574845.091738:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361129984:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574845.091756:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574845.091767:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574845/real 1788574845]  req@ffff8dc005dc3b80 x1875453361129984/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574870 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574845.091779:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361129984/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574870 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574845.091788:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574845.091791:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574845.091794:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361129984:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574845.091801:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361130112:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574845.091821:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574845.091833:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574845/real 1788574845]  req@ffff8dc005dc2d80 x1875453361130112/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574870 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574845.091852:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361130112/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574870 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574845.091861:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574845.091890:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574845.091895:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361130112:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574845.091903:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361130240:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574845.091924:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574845.091937:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574845/real 1788574845]  req@ffff8dc005dc1180 x1875453361130240/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574870 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574845.091949:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361130240/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574870 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574845.091957:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574845.091960:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574845.091964:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361130240:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574845.091985:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361130368:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574845.092006:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574845.092017:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574845/real 1788574845]  req@ffff8dc005dc0a80 x1875453361130368/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574870 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574845.092029:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361130368/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574870 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574845.092043:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574845.092046:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574845.092049:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361130368:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574845.474998:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574845.475010:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574845.475080:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788574845.475091:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574845.475176:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574845.475176:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574846.114935:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574846.498994:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574846.498994:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574846.498994:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574846.498994:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574846.499033:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788574846.499111:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574847.138975:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574847.523003:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574847.523003:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574847.523041:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574847.523060:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574847.523068:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788574847.523094:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574848.162985:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574848.547021:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574848.547028:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574848.547029:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574848.547066:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574848.547078:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788574848.547079:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574849.187034:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574849.571006:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574849.571006:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574849.571026:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574849.571044:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574849.571045:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788574849.571055:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1788574850.211035:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788574850.211043:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574850.211055:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788574850.211062:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574850.211075:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3195
00000100:00080000:0.0:1788574850.211089:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574850.211100:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574850.211164:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361130496/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574850.211197:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574850.211201:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574850.211204:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574850.211209:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3195
00000100:00080000:0.0:1788574850.211213:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574850.211218:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574850.211232:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574850.211250:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361130624/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574850.211263:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574850.211267:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574850.211271:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788574850.211273:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361130496:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788574850.211279:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3195
00000100:00080000:0.0:1788574850.211285:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574850.211290:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574850.211296:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574850.211312:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361130752/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574850.211323:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574850.211327:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574850.211330:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574850.211334:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3195
00000100:00080000:0.0:1788574850.211339:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574850.211345:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574850.211350:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574850.211365:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361130880/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788574850.211389:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788574850.211405:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574850.211415:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574850.211417:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574850.211423:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3195
00000100:00080000:0.0:1788574850.211428:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574850.211433:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574850.211439:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574850.211455:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574850/real 1788574850]  req@ffff8dc006713100 x1875453361130496/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574875 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574850.211456:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361131008/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574850.211492:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574850.211496:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574850.211499:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788574850.211506:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361130496/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574875 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574850.211507:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3195
00000100:00080000:0.0:1788574850.211514:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574850.211523:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:2.0:1788574850.211530:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1788574850.211531:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1788574850.211540:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574850.211549:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361131136/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574850.211549:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361130496:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788574850.211566:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574850.211570:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574850.211572:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574850.211578:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3195
00000100:00080000:0.0:1788574850.211582:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1788574850.211589:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361130624:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788574850.211590:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574850.211599:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574850.211611:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361131264/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788574850.211631:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574850.211650:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574850/real 1788574850]  req@ffff8dc006711c00 x1875453361130624/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574875 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574850.211665:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361130624/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574875 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574850.211678:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574850.211682:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574850.211687:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361130624:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574850.211694:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361130752:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574850.211719:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574850.211732:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574850/real 1788574850]  req@ffff8dc006711880 x1875453361130752/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574875 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574850.211746:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361130752/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574875 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574850.211756:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574850.211760:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574850.211764:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361130752:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574850.211771:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361130880:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574850.211793:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574850.211805:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574850/real 1788574850]  req@ffff8dc006712a00 x1875453361130880/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574875 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574850.211817:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361130880/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574875 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574850.211834:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574850.211838:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574850.211842:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361130880:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574850.211849:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361131008:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574850.211918:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574850.211933:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574850/real 1788574850]  req@ffff8dc006713800 x1875453361131008/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574875 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574850.211946:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361131008/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574875 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574850.211956:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574850.211960:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574850.211963:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361131008:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574850.211970:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361131136:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574850.211993:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574850.212006:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574850/real 1788574850]  req@ffff8dc006710e00 x1875453361131136/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574875 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574850.212018:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361131136/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574875 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574850.212027:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574850.212030:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574850.212034:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361131136:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574850.212054:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361131264:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574850.212077:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574850.212089:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574850/real 1788574850]  req@ffff8dc006713100 x1875453361131264/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574875 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574850.212102:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361131264/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574875 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574850.212111:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574850.212115:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574850.212118:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361131264:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574850.595027:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574850.595027:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574850.595043:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574850.595076:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574850.595100:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788574850.595105:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574851.234966:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574851.619021:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574851.619034:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574851.619040:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788574851.619076:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574851.619084:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574851.619088:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574852.258990:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574852.642976:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574852.642977:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574852.642977:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574852.643019:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574852.643065:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788574852.643110:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574853.282957:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574853.666966:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574853.667025:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574853.667028:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574853.667062:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788574853.667070:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574853.667072:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574854.306982:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574854.691001:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574854.691002:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574854.691025:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574854.691034:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574854.691067:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788574854.691116:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1788574855.330972:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788574855.330977:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574855.330986:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788574855.330992:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574855.331003:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3200
00000100:00080000:0.0:1788574855.331016:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574855.331025:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574855.331074:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361131392/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574855.331107:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574855.331111:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574855.331113:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574855.331117:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3200
00000100:00080000:0.0:1788574855.331120:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574855.331123:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574855.331136:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574855.331147:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361131520/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574855.331156:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574855.331159:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574855.331161:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574855.331166:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3200
00000100:00080000:0.0:1788574855.331169:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574855.331171:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574855.331175:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574855.331186:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453361131648/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574855.331196:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574855.331201:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574855.331206:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788574855.331208:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361131392:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788574855.331212:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3200
00000100:00080000:0.0:1788574855.331224:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574855.331229:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574855.331232:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574855.331261:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361131776/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574855.331268:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574855.331271:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574855.331273:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574855.331278:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3200
00000100:00080000:0.0:1788574855.331285:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574855.331289:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574855.331294:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574855.331309:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361131904/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788574855.331311:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788574855.331325:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574855.331329:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574855.331331:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574855.331339:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3200
00000100:00080000:0.0:1788574855.331346:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574855.331349:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574855.331353:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574855.331362:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361132032/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574855.331371:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788574855.331376:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574855/real 1788574855]  req@ffff8dc006713b80 x1875453361131392/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574880 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574855.331377:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574855.331383:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574855.331399:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3200
00000100:00080000:0.0:1788574855.331409:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574855.331414:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574855.331418:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574855.331423:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361131392/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574880 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574855.331431:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361132160/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574855.331487:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574855.331492:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574855.331500:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361131392:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788574855.331508:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361131520:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574855.331526:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574855.331535:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574855/real 1788574855]  req@ffff8dc006712300 x1875453361131520/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574880 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574855.331543:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361131520/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574880 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574855.331551:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574855.331553:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574855.331555:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361131520:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574855.331576:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361131648:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574855.331588:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574855.331595:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574855/real 1788574855]  req@ffff8dc006710380 x1875453361131648/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574880 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574855.331602:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453361131648/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574880 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574855.331608:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574855.331611:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574855.331613:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361131648:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574855.331618:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361131776:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574855.331628:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574855.331634:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574855/real 1788574855]  req@ffff8dc006712680 x1875453361131776/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574880 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574855.331641:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361131776/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574880 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574855.331648:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574855.331650:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574855.331652:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361131776:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574855.331656:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361131904:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574855.331666:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574855.331672:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574855/real 1788574855]  req@ffff8dc006713480 x1875453361131904/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574880 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574855.331679:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361131904/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574880 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574855.331685:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574855.331687:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574855.331689:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361131904:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574855.331693:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361132032:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574855.331704:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574855.331710:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574855/real 1788574855]  req@ffff8dc006711500 x1875453361132032/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574880 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574855.331718:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361132032/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574880 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574855.331723:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574855.331724:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574855.331726:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361132032:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574855.331730:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361132160:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574855.331740:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574855.331746:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574855/real 1788574855]  req@ffff8dc006713100 x1875453361132160/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574880 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574855.331752:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361132160/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574880 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574855.331757:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574855.331759:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574855.331761:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361132160:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574855.715037:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574855.715038:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574855.715041:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788574855.715083:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574855.715084:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574855.715090:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574856.354996:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574856.738971:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574856.738972:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574856.738972:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574856.739028:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574856.739034:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788574856.739078:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574857.379000:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574857.762982:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574857.762982:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574857.763020:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574857.763035:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574857.763049:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574857.763078:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574858.402956:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574858.786984:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574858.786984:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574858.787027:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574858.787032:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574858.787039:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574858.787060:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574859.427015:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574859.810966:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574859.810967:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574859.810967:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788574859.810996:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574859.810998:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574859.811012:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574860.450932:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574860.450944:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574860.450952:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788574860.450957:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574860.450968:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3206
00000100:00080000:0.0:1788574860.450978:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574860.450986:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574860.451024:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361132288/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574860.451056:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574860.451059:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574860.451061:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574860.451064:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3206
00000100:00080000:0.0:1788574860.451067:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574860.451072:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574860.451080:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574860.451091:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361132416/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574860.451101:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788574860.451101:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361132288:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788574860.451107:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574860.451111:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574860.451129:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3206
00000100:00080000:0.0:1788574860.451134:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574860.451138:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574860.451144:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574860.451161:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361132544/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574860.451174:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574860.451177:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574860.451179:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574860.451186:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3206
00000800:00000100:2.0:1788574860.451186:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788574860.451194:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574860.451200:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574860.451206:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574860.451221:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361132672/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574860.451229:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574860/real 1788574860]  req@ffff8dc006710e00 x1875453361132288/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574885 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574860.451248:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788574860.451252:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361132288/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574885 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574860.451253:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574860.451257:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574860.451265:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3206
00000100:00080000:0.0:1788574860.451270:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574860.451270:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574860.451278:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788574860.451279:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574860.451286:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361132288:192.168.202.140@tcp:250:kworker.0
00000008:00100000:0.0:1788574860.451287:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574860.451310:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361132416:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574860.451315:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361132800/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574860.451330:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:2.0:1788574860.451331:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788574860.451337:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574860.451340:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788574860.451344:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574860/real 1788574860]  req@ffff8dc006713800 x1875453361132416/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574885 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574860.451348:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3206
00000100:00080000:0.0:1788574860.451355:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574860.451361:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574860.451364:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361132416/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574885 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1788574860.451367:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1788574860.451377:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574860.451381:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574860.451384:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361132928/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574860.451386:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361132416:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574860.451397:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361132544:192.168.202.140@tcp:8:kworker.0
00000100:00080000:0.0:1788574860.451401:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574860.451404:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574860.451406:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574860.451409:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3206
00000100:00080000:0.0:1788574860.451412:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574860.451414:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574860.451425:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788574860.451425:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574860.451435:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574860/real 1788574860]  req@ffff8dc006712a00 x1875453361132544/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574885 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574860.451438:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361133056/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574860.451460:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361132544/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574885 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574860.451468:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574860.451470:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574860.451474:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361132544:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574860.451480:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361132672:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574860.451491:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574860.451498:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574860/real 1788574860]  req@ffff8dc006711880 x1875453361132672/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574885 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574860.451505:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361132672/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574885 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574860.451512:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574860.451513:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574860.451515:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361132672:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574860.451525:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361132800:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574860.451536:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574860.451542:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574860/real 1788574860]  req@ffff8dc006711c00 x1875453361132800/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574885 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574860.451550:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361132800/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574885 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574860.451560:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574860.451562:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574860.451565:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361132800:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574860.451568:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361132928:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574860.451578:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574860.451584:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574860/real 1788574860]  req@ffff8dc006710e00 x1875453361132928/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574885 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574860.451591:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361132928/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574885 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574860.451596:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574860.451598:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574860.451600:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361132928:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574860.451604:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361133056:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574860.451613:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574860.451619:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574860/real 1788574860]  req@ffff8dc006713100 x1875453361133056/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574885 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574860.451625:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361133056/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574885 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574860.451630:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574860.451631:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574860.451634:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361133056:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574860.834933:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574860.834949:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574860.834954:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574860.834955:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574860.834978:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574860.835011:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574861.474968:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574861.858983:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574861.858983:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574861.858995:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788574861.859038:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574861.859058:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574861.859075:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574862.499009:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574862.883010:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574862.883010:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574862.883045:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574862.883082:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574862.883089:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574862.883101:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574863.523053:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574863.906998:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574863.907010:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574863.907048:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574863.907082:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788574863.907089:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574863.907101:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574864.547009:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574864.930967:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574864.930967:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574864.930969:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574864.930997:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574864.931015:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788574864.931052:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1788574865.570975:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788574865.570983:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574865.570999:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788574865.571005:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574865.571016:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3211
00000100:00080000:1.0:1788574865.571027:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574865.571035:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574865.571074:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361133184/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574865.571102:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574865.571106:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574865.571109:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574865.571114:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3211
00000100:00080000:1.0:1788574865.571120:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574865.571125:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574865.571135:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574865.571137:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361133184:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788574865.571156:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361133312/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574865.571170:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574865.571174:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574865.571177:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574865.571181:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3211
00000100:00080000:1.0:1788574865.571188:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574865.571193:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574865.571200:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788574865.571200:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574865.571220:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361133440/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574865.571231:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574865.571234:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574865.571237:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574865.571241:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3211
00000100:00080000:1.0:1788574865.571247:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1788574865.571247:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574865/real 1788574865]  req@ffff8dc005dc1500 x1875453361133184/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574890 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574865.571258:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574865.571265:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574865.571269:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361133184/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574890 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574865.571279:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1788574865.571285:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361133568/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574865.571285:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574865.571292:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361133184:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574865.571307:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574865.571312:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574865.571314:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788574865.571318:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361133312:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788574865.571324:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3211
00000100:00080000:1.0:1788574865.571329:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574865.571334:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574865.571340:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788574865.571345:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574865.571358:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574865/real 1788574865]  req@ffff8dc005dc0a80 x1875453361133312/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574890 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574865.571363:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361133696/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574865.571372:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361133312/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574890 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574865.571389:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574865.571394:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574865.571395:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574865.571401:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574865.571402:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574865.571411:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361133312:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788574865.571412:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3211
00000100:00080000:1.0:1788574865.571420:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1788574865.571421:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361133440:192.168.202.140@tcp:8:kworker.0
00000100:00080000:1.0:1788574865.571430:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574865.571437:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788574865.571443:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574865.571453:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361133824/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574865.571455:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574865/real 1788574865]  req@ffff8dc005dc1180 x1875453361133440/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574890 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574865.571482:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361133440/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574890 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574865.571489:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574865.571493:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574865.571497:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361133440:192.168.202.140@tcp:8:kworker.0
00000100:00080000:1.0:1788574865.571498:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788574865.571504:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361133568:192.168.202.140@tcp:8:kworker.0
00000100:00080000:1.0:1788574865.571506:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574865.571511:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574865.571518:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3211
00000100:00080000:1.0:1788574865.571523:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574865.571527:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:2.0:1788574865.571531:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:1.0:1788574865.571537:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574865.571544:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574865/real 1788574865]  req@ffff8dc005dc2d80 x1875453361133568/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574890 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574865.571552:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361133568/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574890 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574865.571560:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574865.571563:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574865.571569:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361133568:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574865.571570:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361133952/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574865.571584:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361133696:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574865.571601:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574865.571611:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574865/real 1788574865]  req@ffff8dc005dc3b80 x1875453361133696/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574890 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574865.571619:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361133696/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574890 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574865.571625:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574865.571627:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574865.571629:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361133696:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574865.571633:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361133824:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574865.571643:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574865.571649:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574865/real 1788574865]  req@ffff8dc005dc0700 x1875453361133824/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574890 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574865.571656:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361133824/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574890 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574865.571661:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574865.571663:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574865.571665:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361133824:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574865.571674:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361133952:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574865.571692:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574865.571704:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574865/real 1788574865]  req@ffff8dc005dc3800 x1875453361133952/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574890 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574865.571717:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361133952/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574890 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574865.571726:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574865.571729:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574865.571732:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361133952:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574865.954949:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574865.954950:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574865.954951:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574865.954997:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574865.955008:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788574865.955085:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574866.594957:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574866.978987:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574866.978987:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574866.978987:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574866.978996:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574866.979031:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788574866.979064:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574867.619017:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574868.002952:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574868.002971:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574868.002976:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574868.002990:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574868.003002:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788574868.003039:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574868.642995:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574869.026996:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574869.026996:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574869.026997:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574869.026997:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574869.027044:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788574869.027116:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574869.667007:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574870.050997:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574870.050997:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574870.051015:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574870.051026:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574870.051071:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788574870.051182:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1788574870.691023:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574870.691033:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:1.0:1788574870.691035:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788574870.691037:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574870.691048:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3216
00000100:00080000:3.0:1788574870.691058:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574870.691065:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788574870.691100:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ce00 x1875453361134080/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574870.691123:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574870.691126:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574870.691127:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574870.691130:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3216
00000100:00080000:3.0:1788574870.691132:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574870.691134:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574870.691142:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574870.691150:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f800 x1875453361134208/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574870.691157:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574870.691160:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574870.691161:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574870.691165:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3216
00000100:00100000:2.0:1788574870.691167:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361134080:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788574870.691167:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574870.691174:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574870.691178:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574870.691192:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c000 x1875453361134336/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574870.691201:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574870.691205:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574870.691208:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574870.691212:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3216
00000100:00080000:3.0:1788574870.691217:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574870.691221:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574870.691227:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788574870.691228:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574870.691244:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644dc00 x1875453361134464/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574870.691255:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574870.691258:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574870.691260:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574870.691265:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3216
00000100:00100000:2.0:1788574870.691268:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574870/real 1788574870]  req@ffff8dc00644ce00 x1875453361134080/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574895 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574870.691271:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574870.691280:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574870.691285:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574870.691300:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ce00 x1875453361134080/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574895 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574870.691301:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ca80 x1875453361134592/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574870.691334:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574870.691335:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574870.691338:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574870.691342:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788574870.691342:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574870.691349:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3216
00000100:00100000:2.0:1788574870.691350:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361134080:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788574870.691353:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574870.691359:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574870.691363:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574870.691371:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ea00 x1875453361134720/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574870.691379:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574870.691382:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:2.0:1788574870.691384:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361134208:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788574870.691385:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574870.691390:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3216
00000100:00080000:3.0:1788574870.691394:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574870.691397:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574870.691400:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574870.691408:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d500 x1875453361134848/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788574870.691422:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574870.691437:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574870/real 1788574870]  req@ffff8dc00644f800 x1875453361134208/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574895 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574870.691450:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f800 x1875453361134208/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574895 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574870.691461:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574870.691465:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574870.691468:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361134208:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574870.691475:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361134336:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574870.691498:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574870.691507:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574870/real 1788574870]  req@ffff8dc00644c000 x1875453361134336/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574895 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574870.691515:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c000 x1875453361134336/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574895 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574870.691521:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574870.691524:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574870.691526:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361134336:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574870.691530:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361134464:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574870.691542:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574870.691548:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574870/real 1788574870]  req@ffff8dc00644dc00 x1875453361134464/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574895 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574870.691556:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644dc00 x1875453361134464/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574895 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574870.691562:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574870.691564:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574870.691566:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361134464:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574870.691569:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361134592:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574870.691579:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574870.691585:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574870/real 1788574870]  req@ffff8dc00644ca80 x1875453361134592/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574895 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574870.691592:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ca80 x1875453361134592/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574895 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574870.691598:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574870.691600:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574870.691602:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361134592:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574870.691614:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361134720:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574870.691632:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574870.691644:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574870/real 1788574870]  req@ffff8dc00644ea00 x1875453361134720/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574895 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574870.691657:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ea00 x1875453361134720/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574895 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574870.691672:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574870.691675:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574870.691677:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361134720:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574870.691681:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361134848:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574870.691696:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574870.691704:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574870/real 1788574870]  req@ffff8dc00644d500 x1875453361134848/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574895 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574870.691711:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d500 x1875453361134848/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574895 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574870.691716:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574870.691718:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574870.691720:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361134848:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574871.074990:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574871.074990:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574871.075023:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574871.075126:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574871.075140:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574871.075159:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574871.714990:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574872.098965:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574872.098969:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574872.098971:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574872.098992:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574872.099000:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788574872.099002:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574872.739012:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574873.122951:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574873.122978:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574873.122999:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574873.123006:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574873.123015:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574873.123019:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574873.763015:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574874.146982:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574874.146982:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574874.147010:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574874.147120:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574874.147147:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788574874.147197:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574874.787031:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574875.171032:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574875.171032:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574875.171035:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574875.171089:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574875.171106:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788574875.171128:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574875.811021:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574875.811025:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574875.811036:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788574875.811040:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574875.811052:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3221
00000100:00080000:0.0:1788574875.811064:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574875.811073:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574875.811117:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361134976/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574875.811145:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574875.811148:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574875.811150:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574875.811153:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3221
00000100:00080000:0.0:1788574875.811156:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574875.811159:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574875.811169:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574875.811181:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361135104/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574875.811190:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574875.811194:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574875.811196:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788574875.811200:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361134976:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788574875.811203:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3221
00000100:00080000:0.0:1788574875.811211:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574875.811218:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574875.811224:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574875.811247:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361135232/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574875.811255:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574875.811258:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574875.811259:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574875.811262:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3221
00000100:00080000:0.0:1788574875.811265:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574875.811268:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574875.811273:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574875.811282:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453361135360/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788574875.811289:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788574875.811293:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574875.811296:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574875.811298:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574875.811301:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3221
00000100:00080000:0.0:1788574875.811303:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574875.811306:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574875.811309:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574875.811315:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361135488/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574875.811320:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574875.811322:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574875.811323:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574875.811325:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3221
00000100:00080000:0.0:1788574875.811329:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574875.811331:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574875.811335:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574875.811342:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574875/real 1788574875]  req@ffff8dc006711500 x1875453361134976/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574900 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574875.811344:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361135616/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574875.811364:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574875.811368:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574875.811369:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574875.811372:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3221
00000100:00080000:0.0:1788574875.811374:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574875.811378:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574875.811380:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361134976/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574900 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1788574875.811381:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1788574875.811394:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1788574875.811395:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361135744/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574875.811401:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574875.811409:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361134976:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788574875.811449:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361135104:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574875.811468:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574875.811479:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574875/real 1788574875]  req@ffff8dc006713480 x1875453361135104/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574900 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574875.811492:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361135104/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574900 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574875.811503:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574875.811506:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574875.811510:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361135104:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574875.811516:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361135232:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574875.811537:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574875.811548:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574875/real 1788574875]  req@ffff8dc006712680 x1875453361135232/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574900 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574875.811564:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361135232/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574900 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574875.811572:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574875.811575:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574875.811578:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361135232:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574875.811584:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361135360:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574875.811602:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574875.811613:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574875/real 1788574875]  req@ffff8dc006710380 x1875453361135360/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574900 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574875.811626:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453361135360/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574900 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574875.811635:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574875.811639:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574875.811643:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361135360:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574875.811650:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361135488:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574875.811671:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574875.811687:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574875/real 1788574875]  req@ffff8dc006712300 x1875453361135488/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574900 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574875.811700:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361135488/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574900 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574875.811716:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574875.811720:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574875.811723:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361135488:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574875.811729:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361135616:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574875.811758:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574875.811769:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574875/real 1788574875]  req@ffff8dc006713b80 x1875453361135616/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574900 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574875.811777:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361135616/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574900 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574875.811782:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574875.811784:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574875.811786:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361135616:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574875.811790:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361135744:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574875.811802:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574875.811808:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574875/real 1788574875]  req@ffff8dc006713100 x1875453361135744/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574900 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574875.811814:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361135744/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574900 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574875.811818:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574875.811820:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574875.811823:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361135744:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574876.195001:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574876.195001:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574876.195001:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574876.195032:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574876.195036:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788574876.195037:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574876.835015:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574877.218974:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574877.218974:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574877.218996:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788574877.219039:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574877.219042:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574877.219065:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574877.858992:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574878.242961:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574878.242975:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574878.242975:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574878.242984:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574878.243005:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788574878.243085:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574878.883007:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574879.266970:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574879.266990:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574879.266995:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788574879.267016:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574879.267027:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574879.267032:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574879.907057:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574880.290949:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574880.290951:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574880.291024:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574880.291030:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574880.291056:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788574880.291115:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574880.930961:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788574880.930983:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574880.930988:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788574880.930991:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574880.930998:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3226
00000100:00080000:2.0:1788574880.931006:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574880.931012:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574880.931042:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453361135872/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574880.931062:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574880.931065:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574880.931066:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574880.931069:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3226
00000100:00080000:2.0:1788574880.931070:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574880.931072:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574880.931080:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574880.931088:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453361136000/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574880.931094:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361135872:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788574880.931108:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574880.931110:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574880.931111:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574880.931114:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3226
00000100:00080000:2.0:1788574880.931116:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574880.931118:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574880.931121:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574880.931130:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453361136128/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574880.931146:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574880.931149:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574880.931151:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574880.931155:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3226
00000100:00080000:2.0:1788574880.931158:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574880.931162:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574880.931167:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1788574880.931177:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574880.931178:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453361136256/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574880.931186:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574880.931188:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574880.931190:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574880.931192:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3226
00000100:00080000:2.0:1788574880.931196:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574880.931199:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574880.931202:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574880.931209:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361136384/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574880.931214:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574880.931216:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574880.931217:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574880.931220:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3226
00000100:00080000:2.0:1788574880.931221:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574880.931224:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574880.931226:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574880.931236:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574880/real 1788574880]  req@ffff8dc020496d80 x1875453361135872/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574905 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574880.931236:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453361136512/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574880.931252:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574880.931255:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574880.931256:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574880.931260:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3226
00000100:00100000:1.0:1788574880.931261:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453361135872/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574905 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574880.931262:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574880.931268:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574880.931275:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1788574880.931280:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574880.931285:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574880.931290:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361136640/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574880.931293:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361135872:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788574880.931323:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361136000:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574880.931347:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574880.931359:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574880/real 1788574880]  req@ffff8dc020496a00 x1875453361136000/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574905 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574880.931371:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453361136000/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574905 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574880.931381:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574880.931384:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574880.931387:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361136000:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574880.931393:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361136128:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574880.931417:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574880.931428:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574880/real 1788574880]  req@ffff8dc020497100 x1875453361136128/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574905 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574880.931438:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453361136128/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574905 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574880.931446:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574880.931449:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574880.931453:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361136128:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574880.931458:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361136256:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574880.931475:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574880.931485:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574880/real 1788574880]  req@ffff8dc020494380 x1875453361136256/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574905 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574880.931496:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453361136256/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574905 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574880.931505:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574880.931508:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574880.931511:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361136256:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574880.931516:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361136384:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574880.931534:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574880.931545:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574880/real 1788574880]  req@ffff8dc020494700 x1875453361136384/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574905 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574880.931556:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361136384/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574905 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574880.931563:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574880.931566:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574880.931569:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361136384:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574880.931574:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361136512:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574880.931592:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574880.931612:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574880/real 1788574880]  req@ffff8dc020494e00 x1875453361136512/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574905 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574880.931624:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453361136512/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574905 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574880.931631:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574880.931634:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574880.931643:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361136512:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574880.931648:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361136640:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574880.931687:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574880.931698:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574880/real 1788574880]  req@ffff8dc020494000 x1875453361136640/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574905 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574880.931708:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361136640/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574905 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574880.931720:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574880.931724:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574880.931727:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361136640:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574881.314967:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574881.314967:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574881.314967:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574881.314968:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574881.315004:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788574881.315058:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574881.954923:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574882.338974:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574882.338975:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574882.338988:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574882.339008:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574882.339011:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574882.339018:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574882.978963:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574883.362958:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574883.362958:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574883.362959:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574883.362983:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574883.362993:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574883.362994:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574884.002977:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574884.386979:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574884.386979:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574884.386979:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574884.386998:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574884.387013:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788574884.387046:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574885.026989:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574885.410939:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574885.410939:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574885.410951:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574885.410955:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574885.410975:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574885.411007:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1788574886.050963:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788574886.050965:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574886.050972:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788574886.050976:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574886.050984:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3231
00000100:00080000:0.0:1788574886.050993:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574886.051000:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574886.051038:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361136768/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574886.051057:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574886.051060:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574886.051061:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574886.051064:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3231
00000100:00080000:0.0:1788574886.051066:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574886.051069:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574886.051077:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574886.051086:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361136896/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574886.051094:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574886.051096:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574886.051098:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1788574886.051102:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361136768:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788574886.051103:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3231
00000100:00080000:0.0:1788574886.051108:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574886.051113:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574886.051124:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574886.051144:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361137024/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574886.051155:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574886.051158:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574886.051160:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574886.051165:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3231
00000100:00080000:0.0:1788574886.051169:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574886.051174:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574886.051180:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574886.051192:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361137152/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574886.051199:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574886.051202:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574886.051203:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574886.051208:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3231
00000100:00080000:0.0:1788574886.051213:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788574886.051214:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361136896:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788574886.051222:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574886.051236:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574886.051252:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361137280/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574886.051261:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361137024:192.168.202.140@tcp:8:kworker.0
00000100:00080000:0.0:1788574886.051266:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574886.051269:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574886.051278:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574886.051284:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3231
00000100:00080000:0.0:1788574886.051289:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574886.051295:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574886.051299:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361137152:192.168.202.140@tcp:8:kworker.0
00000008:00100000:0.0:1788574886.051303:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574886.051323:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361137408/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574886.051334:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361137280:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788574886.051335:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574886.051343:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574886.051345:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574886.051351:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3231
00000100:00080000:0.0:1788574886.051356:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574886.051361:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574886.051368:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574886.051369:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361137408:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574886.051392:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361137536/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574886.051421:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361137536:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574886.434983:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574886.434983:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574886.434984:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574886.434985:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574886.435026:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788574886.435074:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574887.074987:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574887.458946:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574887.458946:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574887.458955:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574887.458955:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574887.458981:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574887.459012:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574888.098951:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574888.482979:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574888.482979:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574888.482979:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574888.482979:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574888.483008:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788574888.483093:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574889.122980:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000400:00000100:3.0:1788574889.123155:0:2334:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.140:988
00000400:00000100:3.0:1788574889.123195:0:2334:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.140@tcp at host 192.168.202.140 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:3.0:1788574889.123211:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788574889.123258:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788574889.123270:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788574889.123281:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788574889.123291:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788574889.123303:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788574889.123315:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:1.0:1788574889.123327:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574886/real 1788574889]  req@ffff8dc006713100 x1875453361137408/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574911 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574889.123353:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361137408/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574911 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574889.123366:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574889.123370:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574889.123374:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361137408:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574889.123381:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574886/real 1788574889]  req@ffff8dc006713800 x1875453361137280/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574911 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574889.123394:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361137280/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574911 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574889.123403:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574889.123406:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574889.123409:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361137280:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574889.123415:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574886/real 1788574889]  req@ffff8dc006711c00 x1875453361136896/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574911 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574889.123427:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361136896/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574911 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574889.123438:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574889.123441:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574889.123444:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361136896:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574889.123452:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574886/real 1788574889]  req@ffff8dc006711880 x1875453361137024/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574911 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574889.123464:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361137024/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574911 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574889.123473:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574889.123477:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574889.123480:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361137024:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574889.123485:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574886/real 1788574889]  req@ffff8dc006712a00 x1875453361137152/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574911 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574889.123495:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361137152/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574911 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574889.123504:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574889.123507:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574889.123510:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361137152:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574889.123516:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574886/real 1788574889]  req@ffff8dc006710e00 x1875453361136768/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574911 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574889.123528:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361136768/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574911 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574889.123536:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574889.123539:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574889.123541:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361136768:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788574889.123568:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574886/real 1788574889]  req@ffff8dc006713b80 x1875453361137536/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574911 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574889.123578:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361137536/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574911 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574889.123585:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574889.123588:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574889.123591:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361137536:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574889.506962:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574889.506966:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574889.506967:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574889.506984:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574889.507007:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788574889.507033:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574890.146940:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574890.530968:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574890.530968:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574890.530979:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574890.530999:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574890.531013:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574890.531015:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00080000:0.0:1788574891.170961:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788574891.170961:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574891.170970:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788574891.170974:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574891.170991:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3236
00000100:00080000:0.0:1788574891.171000:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574891.171007:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574891.171035:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361137664/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574891.171059:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574891.171063:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574891.171065:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574891.171069:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3236
00000100:00080000:0.0:1788574891.171073:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574891.171077:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574891.171088:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574891.171103:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453361137792/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574891.171113:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361137664:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788574891.171130:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574891.171135:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574891.171137:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574891.171142:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3236
00000100:00080000:0.0:1788574891.171147:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574891.171152:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574891.171159:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574891.171173:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361137920/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788574891.171183:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788574891.171186:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574891.171191:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574891.171193:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574891.171199:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3236
00000100:00080000:0.0:1788574891.171211:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574891.171216:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574891.171222:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574891.171231:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574891/real 1788574891]  req@ffff8dc006712300 x1875453361137664/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574916 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574891.171237:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361138048/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574891.171265:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788574891.171265:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361137664/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574916 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574891.171274:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574891.171279:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574891.171288:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3236
00000100:00080000:1.0:1788574891.171291:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574891.171293:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574891.171303:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788574891.171304:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574891.171313:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574891.171314:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361137664:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788574891.171330:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361138176/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574891.171344:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788574891.171346:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361137792:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788574891.171349:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574891.171355:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574891.171360:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3236
00000100:00080000:0.0:1788574891.171365:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574891.171369:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574891.171376:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1788574891.171382:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574891.171392:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361138304/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574891.171403:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574891/real 1788574891]  req@ffff8dc006710380 x1875453361137792/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574916 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574891.171404:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574891.171413:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574891.171417:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574891.171427:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3236
00000100:00100000:1.0:1788574891.171432:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453361137792/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574916 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574891.171433:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574891.171443:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574891.171453:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1788574891.171456:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574891.171463:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574891.171470:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361138432/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788574891.171471:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361137792:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574891.171487:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361137920:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574891.171518:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574891.171533:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574891/real 1788574891]  req@ffff8dc006712680 x1875453361137920/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574916 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574891.171547:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361137920/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574916 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574891.171557:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574891.171561:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574891.171565:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361137920:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574891.171572:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361138048:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574891.171609:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574891.171622:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574891/real 1788574891]  req@ffff8dc006713480 x1875453361138048/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574916 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574891.171634:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361138048/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574916 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574891.171644:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574891.171647:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574891.171651:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361138048:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574891.171669:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361138176:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788574891.171691:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574891.171704:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574891/real 1788574891]  req@ffff8dc006711500 x1875453361138176/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574916 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574891.171718:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361138176/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574916 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574891.171728:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574891.171732:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574891.171735:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361138176:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574891.171742:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361138304:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574891.171769:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574891.171783:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574891/real 1788574891]  req@ffff8dc006712300 x1875453361138304/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574916 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574891.171801:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361138304/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574916 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574891.171810:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574891.171813:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574891.171816:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361138304:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574891.171823:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361138432:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788574891.171844:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574891.171855:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574891/real 1788574891]  req@ffff8dc006713b80 x1875453361138432/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574916 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574891.171896:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361138432/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574916 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574891.171907:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574891.171910:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788574891.171914:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361138432:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574891.554959:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574891.554960:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574891.554960:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574891.554991:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574891.554994:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788574891.555004:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574892.194940:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574892.578970:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574892.578975:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574892.578982:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574892.579003:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574892.579014:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574892.579032:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574893.219048:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574893.602993:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574893.602997:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574893.603032:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788574893.603053:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574893.603056:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574893.603085:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574894.242966:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574894.627013:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574894.627037:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574894.627045:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574894.627062:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574894.627066:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574894.627067:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574895.266999:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574895.650926:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574895.650998:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574895.651006:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574895.651007:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574895.651037:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788574895.651041:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574896.291017:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574896.291029:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574896.291038:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788574896.291044:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574896.291057:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3241
00000100:00080000:1.0:1788574896.291071:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574896.291079:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574896.291123:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361138560/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574896.291151:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574896.291154:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574896.291156:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574896.291160:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3241
00000100:00080000:1.0:1788574896.291163:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574896.291166:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574896.291177:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574896.291188:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361138560:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788574896.291192:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361138688/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574896.291202:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574896.291205:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574896.291206:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574896.291209:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3241
00000100:00080000:1.0:1788574896.291212:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574896.291214:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574896.291218:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574896.291226:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361138816/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574896.291250:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574896.291254:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574896.291256:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574896.291262:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3241
00000100:00080000:1.0:1788574896.291266:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574896.291271:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:2.0:1788574896.291278:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:1.0:1788574896.291279:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574896.291296:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361138944/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574896.291305:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574896.291308:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574896.291309:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574896.291312:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3241
00000100:00080000:1.0:1788574896.291316:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574896.291319:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574896.291324:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574896.291329:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574896/real 1788574896]  req@ffff8dc005dc1c00 x1875453361138560/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574921 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574896.291336:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361139072/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574896.291350:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574896.291354:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574896.291358:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788574896.291358:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361138560/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574921 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574896.291363:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3241
00000100:00080000:1.0:1788574896.291370:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574896.291374:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:2.0:1788574896.291375:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:1.0:1788574896.291378:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1788574896.291382:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574896.291387:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361138560:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788574896.291391:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361139200/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574896.291399:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574896.291401:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574896.291402:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574896.291405:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3241
00000100:00080000:1.0:1788574896.291406:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574896.291408:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574896.291412:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574896.291415:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361138688:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574896.291422:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361139328/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788574896.291438:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574896.291452:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574896/real 1788574896]  req@ffff8dc005dc3800 x1875453361138688/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574921 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574896.291461:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361138688/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574921 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574896.291468:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574896.291471:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574896.291473:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361138688:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574896.291478:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361138816:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574896.291491:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574896.291497:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574896/real 1788574896]  req@ffff8dc005dc0700 x1875453361138816/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574921 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574896.291505:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361138816/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574921 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574896.291511:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574896.291512:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574896.291514:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361138816:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574896.291518:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361138944:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574896.291529:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574896.291535:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574896/real 1788574896]  req@ffff8dc005dc3b80 x1875453361138944/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574921 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574896.291543:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361138944/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574921 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574896.291576:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574896.291579:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574896.291581:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361138944:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574896.291585:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361139072:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574896.291602:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574896.291610:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574896/real 1788574896]  req@ffff8dc005dc2d80 x1875453361139072/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574921 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574896.291618:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361139072/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574921 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574896.291625:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574896.291627:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574896.291629:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361139072:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574896.291632:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361139200:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574896.291643:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574896.291649:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574896/real 1788574896]  req@ffff8dc005dc1180 x1875453361139200/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574921 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574896.291656:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361139200/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574921 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574896.291661:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574896.291662:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574896.291664:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361139200:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574896.291677:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361139328:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574896.291687:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574896.291693:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574896/real 1788574896]  req@ffff8dc005dc0a80 x1875453361139328/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574921 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574896.291701:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361139328/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574921 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574896.291707:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574896.291709:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574896.291711:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361139328:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574896.674994:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574896.674994:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574896.674995:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574896.675032:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574896.675063:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574896.675085:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574897.314977:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574897.698959:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574897.698977:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574897.698986:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574897.699014:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574897.699031:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574897.699035:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574898.339048:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574898.723005:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574898.723011:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574898.723011:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574898.723040:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574898.723049:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574898.723049:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574899.362956:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574899.746937:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574899.746964:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574899.747021:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574899.747065:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574899.747065:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574899.747120:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574900.387031:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574900.771000:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574900.771000:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574900.771008:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574900.771058:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574900.771058:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574900.771090:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574901.411002:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574901.411004:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574901.411014:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788574901.411018:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574901.411029:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3247
00000100:00080000:0.0:1788574901.411042:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574901.411050:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574901.411101:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361139456/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574901.411128:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574901.411131:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574901.411132:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574901.411135:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3247
00000100:00080000:0.0:1788574901.411138:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574901.411141:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574901.411154:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574901.411169:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361139456:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788574901.411171:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361139584/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574901.411188:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574901.411193:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574901.411195:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574901.411200:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3247
00000100:00080000:0.0:1788574901.411204:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574901.411208:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574901.411216:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574901.411233:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361139712/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574901.411244:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574901.411248:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574901.411251:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574901.411256:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3247
00000100:00080000:0.0:1788574901.411269:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1788574901.411274:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788574901.411278:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574901.411284:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574901.411295:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361139840/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574901.411303:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574901.411306:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574901.411308:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574901.411311:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3247
00000100:00080000:0.0:1788574901.411314:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574901.411317:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574901.411320:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574901.411329:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361139968/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574901.411336:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574901.411339:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:2.0:1788574901.411339:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574901/real 1788574901]  req@ffff8dc006710e00 x1875453361139456/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574926 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574901.411349:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574901.411358:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3247
00000100:00080000:0.0:1788574901.411361:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574901.411364:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574901.411368:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574901.411370:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361139456/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574926 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574901.411379:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361140096/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574901.411392:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574901.411392:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574901.411399:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574901.411401:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574901.411404:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788574901.411406:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3247
00000100:00080000:0.0:1788574901.411412:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574901.411417:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574901.411417:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361139456:192.168.202.140@tcp:250:kworker.0
00000008:00100000:0.0:1788574901.411424:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574901.411433:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361140224/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574901.411455:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361139584:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574901.411485:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574901.411500:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574901/real 1788574901]  req@ffff8dc006712a00 x1875453361139584/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574926 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574901.411532:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361139584/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574926 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574901.411545:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574901.411549:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574901.411553:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361139584:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574901.411560:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361139712:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574901.411585:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574901.411598:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574901/real 1788574901]  req@ffff8dc006711880 x1875453361139712/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574926 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574901.411611:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361139712/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574926 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574901.411621:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574901.411625:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574901.411628:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361139712:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574901.411635:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361139840:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574901.411655:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574901.411667:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574901/real 1788574901]  req@ffff8dc006711c00 x1875453361139840/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574926 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574901.411679:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361139840/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574926 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574901.411689:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574901.411702:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574901.411706:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361139840:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574901.411713:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361139968:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574901.411734:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574901.411745:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574901/real 1788574901]  req@ffff8dc006713800 x1875453361139968/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574926 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574901.411758:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361139968/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574926 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574901.411768:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574901.411772:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574901.411776:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361139968:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574901.411782:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361140096:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574901.411802:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574901.411813:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574901/real 1788574901]  req@ffff8dc006713100 x1875453361140096/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574926 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574901.411826:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361140096/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574926 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574901.411835:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574901.411839:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574901.411842:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361140096:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574901.411849:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361140224:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574901.411892:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574901.411905:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574901/real 1788574901]  req@ffff8dc006713b80 x1875453361140224/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574926 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574901.411919:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361140224/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574926 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574901.411929:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574901.411933:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574901.411937:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361140224:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574901.795036:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574901.795036:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574901.795039:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574901.795074:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574901.795077:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574901.795100:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574902.435025:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574902.819018:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574902.819020:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574902.819032:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574902.819068:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574902.819071:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574902.819080:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574903.458954:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574903.842986:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574903.842990:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574903.842991:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574903.843021:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574903.843053:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574903.843063:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574904.482957:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574904.866957:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574904.866957:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574904.866961:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574904.866992:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788574904.866997:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574904.867003:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574905.506954:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574905.890983:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574905.890983:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574905.890983:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574905.890983:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574905.891018:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574905.891053:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1788574906.530960:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788574906.530966:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574906.530968:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788574906.530973:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574906.530983:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3252
00000100:00080000:0.0:1788574906.530992:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574906.530999:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574906.531033:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361140352/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574906.531055:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574906.531058:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574906.531059:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574906.531062:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3252
00000100:00080000:0.0:1788574906.531064:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574906.531066:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574906.531074:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574906.531084:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361140480/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574906.531092:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574906.531094:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574906.531095:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574906.531101:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3252
00000100:00100000:2.0:1788574906.531101:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361140352:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788574906.531105:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574906.531108:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574906.531117:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574906.531129:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361140608/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574906.531145:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574906.531149:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574906.531151:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574906.531155:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3252
00000100:00080000:0.0:1788574906.531159:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574906.531164:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574906.531168:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788574906.531177:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574906.531180:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361140736/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574906.531188:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574906.531191:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574906.531192:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574906.531195:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3252
00000100:00080000:0.0:1788574906.531198:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574906.531201:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574906.531203:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574906.531208:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453361140864/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574906.531214:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574906.531216:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574906.531218:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574906.531221:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3252
00000100:00080000:0.0:1788574906.531223:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574906.531226:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574906.531230:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574906.531238:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361140992/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574906.531244:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574906/real 1788574906]  req@ffff8dc006712300 x1875453361140352/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574931 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574906.531270:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574906.531275:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574906.531277:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788574906.531280:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361140352/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574931 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574906.531285:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3252
00000100:00080000:0.0:1788574906.531293:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574906.531298:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574906.531301:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:2.0:1788574906.531306:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000008:00100000:0.0:1788574906.531307:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574906.531313:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361140352:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788574906.531321:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361141120/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574906.531340:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361140480:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574906.531368:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574906.531382:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574906/real 1788574906]  req@ffff8dc006711500 x1875453361140480/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574931 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574906.531395:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361140480/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574931 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574906.531406:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574906.531410:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574906.531413:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361140480:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574906.531420:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361140608:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574906.531439:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574906.531451:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574906/real 1788574906]  req@ffff8dc006713480 x1875453361140608/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574931 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574906.531464:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361140608/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574931 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574906.531487:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574906.531491:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574906.531494:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361140608:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574906.531500:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361140736:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574906.531522:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574906.531534:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574906/real 1788574906]  req@ffff8dc006712680 x1875453361140736/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574931 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574906.531546:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361140736/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574931 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574906.531555:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574906.531558:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574906.531563:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361140736:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574906.531569:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361140864:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574906.531587:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574906.531598:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574906/real 1788574906]  req@ffff8dc006710380 x1875453361140864/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574931 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574906.531609:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453361140864/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574931 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574906.531624:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574906.531627:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574906.531631:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361140864:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574906.531637:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361140992:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574906.531655:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574906.531666:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574906/real 1788574906]  req@ffff8dc006713b80 x1875453361140992/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574931 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574906.531678:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361140992/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574931 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574906.531686:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574906.531690:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574906.531693:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361140992:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574906.531699:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361141120:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574906.531716:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574906.531726:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574906/real 1788574906]  req@ffff8dc006713100 x1875453361141120/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574931 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574906.531739:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361141120/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574931 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574906.531747:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574906.531751:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574906.531755:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361141120:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574906.914960:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574906.914968:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574906.914996:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574906.915013:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574906.915017:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788574906.915028:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574907.554943:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574907.938985:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574907.938985:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574907.938985:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574907.939017:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574907.939024:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574907.939026:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574908.578967:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574908.962951:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574908.962955:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574908.962970:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574908.962994:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574908.963024:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788574908.963025:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574909.602953:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574909.987018:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574909.987018:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574909.987018:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574909.987060:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574909.987079:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574909.987114:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574910.626960:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574911.010967:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574911.010969:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574911.010970:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574911.011002:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574911.011019:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788574911.011025:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574911.650937:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574911.650966:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574911.650971:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788574911.650975:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574911.650982:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3257
00000100:00080000:1.0:1788574911.650991:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574911.650998:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574911.651029:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361141248/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574911.651060:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574911.651063:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574911.651064:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574911.651067:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3257
00000100:00080000:1.0:1788574911.651070:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574911.651073:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574911.651081:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574911.651093:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361141376/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574911.651101:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788574911.651105:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361141248:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574911.651105:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574911.651107:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574911.651113:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3257
00000100:00080000:1.0:1788574911.651116:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574911.651118:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574911.651126:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574911.651144:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361141504/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574911.651155:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574911.651160:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574911.651162:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574911.651167:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3257
00000100:00080000:1.0:1788574911.651181:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574911.651187:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:0.0:1788574911.651188:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:1.0:1788574911.651198:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574911.651213:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361141632/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574911.651225:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574911.651229:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574911.651231:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788574911.651234:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574911/real 1788574911]  req@ffff8dc005dc1500 x1875453361141248/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574936 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574911.651238:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3257
00000100:00080000:1.0:1788574911.651245:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574911.651252:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574911.651261:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574911.651272:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361141760/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574911.651276:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361141248/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574936 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574911.651296:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574911.651299:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574911.651303:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574911.651306:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788574911.651308:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788574911.651311:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361141248:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574911.651318:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3257
00000100:00080000:1.0:1788574911.651323:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574911.651328:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574911.651333:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574911.651335:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361141376:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574911.651348:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361141888/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574911.651358:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1788574911.651360:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788574911.651370:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:0.0:1788574911.651372:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574911/real 1788574911]  req@ffff8dc005dc0a80 x1875453361141376/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574936 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574911.651373:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574911.651382:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3257
00000100:00080000:1.0:1788574911.651388:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574911.651393:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574911.651396:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361141376/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574936 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1788574911.651399:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1788574911.651411:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1788574911.651414:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361142016/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574911.651417:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574911.651440:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361141376:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574911.651452:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361141504:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574911.651473:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574911.651482:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574911/real 1788574911]  req@ffff8dc005dc1180 x1875453361141504/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574936 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574911.651491:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361141504/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574936 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574911.651502:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574911.651505:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574911.651508:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361141504:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574911.651516:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361141632:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574911.651541:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574911.651556:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574911/real 1788574911]  req@ffff8dc005dc2d80 x1875453361141632/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574936 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574911.651581:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361141632/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574936 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574911.651589:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574911.651593:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574911.651597:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361141632:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574911.651602:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361141760:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574911.651617:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574911.651624:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574911/real 1788574911]  req@ffff8dc005dc3b80 x1875453361141760/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574936 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574911.651632:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361141760/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574936 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574911.651637:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574911.651639:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574911.651642:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361141760:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574911.651655:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361141888:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574911.651666:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574911.651675:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574911/real 1788574911]  req@ffff8dc005dc0700 x1875453361141888/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574936 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574911.651687:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361141888/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574936 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574911.651696:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574911.651699:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574911.651703:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361141888:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574911.651710:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361142016:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574911.651730:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574911.651753:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574911/real 1788574911]  req@ffff8dc005dc3800 x1875453361142016/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574936 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574911.651766:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361142016/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574936 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574911.651775:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574911.651778:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574911.651781:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361142016:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574912.034980:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574912.034980:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574912.034980:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574912.034991:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574912.035014:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788574912.035054:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574912.674950:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574913.058963:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574913.058963:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574913.058964:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574913.058998:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574913.059005:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788574913.059010:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574913.698969:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574914.082981:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574914.082981:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574914.082982:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574914.082982:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574914.083016:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788574914.083060:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574914.722995:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574915.106969:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574915.106969:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574915.106969:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574915.107005:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574915.107006:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788574915.107024:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574915.746969:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574916.130956:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574916.130956:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574916.130956:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574916.130959:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574916.130990:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788574916.131041:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1788574916.770961:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574916.770970:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788574916.770974:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788574916.770974:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574916.770984:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3262
00000100:00080000:1.0:1788574916.770993:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574916.771000:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574916.771034:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361142144/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574916.771060:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574916.771063:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574916.771064:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574916.771067:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3262
00000100:00080000:1.0:1788574916.771069:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574916.771072:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574916.771080:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574916.771090:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361142272/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574916.771104:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574916.771107:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574916.771108:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574916.771111:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3262
00000100:00080000:1.0:1788574916.771114:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788574916.771119:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361142144:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574916.771119:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574916.771127:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574916.771140:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361142400/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574916.771148:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574916.771151:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574916.771152:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574916.771154:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3262
00000100:00080000:1.0:1788574916.771156:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574916.771158:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574916.771161:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574916.771169:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361142528/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574916.771175:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574916.771178:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574916.771180:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574916.771182:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3262
00000100:00080000:1.0:1788574916.771185:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574916.771188:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:0.0:1788574916.771194:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:1.0:1788574916.771195:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574916.771213:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361142656/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574916.771220:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574916.771222:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574916.771223:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574916.771227:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3262
00000100:00080000:1.0:1788574916.771230:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788574916.771233:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574916/real 1788574916]  req@ffff8dc005dc1c00 x1875453361142144/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574941 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574916.771235:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574916.771242:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574916.771256:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361142784/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574916.771261:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361142144/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574941 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574916.771269:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574916.771278:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574916.771282:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574916.771285:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574916.771289:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3262
00000100:00080000:0.0:1788574916.771292:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788574916.771295:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788574916.771298:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361142144:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574916.771304:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574916.771311:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574916.771315:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361142272:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574916.771328:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361142912/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1788574916.771338:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574916.771353:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574916/real 1788574916]  req@ffff8dc005dc3800 x1875453361142272/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574941 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574916.771366:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361142272/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574941 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574916.771374:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574916.771376:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574916.771379:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361142272:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574916.771430:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361142400:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574916.771449:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574916.771458:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574916/real 1788574916]  req@ffff8dc005dc0700 x1875453361142400/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574941 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574916.771469:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361142400/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574941 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574916.771476:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574916.771478:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574916.771481:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361142400:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574916.771485:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361142528:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574916.771498:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574916.771505:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574916/real 1788574916]  req@ffff8dc005dc3b80 x1875453361142528/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574941 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574916.771512:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361142528/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574941 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574916.771518:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574916.771519:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574916.771521:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361142528:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574916.771525:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361142656:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574916.771536:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574916.771542:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574916/real 1788574916]  req@ffff8dc005dc2d80 x1875453361142656/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574941 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574916.771554:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361142656/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574941 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574916.771563:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574916.771565:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574916.771568:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361142656:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574916.771572:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361142784:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574916.771585:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574916.771591:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574916/real 1788574916]  req@ffff8dc005dc1180 x1875453361142784/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574941 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574916.771599:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361142784/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574941 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574916.771604:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574916.771606:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574916.771608:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361142784:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574916.771611:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361142912:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574916.771621:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574916.771626:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574916/real 1788574916]  req@ffff8dc005dc0a80 x1875453361142912/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574941 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574916.771633:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361142912/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574941 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574916.771642:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574916.771643:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574916.771645:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361142912:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574917.154970:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574917.154970:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574917.154973:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574917.154999:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574917.155006:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788574917.155032:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574917.794974:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574918.178981:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574918.178982:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574918.178982:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574918.178982:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574918.179018:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788574918.179080:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574918.818975:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574919.203021:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574919.203055:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574919.203062:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574919.203089:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788574919.203092:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574919.203096:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574919.842965:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574920.226971:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574920.226983:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574920.226989:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574920.227021:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574920.227037:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574920.227055:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574920.866936:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574921.250977:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574921.250977:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574921.250989:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574921.251005:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574921.251007:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574921.251018:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574921.890974:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788574921.891000:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574921.891004:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788574921.891007:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574921.891014:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3267
00000100:00080000:2.0:1788574921.891023:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574921.891038:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574921.891077:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361143040/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574921.891103:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574921.891106:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574921.891108:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574921.891117:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3267
00000100:00080000:2.0:1788574921.891121:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574921.891128:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574921.891138:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574921.891155:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361143040:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788574921.891156:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453361143168/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574921.891173:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574921.891177:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574921.891179:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574921.891184:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3267
00000100:00080000:2.0:1788574921.891188:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574921.891194:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574921.891200:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574921.891214:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361143296/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574921.891222:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574921.891225:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574921.891228:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1788574921.891229:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788574921.891235:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3267
00000100:00080000:2.0:1788574921.891239:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574921.891243:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574921.891247:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574921.891257:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361143424/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574921.891268:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788574921.891271:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574921/real 1788574921]  req@ffff8dc020495500 x1875453361143040/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574946 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574921.891272:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574921.891276:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574921.891283:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3267
00000100:00080000:2.0:1788574921.891287:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574921.891292:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574921.891295:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574921.891303:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361143040/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574946 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574921.891305:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453361143552/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574921.891332:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574921.891337:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574921.891339:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574921.891341:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574921.891342:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3267
00000100:00080000:2.0:1788574921.891362:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574921.891366:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574921.891370:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1788574921.891378:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574921.891381:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361143680/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574921.891387:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361143040:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788574921.891398:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574921.891401:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574921.891402:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574921.891406:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3267
00000100:00100000:0.0:1788574921.891411:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361143168:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788574921.891411:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574921.891419:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574921.891422:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574921.891431:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453361143808/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1788574921.891447:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574921.891468:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574921/real 1788574921]  req@ffff8dc020497480 x1875453361143168/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574946 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574921.891483:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453361143168/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574946 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574921.891494:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574921.891497:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574921.891499:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361143168:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574921.891504:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361143296:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574921.891520:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574921.891528:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574921/real 1788574921]  req@ffff8dc020495880 x1875453361143296/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574946 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574921.891536:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361143296/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574946 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574921.891542:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574921.891544:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574921.891546:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361143296:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574921.891549:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361143424:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574921.891559:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574921.891565:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574921/real 1788574921]  req@ffff8dc020495180 x1875453361143424/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574946 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574921.891572:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361143424/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574946 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574921.891577:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574921.891579:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574921.891582:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361143424:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574921.891585:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361143552:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574921.891595:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574921.891601:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574921/real 1788574921]  req@ffff8dc020494a80 x1875453361143552/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574946 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574921.891607:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453361143552/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574946 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574921.891613:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574921.891615:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574921.891617:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361143552:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574921.891621:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361143680:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574921.891630:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574921.891636:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574921/real 1788574921]  req@ffff8dc020494000 x1875453361143680/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574946 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574921.891643:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361143680/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574946 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574921.891648:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574921.891650:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574921.891651:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361143680:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574921.891664:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361143808:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574921.891674:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574921.891680:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574921/real 1788574921]  req@ffff8dc020494e00 x1875453361143808/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574946 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574921.891687:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453361143808/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574946 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574921.891693:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574921.891694:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574921.891696:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361143808:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574922.274990:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574922.274990:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574922.275020:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574922.275098:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574922.275110:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574922.275151:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574922.914989:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574923.298971:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574923.298973:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574923.298987:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574923.299041:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574923.299056:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574923.299061:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574923.938981:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574924.322967:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574924.322973:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574924.322974:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574924.323003:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574924.323017:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574924.323074:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574924.962999:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574925.346991:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574925.346991:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574925.347000:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574925.347036:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574925.347044:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574925.347085:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574925.987107:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574926.370942:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574926.371006:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574926.371014:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574926.371018:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574926.371022:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574926.371057:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00080000:1.0:1788574927.011027:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788574927.011038:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574927.011043:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788574927.011052:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574927.011065:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3272
00000100:00080000:1.0:1788574927.011080:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574927.011089:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574927.011143:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361143936/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574927.011180:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574927.011185:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574927.011187:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574927.011192:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3272
00000100:00080000:1.0:1788574927.011196:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574927.011201:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574927.011214:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574927.011232:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361143936:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788574927.011233:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361144064/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574927.011249:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574927.011253:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574927.011255:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574927.011259:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3272
00000100:00080000:1.0:1788574927.011264:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574927.011270:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574927.011277:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574927.011292:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361144192/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574927.011303:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574927.011307:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574927.011323:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574927.011328:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3272
00000100:00080000:1.0:1788574927.011333:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574927.011337:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:0.0:1788574927.011343:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:1.0:1788574927.011344:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574927.011362:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361144320/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574927.011374:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574927.011378:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574927.011380:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574927.011385:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3272
00000100:00080000:1.0:1788574927.011389:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574927.011395:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574927.011400:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574927/real 1788574927]  req@ffff8dc005dc1500 x1875453361143936/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574952 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1788574927.011402:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574927.011424:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361144448/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574927.011425:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361143936/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574952 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574927.011460:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574927.011464:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574927.011468:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361143936:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574927.011473:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574927.011483:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574927.011485:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574927.011491:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3272
00000100:00100000:0.0:1788574927.011494:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361144064:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788574927.011499:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574927.011507:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574927.011513:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788574927.011519:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574927.011530:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361144576/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574927.011533:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574927/real 1788574927]  req@ffff8dc005dc0a80 x1875453361144064/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574952 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574927.011562:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361144064/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574952 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574927.011575:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574927.011578:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574927.011580:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574927.011584:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788574927.011585:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788574927.011589:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361144064:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788574927.011595:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3272
00000100:00100000:0.0:1788574927.011599:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361144192:192.168.202.140@tcp:8:kworker.0
00000100:00080000:1.0:1788574927.011601:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574927.011610:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574927.011617:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788574927.011621:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574927.011632:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574927/real 1788574927]  req@ffff8dc005dc1180 x1875453361144192/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574952 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574927.011637:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361144704/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574927.011648:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361144192/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574952 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574927.011659:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574927.011668:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574927.011672:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361144192:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574927.011677:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361144320:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574927.011690:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574927.011697:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574927/real 1788574927]  req@ffff8dc005dc2d80 x1875453361144320/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574952 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574927.011710:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361144320/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574952 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574927.011717:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574927.011719:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574927.011721:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361144320:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574927.011724:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361144448:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574927.011736:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574927.011742:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574927/real 1788574927]  req@ffff8dc005dc3b80 x1875453361144448/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574952 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574927.011750:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361144448/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574952 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574927.011756:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574927.011758:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574927.011760:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361144448:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574927.011772:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361144576:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574927.011788:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574927.011798:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574927/real 1788574927]  req@ffff8dc005dc0700 x1875453361144576/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574952 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574927.011813:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361144576/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574952 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574927.011830:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574927.011834:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574927.011837:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361144576:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574927.011842:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361144704:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574927.011857:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574927.011884:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574927/real 1788574927]  req@ffff8dc005dc3800 x1875453361144704/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574952 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574927.011897:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361144704/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574952 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574927.011906:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574927.011910:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574927.011914:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361144704:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574927.395010:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574927.395010:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574927.395010:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574927.395011:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574927.395048:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574927.395116:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574928.035047:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574928.418984:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574928.419026:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574928.419030:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574928.419035:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574928.419039:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574928.419122:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574929.059000:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574929.443034:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574929.443034:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574929.443036:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574929.443036:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574929.443085:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574929.443143:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574930.083010:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574930.467001:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574930.467001:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574930.467001:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574930.467003:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574930.467058:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574930.467096:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574931.107054:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574931.490999:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574931.490999:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574931.490999:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574931.490999:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574931.491035:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574931.491101:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1788574932.131029:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788574932.131034:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788574932.131043:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788574932.131049:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574932.131061:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3277
00000100:00080000:2.0:1788574932.131072:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574932.131081:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574932.131133:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361144832/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574932.131165:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574932.131169:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574932.131171:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574932.131176:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3277
00000100:00080000:2.0:1788574932.131180:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574932.131184:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574932.131196:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574932.131212:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453361144960/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574932.131228:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361144832:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788574932.131233:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574932.131239:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574932.131241:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574932.131246:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3277
00000100:00080000:2.0:1788574932.131250:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574932.131254:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574932.131260:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574932.131296:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453361145088/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574932.131306:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574932.131310:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574932.131312:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574932.131317:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3277
00000100:00080000:2.0:1788574932.131320:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574932.131325:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574932.131331:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788574932.131342:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574932.131345:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453361145216/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574932.131356:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574932.131359:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574932.131361:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574932.131366:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3277
00000100:00080000:2.0:1788574932.131369:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574932.131374:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574932.131379:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574932.131390:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453361145344/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574932.131399:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574932.131404:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:0.0:1788574932.131407:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574932/real 1788574932]  req@ffff8dc020494700 x1875453361144832/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574957 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574932.131408:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574932.131418:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3277
00000100:00080000:2.0:1788574932.131425:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574932.131433:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574932.131438:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574932.131442:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361144832/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574957 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574932.131455:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453361145472/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574932.131458:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574932.131469:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788574932.131475:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788574932.131478:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361144832:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788574932.131482:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574932.131487:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574932.131492:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3277
00000100:00080000:2.0:1788574932.131497:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574932.131501:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574932.131507:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574932.131512:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361144960:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574932.131519:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361145600/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1788574932.131546:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574932.131562:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574932/real 1788574932]  req@ffff8dc020494380 x1875453361144960/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574957 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574932.131577:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453361144960/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574957 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574932.131600:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574932.131604:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574932.131608:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361144960:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574932.131615:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361145088:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574932.131640:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574932.131654:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574932/real 1788574932]  req@ffff8dc020497100 x1875453361145088/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574957 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574932.131669:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453361145088/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574957 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574932.131687:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574932.131691:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574932.131695:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361145088:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574932.131701:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361145216:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574932.131722:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574932.131734:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574932/real 1788574932]  req@ffff8dc020496a00 x1875453361145216/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574957 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574932.131748:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453361145216/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574957 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574932.131758:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574932.131762:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574932.131766:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361145216:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574932.131772:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361145344:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574932.131795:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574932.131807:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574932/real 1788574932]  req@ffff8dc020496d80 x1875453361145344/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574957 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574932.131830:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453361145344/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574957 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574932.131841:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574932.131845:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574932.131849:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361145344:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574932.131856:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361145472:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574932.131926:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574932.131939:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574932/real 1788574932]  req@ffff8dc020494e00 x1875453361145472/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574957 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574932.131953:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453361145472/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574957 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574932.131962:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574932.131966:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574932.131970:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361145472:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574932.131993:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361145600:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574932.132026:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574932.132038:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574932/real 1788574932]  req@ffff8dc020494000 x1875453361145600/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574957 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574932.132051:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361145600/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574957 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574932.132060:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574932.132064:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574932.132067:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361145600:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574932.515020:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574932.515020:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574932.515021:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574932.515021:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574932.515061:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574932.515106:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574933.154996:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574933.538998:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574933.538998:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574933.538998:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574933.539049:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574933.539050:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788574933.539050:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574934.178986:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574934.563023:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574934.563030:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574934.563035:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574934.563065:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574934.563075:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574934.563084:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574935.203050:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574935.587006:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574935.587009:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574935.587035:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574935.587058:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574935.587066:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788574935.587103:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574936.226975:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574936.610978:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574936.610983:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574936.611015:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574936.611015:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574936.611049:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574936.611063:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1788574937.251025:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788574937.251025:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574937.251039:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788574937.251045:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574937.251058:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3282
00000100:00080000:1.0:1788574937.251072:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574937.251081:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574937.251131:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361145728/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574937.251167:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574937.251172:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574937.251174:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574937.251178:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3282
00000100:00080000:1.0:1788574937.251186:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574937.251191:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574937.251203:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574937.251220:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361145856/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574937.251227:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361145728:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788574937.251249:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574937.251254:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574937.251256:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574937.251261:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3282
00000100:00080000:1.0:1788574937.251265:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574937.251270:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574937.251276:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574937.251290:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361145984/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574937.251300:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574937.251304:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574937.251306:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574937.251310:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3282
00000100:00080000:1.0:1788574937.251313:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574937.251317:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574937.251323:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788574937.251326:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574937.251339:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361146112/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574937.251350:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574937.251354:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574937.251355:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574937.251360:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3282
00000100:00080000:1.0:1788574937.251364:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574937.251369:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574937.251374:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574937.251376:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574937/real 1788574937]  req@ffff8dc005dc1c00 x1875453361145728/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574962 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574937.251389:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361146240/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574937.251399:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788574937.251401:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361145728/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574962 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574937.251405:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574937.251409:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574937.251418:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3282
00000100:00080000:1.0:1788574937.251422:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574937.251427:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:0.0:1788574937.251428:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:1.0:1788574937.251434:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1788574937.251436:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574937.251443:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361145728:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788574937.251450:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361146368/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574937.251460:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574937.251463:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574937.251465:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574937.251469:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3282
00000100:00080000:1.0:1788574937.251472:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574937.251476:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574937.251481:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574937.251482:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361145856:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574937.251497:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361146496/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1788574937.251511:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574937.251523:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574937/real 1788574937]  req@ffff8dc005dc3800 x1875453361145856/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574962 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574937.251532:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361145856/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574962 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574937.251546:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574937.251551:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574937.251554:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361145856:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574937.251560:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361145984:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574937.251582:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574937.251593:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574937/real 1788574937]  req@ffff8dc005dc0700 x1875453361145984/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574962 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574937.251605:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361145984/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574962 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574937.251614:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574937.251617:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574937.251621:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361145984:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574937.251627:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361146112:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574937.251643:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574937.251650:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574937/real 1788574937]  req@ffff8dc005dc3b80 x1875453361146112/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574962 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574937.251657:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361146112/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574962 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574937.251662:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574937.251664:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574937.251666:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361146112:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574937.251670:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361146240:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574937.251690:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574937.251696:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574937/real 1788574937]  req@ffff8dc005dc2d80 x1875453361146240/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574962 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574937.251703:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361146240/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574962 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574937.251709:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574937.251711:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574937.251712:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361146240:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574937.251717:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361146368:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574937.251735:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574937.251745:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574937/real 1788574937]  req@ffff8dc005dc1180 x1875453361146368/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574962 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574937.251756:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361146368/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574962 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574937.251771:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574937.251773:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574937.251775:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361146368:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574937.251789:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361146496:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574937.251803:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574937.251819:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574937/real 1788574937]  req@ffff8dc005dc0a80 x1875453361146496/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574962 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574937.251838:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361146496/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574962 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574937.251846:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574937.251849:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574937.251853:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361146496:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574937.635017:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574937.635019:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574937.635019:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788574937.635049:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574937.635060:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574937.635067:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574938.274966:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574938.658946:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574938.658946:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574938.658946:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574938.658951:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574938.658976:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574938.659028:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574939.299019:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574939.683010:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574939.683010:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574939.683010:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574939.683061:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574939.683066:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788574939.683110:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574940.323000:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574940.706990:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574940.707000:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574940.707001:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574940.707021:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574940.707032:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574940.707034:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574941.347051:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574941.730966:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574941.730968:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574941.731011:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574941.731015:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574941.731034:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574941.731039:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00080000:3.0:1788574942.371008:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574942.371018:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:2.0:1788574942.371019:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788574942.371024:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574942.371038:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3288
00000100:00080000:3.0:1788574942.371048:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574942.371056:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788574942.371090:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c380 x1875453361146624/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574942.371114:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574942.371118:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574942.371120:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574942.371124:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3288
00000100:00080000:3.0:1788574942.371127:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574942.371131:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574942.371140:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574942.371152:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f480 x1875453361146752/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574942.371159:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361146624:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788574942.371174:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574942.371178:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574942.371180:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574942.371183:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3288
00000100:00080000:3.0:1788574942.371186:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574942.371189:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574942.371193:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574942.371214:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d180 x1875453361146880/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574942.371219:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574942.371221:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574942.371222:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574942.371225:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3288
00000100:00080000:3.0:1788574942.371227:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574942.371229:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574942.371232:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574942.371239:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e680 x1875453361147008/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1788574942.371243:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788574942.371250:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574942.371253:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574942.371254:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574942.371258:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3288
00000100:00080000:3.0:1788574942.371262:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574942.371266:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574942.371271:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574942.371289:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574942/real 1788574942]  req@ffff8dc00644c380 x1875453361146624/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574967 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574942.371294:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c700 x1875453361147136/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574942.371308:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453361146624/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574967 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574942.371308:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574942.371315:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574942.371318:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574942.371324:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574942.371325:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3288
00000100:00080000:3.0:1788574942.371330:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574942.371331:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788574942.371335:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574942.371336:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361146624:192.168.202.140@tcp:250:kworker.0
00000008:00100000:3.0:1788574942.371340:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574942.371350:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e300 x1875453361147264/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574942.371358:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574942.371362:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:0.0:1788574942.371363:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361146752:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788574942.371363:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574942.371369:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3288
00000100:00080000:3.0:1788574942.371373:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574942.371374:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574942.371377:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574942.371383:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644df80 x1875453361147392/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1788574942.371395:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574942.371407:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574942/real 1788574942]  req@ffff8dc00644f480 x1875453361146752/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574967 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574942.371424:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453361146752/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574967 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574942.371431:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574942.371433:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574942.371435:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361146752:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574942.371439:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361146880:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574942.371452:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574942.371458:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574942/real 1788574942]  req@ffff8dc00644d180 x1875453361146880/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574967 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574942.371465:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453361146880/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574967 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574942.371470:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574942.371471:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574942.371473:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361146880:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574942.371476:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361147008:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574942.371485:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574942.371490:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574942/real 1788574942]  req@ffff8dc00644e680 x1875453361147008/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574967 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574942.371501:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453361147008/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574967 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574942.371508:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574942.371511:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574942.371514:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361147008:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574942.371519:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361147136:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574942.371537:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574942.371546:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574942/real 1788574942]  req@ffff8dc00644c700 x1875453361147136/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574967 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574942.371553:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453361147136/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574967 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574942.371558:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574942.371560:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574942.371562:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361147136:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574942.371573:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361147264:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574942.371584:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574942.371590:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574942/real 1788574942]  req@ffff8dc00644e300 x1875453361147264/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574967 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574942.371596:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453361147264/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574967 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574942.371604:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574942.371606:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574942.371608:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361147264:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574942.371611:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361147392:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574942.371619:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574942.371624:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574942/real 1788574942]  req@ffff8dc00644df80 x1875453361147392/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574967 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574942.371630:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644df80 x1875453361147392/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574967 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574942.371634:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574942.371636:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574942.371637:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361147392:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574942.755001:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574942.755001:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574942.755001:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574942.755035:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574942.755050:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574942.755054:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574943.395039:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574943.778982:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574943.778985:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574943.778991:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574943.779014:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788574943.779029:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574943.779030:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574944.419012:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574944.802985:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574944.803005:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574944.803033:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574944.803046:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574944.803047:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574944.803049:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574945.443004:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574945.826953:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574945.826972:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574945.826991:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788574945.827007:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574945.827010:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574945.827016:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574946.467028:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574946.850993:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574946.851005:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574946.851006:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574946.851018:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574946.851042:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574946.851084:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574947.491082:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788574947.491150:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574947.491159:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788574947.491165:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574947.491179:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3293
00000100:00080000:2.0:1788574947.491192:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574947.491202:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574947.491245:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453361147520/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574947.491267:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574947.491271:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574947.491273:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574947.491279:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3293
00000100:00080000:2.0:1788574947.491284:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574947.491289:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574947.491300:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574947.491303:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361147520:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788574947.491314:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361147648/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574947.491328:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574947.491331:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574947.491333:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574947.491337:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3293
00000100:00080000:2.0:1788574947.491342:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574947.491345:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574947.491351:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574947.491362:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361147776/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574947.491368:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574947.491372:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000800:00000100:3.0:1788574947.491375:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788574947.491376:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574947.491381:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3293
00000100:00080000:2.0:1788574947.491384:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574947.491387:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574947.491391:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574947.491399:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453361147904/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574947.491406:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574947.491408:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788574947.491409:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574947.491412:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3293
00000100:00080000:2.0:1788574947.491415:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574947.491417:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574947.491419:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574947.491441:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361148032/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574947.491446:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574947.491449:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788574947.491450:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574947.491455:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3293
00000100:00080000:2.0:1788574947.491457:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574947.491460:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574947.491464:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574947.491470:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361148160/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574947.491477:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574947.491479:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788574947.491481:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574947.491484:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3293
00000100:00080000:2.0:1788574947.491486:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788574947.491490:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574947/real 1788574947]  req@ffff8dc020494a80 x1875453361147520/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574972 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574947.491491:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788574947.491500:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574947.491520:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453361148288/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788574947.491623:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453361147520/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574972 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574947.491665:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574947.491670:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574947.491675:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361147520:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788574947.491702:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361147648:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788574947.491727:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574947.491741:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574947/real 1788574947]  req@ffff8dc020495180 x1875453361147648/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574972 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574947.491751:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361147648/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574972 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574947.491758:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574947.491760:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574947.491763:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361147648:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574947.491768:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361147776:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574947.491781:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574947.491787:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574947/real 1788574947]  req@ffff8dc020495880 x1875453361147776/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574972 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574947.491795:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361147776/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574972 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574947.491800:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574947.491802:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574947.491804:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361147776:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574947.491807:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361147904:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574947.491819:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574947.491825:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574947/real 1788574947]  req@ffff8dc020497480 x1875453361147904/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574972 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574947.491832:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453361147904/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574972 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574947.491838:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574947.491840:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574947.491841:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361147904:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574947.491845:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361148032:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788574947.491856:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574947.491862:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574947/real 1788574947]  req@ffff8dc020495500 x1875453361148032/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574972 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574947.491892:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361148032/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574972 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574947.491899:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574947.491902:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574947.491909:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361148032:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574947.491916:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361148160:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574947.491931:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574947.491939:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574947/real 1788574947]  req@ffff8dc020494000 x1875453361148160/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574972 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574947.491946:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361148160/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574972 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574947.491951:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574947.491953:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574947.491956:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361148160:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574947.491959:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361148288:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574947.491969:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574947.491975:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574947/real 1788574947]  req@ffff8dc020494e00 x1875453361148288/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574972 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574947.491982:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453361148288/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574972 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574947.491988:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574947.491990:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574947.491992:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361148288:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574947.874965:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574947.874966:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788574947.875045:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574947.875123:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574947.875125:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574947.875136:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574948.515000:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574948.898976:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574948.898976:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574948.898976:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574948.899014:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574948.899015:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574948.899016:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574949.538992:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574949.922965:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574949.922965:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574949.922965:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574949.922998:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574949.923000:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788574949.923011:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574950.562971:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574950.946978:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574950.946978:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574950.946996:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574950.947006:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574950.947013:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574950.947017:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574951.587004:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574951.970974:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574951.970975:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788574951.971000:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574951.971009:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574951.971011:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574951.971027:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574952.610965:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788574952.610968:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574952.610976:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788574952.610980:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574952.610988:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3298
00000100:00080000:0.0:1788574952.610996:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574952.611002:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574952.611032:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361148416/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574952.611053:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574952.611056:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574952.611057:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574952.611060:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3298
00000100:00080000:0.0:1788574952.611062:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574952.611064:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574952.611072:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574952.611081:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361148544/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574952.611088:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574952.611090:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574952.611092:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574952.611094:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3298
00000100:00080000:0.0:1788574952.611096:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574952.611098:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574952.611102:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574952.611110:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361148672/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788574952.611112:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361148416:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788574952.611120:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574952.611123:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574952.611124:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574952.611127:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3298
00000100:00080000:0.0:1788574952.611129:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574952.611131:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574952.611134:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574952.611141:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361148800/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574952.611147:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574952.611149:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574952.611151:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574952.611153:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3298
00000100:00080000:0.0:1788574952.611156:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574952.611159:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574952.611162:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574952.611168:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361148928/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574952.611174:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574952.611176:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574952.611178:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574952.611180:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3298
00000100:00080000:0.0:1788574952.611183:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574952.611185:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574952.611188:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574952.611196:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361149056/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574952.611202:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574952.611206:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574952.611208:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574952.611214:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3298
00000100:00080000:0.0:1788574952.611218:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788574952.611222:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361148544:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788574952.611226:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574952.611235:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574952.611250:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361149184/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788574952.611273:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361148672:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574952.611302:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361148800:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574952.611328:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361148928:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574952.611354:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361149056:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574952.611376:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361149184:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574952.994997:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574952.994997:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574952.994997:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574952.995034:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574952.995035:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574952.995049:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574953.634961:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574954.018977:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574954.018989:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574954.019000:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574954.019019:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574954.019024:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788574954.019081:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574954.659042:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574955.042994:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574955.042994:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574955.043001:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574955.043027:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574955.043034:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574955.043044:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574955.682975:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000400:00000100:1.0:1788574955.683153:0:2335:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.140:988
00000400:00000100:1.0:1788574955.683193:0:2335:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.140@tcp at host 192.168.202.140 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:1.0:1788574955.683218:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788574955.683260:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788574955.683271:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788574955.683281:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788574955.683292:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788574955.683303:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788574955.683314:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:3.0:1788574955.683314:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574952/real 1788574955]  req@ffff8dc006711880 x1875453361148672/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574977 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574955.683343:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361148672/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574977 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574955.683357:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574955.683363:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574955.683368:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361148672:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574955.683376:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574952/real 1788574955]  req@ffff8dc006712a00 x1875453361148800/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574977 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574955.683389:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361148800/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574977 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574955.683398:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574955.683401:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574955.683405:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361148800:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574955.683412:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574952/real 1788574955]  req@ffff8dc006710e00 x1875453361148928/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574977 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574955.683425:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361148928/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574977 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574955.683434:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574955.683437:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574955.683440:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361148928:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574955.683447:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574952/real 1788574955]  req@ffff8dc006713100 x1875453361149056/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574977 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574955.683458:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361149056/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574977 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574955.683465:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574955.683469:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574955.683471:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361149056:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574955.683477:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574952/real 1788574955]  req@ffff8dc006713b80 x1875453361149184/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574977 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574955.683488:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361149184/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574977 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574955.683494:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574955.683498:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574955.683500:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361149184:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574955.683506:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574952/real 1788574955]  req@ffff8dc006713800 x1875453361148416/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574977 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574955.683517:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361148416/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574977 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574955.683525:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574955.683528:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574955.683531:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361148416:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788574955.683538:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574952/real 1788574955]  req@ffff8dc006711c00 x1875453361148544/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574977 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574955.683549:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361148544/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574977 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574955.683566:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574955.683570:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574955.683574:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361148544:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574956.066959:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574956.066968:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574956.067045:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574956.067069:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574956.067069:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788574956.067126:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574956.706975:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574957.090968:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574957.090968:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574957.090968:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574957.090969:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574957.091003:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574957.091031:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574957.730982:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788574957.731003:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574957.731012:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788574957.731020:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574957.731031:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3303
00000100:00080000:3.0:1788574957.731042:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574957.731050:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788574957.731094:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f100 x1875453361149312/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574957.731133:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574957.731137:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574957.731140:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574957.731145:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3303
00000100:00080000:3.0:1788574957.731149:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574957.731154:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574957.731166:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574957.731180:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d880 x1875453361149440/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574957.731190:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361149312:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788574957.731194:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574957.731197:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574957.731200:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574957.731205:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3303
00000100:00080000:3.0:1788574957.731211:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574957.731215:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574957.731221:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574957.731235:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644fb80 x1875453361149568/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574957.731246:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574957.731249:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574957.731251:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574957.731255:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3303
00000100:00080000:3.0:1788574957.731259:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574957.731263:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574957.731269:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574957.731280:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ed80 x1875453361149696/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574957.731289:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1788574957.731295:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788574957.731295:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574957.731300:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574957.731305:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3303
00000100:00080000:3.0:1788574957.731311:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574957.731316:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574957.731322:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574957.731347:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644df80 x1875453361149824/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574957.731357:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574957/real 1788574957]  req@ffff8dc00644f100 x1875453361149312/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574982 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574957.731357:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574957.731364:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574957.731368:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574957.731377:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3303
00000100:00080000:3.0:1788574957.731382:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574957.731387:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574957.731391:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f100 x1875453361149312/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574982 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1788574957.731394:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1788574957.731410:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1788574957.731412:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e300 x1875453361149952/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574957.731417:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574957.731422:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361149312:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788574957.731439:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574957.731443:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574957.731445:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574957.731450:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3303
00000100:00080000:3.0:1788574957.731454:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788574957.731455:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361149440:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788574957.731463:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574957.731469:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574957.731483:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c700 x1875453361150080/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1788574957.731485:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574957.731503:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574957/real 1788574957]  req@ffff8dc00644d880 x1875453361149440/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574982 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574957.731524:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d880 x1875453361149440/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574982 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574957.731535:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574957.731539:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574957.731542:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361149440:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574957.731548:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361149568:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574957.731569:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574957.731581:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574957/real 1788574957]  req@ffff8dc00644fb80 x1875453361149568/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574982 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574957.731593:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644fb80 x1875453361149568/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574982 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574957.731602:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574957.731605:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574957.731608:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361149568:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574957.731614:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361149696:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574957.731635:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574957.731650:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574957/real 1788574957]  req@ffff8dc00644ed80 x1875453361149696/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574982 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574957.731660:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ed80 x1875453361149696/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574982 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574957.731673:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574957.731676:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574957.731679:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361149696:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574957.731684:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361149824:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574957.731703:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574957.731714:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574957/real 1788574957]  req@ffff8dc00644df80 x1875453361149824/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574982 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574957.731726:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644df80 x1875453361149824/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574982 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574957.731737:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574957.731740:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574957.731742:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361149824:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574957.731748:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361149952:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574957.731767:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574957.731777:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574957/real 1788574957]  req@ffff8dc00644e300 x1875453361149952/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574982 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574957.731786:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453361149952/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574982 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574957.731793:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574957.731796:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574957.731800:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361149952:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574957.731819:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361150080:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574957.731837:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574957.731847:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574957/real 1788574957]  req@ffff8dc00644c700 x1875453361150080/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574982 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574957.731861:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453361150080/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574982 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574957.731907:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574957.731911:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574957.731914:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361150080:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574958.114988:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574958.114994:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574958.114995:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574958.115004:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574958.115022:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788574958.115088:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574958.755053:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574959.139009:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574959.139018:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574959.139019:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574959.139023:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574959.139061:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574959.139100:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574959.778945:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574960.162995:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574960.162995:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574960.163032:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574960.163044:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574960.163049:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574960.163060:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574960.802988:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574961.187002:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574961.187029:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574961.187063:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574961.187069:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574961.187079:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574961.187081:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574961.827344:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574962.210979:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574962.210980:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574962.211011:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574962.211035:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574962.211037:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574962.211043:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00080000:3.0:1788574962.850979:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788574962.850982:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788574962.850993:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788574962.850997:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574962.851005:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3308
00000100:00080000:3.0:1788574962.851015:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574962.851021:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788574962.851053:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e680 x1875453361150208/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574962.851073:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574962.851076:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574962.851077:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574962.851080:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3308
00000100:00080000:3.0:1788574962.851082:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574962.851084:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574962.851107:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574962.851118:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d180 x1875453361150336/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574962.851126:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361150208:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788574962.851129:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574962.851132:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574962.851134:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574962.851140:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3308
00000100:00080000:3.0:1788574962.851145:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574962.851148:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574962.851152:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574962.851162:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f480 x1875453361150464/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574962.851169:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574962.851172:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574962.851173:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574962.851175:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3308
00000100:00080000:3.0:1788574962.851178:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574962.851180:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574962.851183:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574962.851189:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c380 x1875453361150592/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574962.851195:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574962.851198:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574962.851199:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574962.851203:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3308
00000100:00080000:3.0:1788574962.851208:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574962.851213:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:0.0:1788574962.851220:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:3.0:1788574962.851221:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574962.851249:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d500 x1875453361150720/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574962.851261:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788574962.851262:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574962/real 1788574962]  req@ffff8dc00644e680 x1875453361150208/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574987 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574962.851267:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574962.851270:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574962.851280:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3308
00000100:00080000:3.0:1788574962.851285:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574962.851291:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574962.851300:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574962.851314:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ea00 x1875453361150848/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574962.851319:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453361150208/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574987 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574962.851336:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574962.851339:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574962.851342:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574962.851346:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788574962.851347:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788574962.851352:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361150208:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788574962.851353:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3308
00000100:00080000:3.0:1788574962.851361:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574962.851365:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574962.851369:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574962.851378:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ca80 x1875453361150976/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574962.851387:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361150336:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574962.851411:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574962.851421:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574962/real 1788574962]  req@ffff8dc00644d180 x1875453361150336/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574987 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574962.851430:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453361150336/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574987 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574962.851443:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574962.851445:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574962.851448:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361150336:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574962.851452:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361150464:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574962.851465:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574962.851473:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574962/real 1788574962]  req@ffff8dc00644f480 x1875453361150464/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574987 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574962.851480:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453361150464/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574987 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574962.851490:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574962.851493:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574962.851495:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361150464:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574962.851499:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361150592:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574962.851509:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574962.851514:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574962/real 1788574962]  req@ffff8dc00644c380 x1875453361150592/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574987 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574962.851521:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453361150592/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574987 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574962.851527:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574962.851529:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574962.851531:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361150592:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574962.851535:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361150720:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574962.851545:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574962.851551:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574962/real 1788574962]  req@ffff8dc00644d500 x1875453361150720/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574987 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574962.851558:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d500 x1875453361150720/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574987 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574962.851563:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574962.851565:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574962.851567:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361150720:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574962.851571:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361150848:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574962.851580:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574962.851586:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574962/real 1788574962]  req@ffff8dc00644ea00 x1875453361150848/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574987 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574962.851593:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ea00 x1875453361150848/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574987 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574962.851598:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574962.851600:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574962.851601:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361150848:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574962.851613:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361150976:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574962.851623:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574962.851629:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574962/real 1788574962]  req@ffff8dc00644ca80 x1875453361150976/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574987 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574962.851635:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ca80 x1875453361150976/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574987 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574962.851640:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574962.851642:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574962.851644:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361150976:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574963.234934:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574963.234948:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574963.234961:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574963.234973:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574963.234977:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574963.234982:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574963.874971:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574964.258973:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574964.258973:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574964.258979:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574964.259010:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574964.259011:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574964.259030:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574964.899011:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574965.282940:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574965.282944:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574965.282966:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574965.282987:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574965.282997:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574965.283002:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574965.922976:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574966.306992:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574966.306996:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574966.307030:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574966.307048:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574966.307074:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574966.307110:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574966.946990:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574967.330984:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574967.330985:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574967.330985:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574967.331007:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574967.331017:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574967.331029:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574967.971003:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788574967.971018:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574967.971027:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788574967.971033:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574967.971043:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3313
00000100:00080000:3.0:1788574967.971055:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574967.971064:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788574967.971105:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644dc00 x1875453361151104/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574967.971129:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574967.971132:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574967.971133:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574967.971136:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3313
00000100:00080000:3.0:1788574967.971139:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574967.971142:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574967.971152:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574967.971164:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c000 x1875453361151232/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574967.971167:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361151104:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788574967.971189:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574967.971192:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574967.971194:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574967.971198:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3313
00000100:00080000:3.0:1788574967.971201:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574967.971204:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574967.971207:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574967.971219:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f800 x1875453361151360/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574967.971225:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574967.971227:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574967.971237:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1788574967.971242:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788574967.971244:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3313
00000100:00080000:3.0:1788574967.971252:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574967.971258:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574967.971263:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574967.971280:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ce00 x1875453361151488/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574967.971286:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574967/real 1788574967]  req@ffff8dc00644dc00 x1875453361151104/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574992 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574967.971326:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574967.971329:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574967.971331:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574967.971345:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3313
00000100:00080000:3.0:1788574967.971351:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574967.971356:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574967.971365:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644dc00 x1875453361151104/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574992 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1788574967.971367:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1788574967.971388:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1788574967.971389:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ca80 x1875453361151616/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574967.971403:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788574967.971410:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788574967.971414:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361151104:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788574967.971416:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574967.971421:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574967.971430:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3313
00000100:00080000:3.0:1788574967.971433:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574967.971438:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574967.971442:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574967.971451:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361151232:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574967.971459:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ea00 x1875453361151744/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574967.971481:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574967.971484:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574967.971486:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574967.971490:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3313
00000800:00000100:0.0:1788574967.971498:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788574967.971503:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574967.971508:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574967.971512:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574967.971526:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574967/real 1788574967]  req@ffff8dc00644c000 x1875453361151232/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574992 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574967.971526:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d500 x1875453361151872/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574967.971560:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c000 x1875453361151232/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574992 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574967.971572:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574967.971576:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574967.971580:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361151232:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574967.971592:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361151360:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574967.971611:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574967.971620:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574967/real 1788574967]  req@ffff8dc00644f800 x1875453361151360/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574992 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574967.971628:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f800 x1875453361151360/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574992 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574967.971634:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574967.971636:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574967.971638:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361151360:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574967.971642:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361151488:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574967.971657:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574967.971668:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574967/real 1788574967]  req@ffff8dc00644ce00 x1875453361151488/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574992 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574967.971680:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ce00 x1875453361151488/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574992 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574967.971689:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574967.971693:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574967.971696:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361151488:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574967.971703:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361151616:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574967.971727:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574967.971739:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574967/real 1788574967]  req@ffff8dc00644ca80 x1875453361151616/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574992 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574967.971752:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ca80 x1875453361151616/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574992 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574967.971760:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574967.971763:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574967.971765:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361151616:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574967.971780:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361151744:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574967.971796:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574967.971807:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574967/real 1788574967]  req@ffff8dc00644ea00 x1875453361151744/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574992 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574967.971819:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ea00 x1875453361151744/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574992 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574967.971827:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574967.971831:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574967.971834:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361151744:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574967.971841:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361151872:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574967.971899:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574967.971908:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574967/real 1788574967]  req@ffff8dc00644d500 x1875453361151872/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574992 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574967.971916:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d500 x1875453361151872/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574992 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574967.971930:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574967.971934:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574967.971937:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361151872:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574968.355020:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574968.355031:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574968.355048:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574968.355067:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574968.355068:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574968.355093:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574968.994964:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574969.378974:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574969.378983:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574969.378983:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574969.379004:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574969.379009:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574969.379017:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574970.018945:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574970.402983:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574970.402983:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574970.402994:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574970.403014:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574970.403027:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788574970.403042:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574971.042976:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574971.426985:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574971.426985:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574971.426985:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574971.427018:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574971.427021:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574971.427040:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574972.066980:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574972.450980:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574972.450981:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574972.450981:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574972.451011:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574972.451017:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788574972.451054:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1788574973.090972:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788574973.090973:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788574973.090983:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788574973.090987:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574973.090998:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3318
00000100:00080000:3.0:1788574973.091008:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574973.091016:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788574973.091053:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c380 x1875453361152000/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574973.091075:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574973.091078:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574973.091080:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574973.091090:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3318
00000100:00080000:3.0:1788574973.091099:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574973.091104:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574973.091114:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574973.091127:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361152000:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788574973.091132:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f480 x1875453361152128/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574973.091146:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574973.091150:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574973.091152:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574973.091156:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3318
00000100:00080000:3.0:1788574973.091160:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574973.091165:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574973.091171:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788574973.091185:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574973.091194:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d180 x1875453361152256/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574973.091207:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574973.091211:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574973.091213:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574973.091217:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3318
00000100:00080000:3.0:1788574973.091222:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574973.091227:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574973.091233:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574973.091235:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574973/real 1788574973]  req@ffff8dc00644c380 x1875453361152000/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574998 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574973.091250:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e680 x1875453361152384/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574973.091266:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788574973.091267:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453361152000/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788574998 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574973.091275:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574973.091286:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574973.091288:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574973.091292:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788574973.091302:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3318
00000100:00100000:0.0:1788574973.091303:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361152000:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788574973.091309:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574973.091317:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574973.091323:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574973.091332:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361152128:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574973.091337:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c700 x1875453361152512/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574973.091346:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574973.091349:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574973.091350:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574973.091354:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3318
00000100:00080000:3.0:1788574973.091357:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574973.091360:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574973.091363:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788574973.091368:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574973.091374:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e300 x1875453361152640/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574973.091380:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574973.091385:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574973.091387:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574973.091390:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3318
00000100:00080000:3.0:1788574973.091394:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574973.091396:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574973.091400:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574973.091404:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574973/real 1788574973]  req@ffff8dc00644f480 x1875453361152128/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574998 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574973.091413:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644df80 x1875453361152768/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788574973.091426:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453361152128/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574998 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574973.091439:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574973.091444:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574973.091448:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361152128:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574973.091457:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361152256:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574973.091481:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574973.091494:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574973/real 1788574973]  req@ffff8dc00644d180 x1875453361152256/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574998 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574973.091507:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453361152256/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574998 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574973.091516:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574973.091520:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574973.091523:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361152256:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574973.091530:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361152384:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574973.091567:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574973.091588:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574973/real 1788574973]  req@ffff8dc00644e680 x1875453361152384/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574998 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574973.091602:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453361152384/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574998 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574973.091612:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574973.091616:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574973.091619:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361152384:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574973.091635:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361152512:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788574973.091651:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574973.091659:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574973/real 1788574973]  req@ffff8dc00644c700 x1875453361152512/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574998 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574973.091667:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453361152512/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788574998 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574973.091673:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574973.091675:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574973.091677:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361152512:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574973.091681:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361152640:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574973.091691:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574973.091697:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574973/real 1788574973]  req@ffff8dc00644e300 x1875453361152640/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574998 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574973.091704:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453361152640/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574998 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574973.091709:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574973.091711:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574973.091714:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361152640:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574973.091720:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361152768:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788574973.091738:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574973.091749:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574973/real 1788574973]  req@ffff8dc00644df80 x1875453361152768/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574998 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574973.091762:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644df80 x1875453361152768/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788574998 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574973.091771:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574973.091773:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574973.091776:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361152768:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574973.474966:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574973.474968:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574973.474971:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574973.474999:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574973.475001:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574973.475010:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574974.114972:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574974.499035:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574974.499035:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574974.499189:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574974.499248:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574974.499267:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788574974.499340:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574975.138933:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574975.522958:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574975.522962:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574975.522995:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574975.523023:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574975.523052:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788574975.523068:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574976.162935:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574976.546964:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574976.546965:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574976.546970:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574976.546997:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574976.546998:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574976.547000:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574977.186948:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574977.570933:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574977.570939:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574977.570951:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574977.570978:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574977.570982:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788574977.571025:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1788574978.210970:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788574978.210970:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574978.210979:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788574978.210983:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574978.210991:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3323
00000100:00080000:0.0:1788574978.211000:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574978.211006:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574978.211039:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453361152896/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574978.211061:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574978.211064:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574978.211065:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574978.211068:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3323
00000100:00080000:0.0:1788574978.211071:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574978.211074:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574978.211082:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574978.211092:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361152896:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788574978.211093:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361153024/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574978.211106:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574978.211108:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574978.211110:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574978.211112:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3323
00000100:00080000:0.0:1788574978.211115:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574978.211117:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574978.211120:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574978.211127:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361153152/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574978.211133:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574978.211135:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574978.211136:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574978.211139:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3323
00000100:00080000:0.0:1788574978.211141:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574978.211144:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574978.211147:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574978.211153:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361153280/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574978.211160:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574978.211162:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574978.211163:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574978.211166:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3323
00000100:00080000:0.0:1788574978.211168:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1788574978.211172:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788574978.211173:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574978.211179:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574978.211187:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361153408/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574978.211194:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574978.211197:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574978.211198:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574978.211209:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3323
00000100:00080000:0.0:1788574978.211213:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788574978.211216:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574978/real 1788574978]  req@ffff8dc006710380 x1875453361152896/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575003 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574978.211224:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574978.211232:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574978.211235:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453361152896/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575003 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574978.211247:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1788574978.211251:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361153536/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574978.211254:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574978.211264:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361152896:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788574978.211269:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574978.211273:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574978.211274:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574978.211278:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3323
00000100:00080000:0.0:1788574978.211281:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574978.211284:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574978.211288:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574978.211292:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361153024:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574978.211299:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361153664/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788574978.211318:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574978.211330:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574978/real 1788574978]  req@ffff8dc006712680 x1875453361153024/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575003 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574978.211338:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361153024/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575003 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574978.211346:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574978.211348:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574978.211350:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361153024:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574978.211355:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361153152:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574978.211367:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574978.211381:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574978/real 1788574978]  req@ffff8dc006713480 x1875453361153152/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575003 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574978.211389:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361153152/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575003 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574978.211395:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574978.211397:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574978.211399:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361153152:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574978.211403:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361153280:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574978.211414:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574978.211420:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574978/real 1788574978]  req@ffff8dc006711500 x1875453361153280/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575003 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574978.211427:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361153280/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575003 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574978.211439:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574978.211441:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574978.211443:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361153280:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574978.211447:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361153408:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788574978.211459:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574978.211466:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574978/real 1788574978]  req@ffff8dc006712300 x1875453361153408/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575003 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574978.211473:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361153408/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575003 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574978.211479:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574978.211481:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574978.211483:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361153408:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574978.211486:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361153536:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574978.211496:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574978.211501:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574978/real 1788574978]  req@ffff8dc006711c00 x1875453361153536/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575003 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574978.211508:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361153536/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575003 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574978.211517:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574978.211520:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574978.211523:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361153536:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788574978.211542:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361153664:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788574978.211563:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574978.211572:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574978/real 1788574978]  req@ffff8dc006713800 x1875453361153664/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575003 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574978.211580:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361153664/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575003 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788574978.211586:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574978.211589:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788574978.211592:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361153664:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574978.595006:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574978.595008:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574978.595008:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788574978.595072:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574978.595093:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574978.595105:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574979.235002:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574979.619021:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574979.619023:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574979.619025:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574979.619063:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788574979.619075:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574979.619091:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574980.258976:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574980.642962:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574980.642962:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574980.642963:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574980.642998:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574980.643023:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574980.643049:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574981.282964:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574981.667001:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574981.667023:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574981.667028:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574981.667058:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574981.667059:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788574981.667077:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574982.307043:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574982.691024:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574982.691024:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574982.691026:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574982.691031:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574982.691074:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574982.691140:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1788574983.331070:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788574983.331078:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788574983.331087:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788574983.331094:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574983.331109:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3328
00000100:00080000:1.0:1788574983.331125:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574983.331136:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788574983.331186:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361153792/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574983.331224:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574983.331228:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574983.331231:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574983.331237:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3328
00000100:00080000:1.0:1788574983.331246:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574983.331253:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574983.331271:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574983.331283:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361153792:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788574983.331295:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361153920/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574983.331312:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574983.331317:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574983.331320:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574983.331338:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3328
00000100:00080000:1.0:1788574983.331345:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574983.331351:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574983.331359:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788574983.331372:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788574983.331379:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361154048/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574983.331392:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574983.331397:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574983.331400:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574983.331406:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3328
00000100:00080000:1.0:1788574983.331412:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574983.331418:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574983.331425:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574983.331430:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574983/real 1788574983]  req@ffff8dc005dc1500 x1875453361153792/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575008 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574983.331447:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361154176/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574983.331462:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788574983.331462:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361153792/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575008 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574983.331475:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788574983.331482:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574983.331495:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574983.331496:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3328
00000100:00080000:1.0:1788574983.331506:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574983.331513:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788574983.331521:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574983.331526:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361153792:192.168.202.140@tcp:250:kworker.0
00000008:00100000:1.0:1788574983.331540:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574983.331562:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361153920:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788574983.331563:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361154304/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788574983.331589:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788574983.331595:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788574983.331598:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788574983.331606:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3328
00000800:00000100:2.0:1788574983.331609:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788574983.331617:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788574983.331625:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574983.331633:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574983.331635:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574983/real 1788574983]  req@ffff8dc005dc0a80 x1875453361153920/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575008 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788574983.331657:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361154432/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574983.331660:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361153920/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575008 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788574983.331714:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574983.331717:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788574983.331720:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788574983.331725:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788574983.331728:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788574983.331735:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3328
00000100:00100000:2.0:1788574983.331740:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361153920:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788574983.331745:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1788574983.331756:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361154048:192.168.202.140@tcp:8:kworker.0
00000100:00080000:1.0:1788574983.331757:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788574983.331770:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788574983.331795:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361154560/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788574983.331809:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574983.331847:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574983/real 1788574983]  req@ffff8dc005dc1180 x1875453361154048/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575008 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574983.331902:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361154048/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575008 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574983.331919:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574983.331924:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574983.331931:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361154048:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574983.331940:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361154176:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574983.331963:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574983.331993:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574983/real 1788574983]  req@ffff8dc005dc2d80 x1875453361154176/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575008 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574983.332008:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361154176/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575008 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574983.332017:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574983.332021:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574983.332024:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361154176:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574983.332042:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361154304:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574983.332063:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574983.332075:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574983/real 1788574983]  req@ffff8dc005dc3b80 x1875453361154304/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575008 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574983.332086:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361154304/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575008 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574983.332094:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574983.332097:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574983.332100:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361154304:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574983.332106:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361154432:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574983.332126:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574983.332137:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574983/real 1788574983]  req@ffff8dc005dc0700 x1875453361154432/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575008 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574983.332149:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361154432/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575008 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574983.332159:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574983.332162:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574983.332166:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361154432:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574983.332173:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361154560:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574983.332194:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574983.332204:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574983/real 1788574983]  req@ffff8dc005dc3800 x1875453361154560/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575008 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574983.332212:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361154560/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575008 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574983.332218:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574983.332220:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574983.332222:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361154560:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574983.715033:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574983.715033:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574983.715046:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788574983.715089:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574983.715091:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574983.715094:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574984.354979:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574984.738978:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574984.738978:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574984.738979:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574984.738990:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574984.739030:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574984.739070:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574985.378993:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574985.762980:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574985.762981:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574985.762981:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788574985.763013:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788574985.763017:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574985.763024:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574986.403031:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574986.786949:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574986.786955:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574986.786955:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574986.786980:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574986.786986:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788574986.787018:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574987.426979:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574987.810978:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574987.810978:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574987.811081:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574987.811091:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788574987.811156:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574987.811163:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574988.450999:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788574988.451000:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574988.451008:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788574988.451012:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574988.451021:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3334
00000100:00080000:0.0:1788574988.451031:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574988.451040:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574988.451079:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361154688/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574988.451108:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574988.451113:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574988.451114:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574988.451119:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3334
00000100:00080000:0.0:1788574988.451123:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574988.451126:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574988.451135:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574988.451148:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361154688:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788574988.451149:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361154816/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574988.451163:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574988.451165:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574988.451167:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574988.451170:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3334
00000100:00080000:0.0:1788574988.451172:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574988.451175:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574988.451178:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574988.451186:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361154944/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574988.451197:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574988.451214:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574988.451216:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574988.451219:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3334
00000100:00080000:0.0:1788574988.451222:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574988.451225:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574988.451229:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788574988.451242:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361155072/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788574988.451247:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788574988.451257:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574988.451262:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574988.451264:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574988.451268:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3334
00000100:00080000:0.0:1788574988.451275:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574988.451279:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574988.451285:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574988.451298:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574988/real 1788574988]  req@ffff8dc006713b80 x1875453361154688/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575013 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574988.451300:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361155200/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574988.451334:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574988.451339:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574988.451341:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788574988.451344:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361154688/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575013 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574988.451349:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3334
00000100:00080000:0.0:1788574988.451355:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574988.451362:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:2.0:1788574988.451366:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1788574988.451367:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1788574988.451376:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574988.451383:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361155328/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574988.451385:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361154688:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788574988.451400:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574988.451403:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574988.451404:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574988.451408:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3334
00000100:00080000:0.0:1788574988.451410:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574988.451412:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574988.451416:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574988.451420:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361154816:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788574988.451425:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361155456/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788574988.451451:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574988.451463:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574988/real 1788574988]  req@ffff8dc006713100 x1875453361154816/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575013 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574988.451472:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361154816/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575013 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574988.451479:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574988.451482:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574988.451485:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361154816:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574988.451489:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361154944:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574988.451502:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574988.451509:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574988/real 1788574988]  req@ffff8dc006710e00 x1875453361154944/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575013 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574988.451528:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361154944/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575013 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574988.451537:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574988.451540:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574988.451543:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361154944:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574988.451550:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361155072:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574988.451579:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574988.451587:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574988/real 1788574988]  req@ffff8dc006712a00 x1875453361155072/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575013 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574988.451595:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361155072/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575013 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574988.451602:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574988.451605:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574988.451609:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361155072:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574988.451614:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361155200:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574988.451635:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574988.451647:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574988/real 1788574988]  req@ffff8dc006711880 x1875453361155200/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575013 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574988.451659:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361155200/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575013 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574988.451669:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574988.451671:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574988.451674:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361155200:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574988.451678:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361155328:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574988.451693:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574988.451701:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574988/real 1788574988]  req@ffff8dc006713800 x1875453361155328/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575013 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574988.451713:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361155328/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575013 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574988.451721:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574988.451724:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574988.451727:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361155328:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574988.451747:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361155456:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574988.451769:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574988.451779:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574988/real 1788574988]  req@ffff8dc006711c00 x1875453361155456/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575013 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574988.451787:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361155456/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575013 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574988.451793:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574988.451795:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574988.451797:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361155456:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788574988.834980:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574988.834980:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574988.834980:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574988.835008:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574988.835029:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574988.835057:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574989.474942:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574989.859018:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574989.859018:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574989.859027:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574989.859061:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574989.859073:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574989.859082:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574990.499017:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574990.882984:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574990.882984:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574990.882994:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574990.883023:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574990.883024:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574990.883027:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574991.523046:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574991.907053:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574991.907060:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574991.907062:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788574991.907098:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574991.907120:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574991.907127:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574992.546964:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574992.931020:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788574992.931021:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574992.931024:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574992.931024:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574992.931084:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574992.931137:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574993.570994:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788574993.571028:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574993.571039:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788574993.571045:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574993.571058:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3339
00000100:00080000:0.0:1788574993.571072:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574993.571082:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788574993.571133:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361155584/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574993.571166:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574993.571171:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574993.571173:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574993.571178:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3339
00000100:00080000:0.0:1788574993.571184:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574993.571189:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574993.571202:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574993.571203:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361155584:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788574993.571228:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361155712/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574993.571243:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574993.571247:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574993.571249:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574993.571254:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3339
00000100:00080000:0.0:1788574993.571258:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574993.571264:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574993.571272:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788574993.571288:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788574993.571293:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361155840/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788574993.571308:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574993.571312:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788574993.571316:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574993.571321:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3339
00000100:00080000:0.0:1788574993.571326:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574993.571332:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788574993.571338:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574993.571338:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574993/real 1788574993]  req@ffff8dc006712300 x1875453361155584/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575018 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574993.571361:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361155968/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574993.571369:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361155584/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575018 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788574993.571379:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574993.571391:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788574993.571396:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574993.571408:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3339
00000100:00080000:0.0:1788574993.571414:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788574993.571415:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788574993.571438:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:2.0:1788574993.571440:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000008:00100000:0.0:1788574993.571451:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574993.571453:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361155584:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788574993.571477:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453361156096/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574993.571487:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361155712:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788574993.571495:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574993.571501:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788574993.571504:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574993.571512:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3339
00000800:00000100:2.0:1788574993.571520:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788574993.571525:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788574993.571534:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574993.571537:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574993/real 1788574993]  req@ffff8dc006711500 x1875453361155712/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575018 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1788574993.571545:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574993.571566:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361155712/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575018 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788574993.571574:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361156224/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574993.571580:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574993.571593:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574993.571605:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361155712:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788574993.571608:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788574993.571615:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:2.0:1788574993.571615:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361155840:192.168.202.140@tcp:8:kworker.0
00000100:00080000:0.0:1788574993.571623:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788574993.571633:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3339
00000100:00080000:0.0:1788574993.571638:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1788574993.571641:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788574993.571651:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574993.571655:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574993/real 1788574993]  req@ffff8dc006713480 x1875453361155840/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575018 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1788574993.571669:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574993.571673:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361155840/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575018 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574993.571684:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574993.571688:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788574993.571694:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361156352/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574993.571695:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361155840:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574993.571712:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361155968:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574993.571745:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574993.571754:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574993/real 1788574993]  req@ffff8dc006712680 x1875453361155968/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575018 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574993.571762:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361155968/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575018 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574993.571773:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574993.571776:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574993.571778:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361155968:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574993.571789:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361156096:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574993.571800:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574993.571806:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574993/real 1788574993]  req@ffff8dc006710380 x1875453361156096/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575018 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574993.571813:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453361156096/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575018 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574993.571819:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574993.571821:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574993.571823:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361156096:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574993.571827:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361156224:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574993.571838:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574993.571844:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574993/real 1788574993]  req@ffff8dc006712300 x1875453361156224/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575018 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574993.571851:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361156224/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575018 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574993.571856:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574993.571858:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574993.571861:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361156224:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574993.571883:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361156352:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574993.571896:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574993.571903:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574993/real 1788574993]  req@ffff8dc006711c00 x1875453361156352/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575018 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574993.571910:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361156352/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575018 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574993.571916:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574993.571918:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574993.571921:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361156352:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574993.954962:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574993.954963:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788574993.954964:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788574993.954968:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574993.954993:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574993.955030:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574994.594932:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574994.978939:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574994.978951:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788574994.978952:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574994.978957:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574994.978982:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574994.979022:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574995.618975:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574996.002972:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788574996.002980:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574996.002988:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788574996.003009:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788574996.003011:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574996.003015:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788574996.642948:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574997.026938:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788574997.026949:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574997.026969:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788574997.026983:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788574997.027003:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788574997.027004:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788574997.667010:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574998.050979:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788574998.050979:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574998.050979:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788574998.050979:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574998.051010:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788574998.051045:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1788574998.690976:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574998.690987:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:0.0:1788574998.690989:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788574998.690993:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574998.691015:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3344
00000100:00080000:3.0:1788574998.691025:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574998.691031:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788574998.691067:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ed80 x1875453361156480/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574998.691095:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574998.691099:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574998.691100:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574998.691103:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3344
00000100:00080000:3.0:1788574998.691106:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574998.691109:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574998.691121:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574998.691133:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644fb80 x1875453361156608/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574998.691141:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574998.691144:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574998.691145:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574998.691151:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3344
00000100:00100000:2.0:1788574998.691153:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361156480:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788574998.691154:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574998.691161:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574998.691165:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788574998.691173:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d880 x1875453361156736/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574998.691180:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574998.691183:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574998.691185:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574998.691187:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3344
00000100:00080000:3.0:1788574998.691197:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574998.691200:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574998.691208:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788574998.691210:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574998.691219:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f100 x1875453361156864/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574998.691228:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574998.691232:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788574998.691234:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574998.691238:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3344
00000100:00080000:3.0:1788574998.691243:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574998.691249:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788574998.691250:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574998/real 1788574998]  req@ffff8dc00644ed80 x1875453361156480/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575023 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1788574998.691259:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574998.691281:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ed80 x1875453361156480/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575023 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788574998.691287:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644df80 x1875453361156992/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788574998.691296:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788574998.691301:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788574998.691304:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788574998.691306:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788574998.691310:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788574998.691315:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361156480:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788574998.691316:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3344
00000100:00080000:3.0:1788574998.691321:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574998.691326:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574998.691331:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788574998.691341:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361156608:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788574998.691342:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e300 x1875453361157120/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788574998.691355:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788574998.691358:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788574998.691359:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788574998.691361:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3344
00000100:00080000:3.0:1788574998.691365:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788574998.691368:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788574998.691372:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788574998.691376:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788574998.691382:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c700 x1875453361157248/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788574998.691390:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574998/real 1788574998]  req@ffff8dc00644fb80 x1875453361156608/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575023 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574998.691402:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644fb80 x1875453361156608/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575023 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574998.691410:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574998.691413:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574998.691415:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361156608:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574998.691433:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361156736:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574998.691445:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574998.691452:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574998/real 1788574998]  req@ffff8dc00644d880 x1875453361156736/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575023 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574998.691460:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d880 x1875453361156736/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575023 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574998.691470:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574998.691472:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574998.691474:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361156736:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574998.691477:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361156864:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574998.691492:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574998.691502:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574998/real 1788574998]  req@ffff8dc00644f100 x1875453361156864/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575023 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574998.691514:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f100 x1875453361156864/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575023 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574998.691524:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574998.691527:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574998.691531:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361156864:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574998.691537:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361156992:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788574998.691554:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574998.691562:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574998/real 1788574998]  req@ffff8dc00644df80 x1875453361156992/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575023 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574998.691570:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644df80 x1875453361156992/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575023 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574998.691576:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574998.691578:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574998.691581:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361156992:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788574998.691585:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361157120:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574998.691598:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574998.691609:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574998/real 1788574998]  req@ffff8dc00644e300 x1875453361157120/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575023 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574998.691621:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453361157120/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575023 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574998.691630:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574998.691633:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574998.691637:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361157120:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788574998.691643:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361157248:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788574998.691672:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788574998.691684:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788574998/real 1788574998]  req@ffff8dc00644c700 x1875453361157248/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575023 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788574998.691705:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453361157248/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575023 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788574998.691713:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788574998.691715:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788574998.691718:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361157248:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788574999.074982:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788574999.074982:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788574999.075098:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788574999.075125:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788574999.075132:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788574999.075183:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788574999.714968:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575000.098990:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575000.098995:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575000.099007:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575000.099024:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575000.099027:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575000.099029:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575000.738965:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575001.122988:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575001.122989:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575001.122990:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575001.122990:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575001.123030:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788575001.123117:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575001.762967:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575002.146980:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575002.146986:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575002.146987:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575002.147046:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575002.147096:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575002.147137:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575002.786971:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575003.170936:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575003.170995:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575003.171014:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575003.171017:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575003.171063:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788575003.171077:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1788575003.811037:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575003.811049:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788575003.811054:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788575003.811065:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788575003.811067:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3349
00000100:00080000:2.0:1788575003.811083:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575003.811092:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575003.811145:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453361157376/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575003.811179:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575003.811183:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575003.811185:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575003.811190:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3349
00000100:00080000:2.0:1788575003.811194:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575003.811198:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575003.811209:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575003.811224:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453361157504/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575003.811237:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788575003.811247:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361157376:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788575003.811252:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575003.811256:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575003.811262:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3349
00000100:00080000:2.0:1788575003.811268:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575003.811273:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575003.811279:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575003.811294:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453361157632/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575003.811306:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1788575003.811308:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788575003.811314:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575003.811316:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575003.811322:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3349
00000100:00080000:2.0:1788575003.811327:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575003.811332:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575003.811337:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575003.811346:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575003/real 1788575003]  req@ffff8dc020496d80 x1875453361157376/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575028 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575003.811354:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453361157760/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575003.811367:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575003.811371:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575003.811375:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788575003.811375:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453361157376/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575028 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575003.811384:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3349
00000100:00080000:2.0:1788575003.811391:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575003.811396:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:3.0:1788575003.811398:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:2.0:1788575003.811402:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788575003.811406:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575003.811414:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361157376:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788575003.811416:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361157888/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575003.811428:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575003.811430:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575003.811432:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575003.811436:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3349
00000100:00080000:2.0:1788575003.811438:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575003.811440:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575003.811448:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361157504:192.168.202.140@tcp:38:kworker.0
00000008:00100000:2.0:1788575003.811452:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575003.811464:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453361158016/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575003.811473:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575003.811475:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575003.811477:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575003.811483:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3349
00000800:00000100:3.0:1788575003.811485:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788575003.811487:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575003.811491:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575003.811495:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575003.811509:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453361158144/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575003.811521:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575003/real 1788575003]  req@ffff8dc020496a00 x1875453361157504/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575028 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575003.811538:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453361157504/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575028 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575003.811549:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575003.811553:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575003.811556:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361157504:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575003.811563:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361157632:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575003.811599:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575003.811613:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575003/real 1788575003]  req@ffff8dc020497100 x1875453361157632/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575028 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575003.811628:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453361157632/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575028 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575003.811637:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575003.811640:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575003.811643:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361157632:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575003.811647:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361157760:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575003.811664:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575003.811672:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575003/real 1788575003]  req@ffff8dc020494380 x1875453361157760/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575028 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575003.811679:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453361157760/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575028 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575003.811686:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575003.811688:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575003.811691:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361157760:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575003.811697:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361157888:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575003.811717:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575003.811730:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575003/real 1788575003]  req@ffff8dc020494700 x1875453361157888/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575028 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575003.811750:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361157888/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575028 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575003.811758:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575003.811760:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575003.811762:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361157888:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575003.811776:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361158016:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575003.811792:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575003.811803:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575003/real 1788575003]  req@ffff8dc020496d80 x1875453361158016/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575028 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575003.811815:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453361158016/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575028 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575003.811824:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575003.811827:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575003.811831:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361158016:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575003.811837:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361158144:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575003.811855:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575003.811863:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575003/real 1788575003]  req@ffff8dc020494e00 x1875453361158144/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575028 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575003.811907:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453361158144/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575028 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575003.811917:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575003.811919:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575003.811922:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361158144:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575004.194931:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575004.194953:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575004.195005:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575004.195010:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575004.195051:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575004.195072:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575004.834990:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575005.219021:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575005.219021:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575005.219033:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575005.219063:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575005.219065:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575005.219080:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575005.859011:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575006.242993:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575006.243017:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575006.243021:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575006.243044:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575006.243060:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575006.243067:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575006.882978:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575007.267034:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575007.267034:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575007.267035:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575007.267076:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575007.267083:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575007.267100:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575007.907048:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575008.291041:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575008.291045:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575008.291051:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575008.291080:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575008.291090:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575008.291093:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00080000:2.0:1788575008.930955:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575008.930970:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:0.0:1788575008.930974:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788575008.930977:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575008.930992:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3354
00000100:00080000:2.0:1788575008.931007:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575008.931016:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575008.931100:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361158272/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575008.931141:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575008.931146:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575008.931148:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575008.931154:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3354
00000100:00080000:2.0:1788575008.931158:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575008.931163:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575008.931177:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575008.931192:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361158400/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575008.931205:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788575008.931207:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361158272:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788575008.931210:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575008.931216:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575008.931222:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3354
00000100:00080000:2.0:1788575008.931235:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575008.931241:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575008.931248:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575008.931264:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453361158528/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575008.931275:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575008.931279:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575008.931281:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575008.931285:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3354
00000100:00080000:2.0:1788575008.931290:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575008.931294:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575008.931300:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788575008.931306:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575008.931315:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361158656/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575008.931326:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575008.931330:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575008.931333:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575008.931337:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3354
00000100:00080000:2.0:1788575008.931342:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575008.931346:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575008.931351:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575008.931368:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361158784/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575008.931374:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575008/real 1788575008]  req@ffff8dc020494000 x1875453361158272/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575033 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575008.931382:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575008.931392:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575008.931396:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575008.931403:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3354
00000100:00080000:2.0:1788575008.931408:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575008.931416:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575008.931417:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361158272/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575033 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1788575008.931424:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788575008.931439:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1788575008.931443:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453361158912/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575008.931449:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575008.931456:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361158272:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788575008.931466:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575008.931471:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575008.931473:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575008.931479:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3354
00000100:00080000:2.0:1788575008.931484:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788575008.931489:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361158400:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788575008.931491:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575008.931500:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788575008.931518:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575008.931527:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361159040/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575008.931533:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575008/real 1788575008]  req@ffff8dc020495500 x1875453361158400/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575033 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575008.931560:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361158400/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575033 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575008.931571:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575008.931574:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575008.931577:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361158400:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575008.931582:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361158528:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575008.931597:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575008.931604:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575008/real 1788575008]  req@ffff8dc020497480 x1875453361158528/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575033 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575008.931612:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453361158528/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575033 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575008.931619:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575008.931621:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575008.931623:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361158528:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575008.931627:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361158656:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575008.931638:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575008.931643:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575008/real 1788575008]  req@ffff8dc020495880 x1875453361158656/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575033 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575008.931651:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361158656/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575033 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575008.931657:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575008.931659:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575008.931662:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361158656:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575008.931666:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361158784:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575008.931677:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575008.931683:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575008/real 1788575008]  req@ffff8dc020495180 x1875453361158784/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575033 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575008.931691:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361158784/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575033 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575008.931697:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575008.931699:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575008.931701:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361158784:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575008.931704:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361158912:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575008.931714:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575008.931720:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575008/real 1788575008]  req@ffff8dc020494a80 x1875453361158912/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575033 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575008.931728:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453361158912/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575033 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575008.931734:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575008.931736:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575008.931737:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361158912:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575008.931749:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361159040:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575008.931760:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575008.931767:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575008/real 1788575008]  req@ffff8dc020494000 x1875453361159040/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575033 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575008.931780:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361159040/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575033 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575008.931788:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575008.931791:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575008.931795:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361159040:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575009.315002:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575009.315002:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575009.315027:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575009.315075:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575009.315080:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575009.315087:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575009.954979:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575010.338986:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575010.338992:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575010.339009:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575010.339039:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575010.339044:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575010.339055:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575010.979054:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575011.363013:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575011.363014:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575011.363021:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575011.363037:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575011.363076:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575011.363111:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575012.003027:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575012.386943:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575012.386986:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575012.387017:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575012.387035:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575012.387036:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575012.387042:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575013.027066:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575013.411035:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575013.411036:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575013.411037:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575013.411085:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575013.411085:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575013.411096:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575014.051012:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575014.051022:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575014.051033:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575014.051038:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575014.051050:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3359
00000100:00080000:1.0:1788575014.051060:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575014.051069:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575014.051107:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361159168/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575014.051138:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575014.051142:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575014.051144:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575014.051148:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3359
00000100:00080000:1.0:1788575014.051152:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575014.051168:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575014.051179:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575014.051194:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361159296/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575014.051207:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575014.051210:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575014.051213:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788575014.051217:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361159168:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788575014.051220:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3359
00000100:00080000:1.0:1788575014.051224:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575014.051233:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575014.051240:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575014.051255:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361159424/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575014.051265:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575014.051269:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575014.051272:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575014.051275:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3359
00000100:00080000:1.0:1788575014.051288:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575014.051293:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:3.0:1788575014.051299:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:1.0:1788575014.051302:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575014.051316:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361159552/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575014.051326:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575014.051329:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575014.051331:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575014.051336:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3359
00000100:00080000:1.0:1788575014.051340:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575014.051344:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575014.051350:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575014/real 1788575014]  req@ffff8dc005dc1c00 x1875453361159168/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575039 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1788575014.051352:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575014.051371:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361159680/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575014.051380:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361159168/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575039 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575014.051385:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575014.051393:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575014.051397:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575014.051404:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575014.051405:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3359
00000100:00080000:1.0:1788575014.051413:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575014.051416:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788575014.051420:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575014.051426:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361159168:192.168.202.140@tcp:250:kworker.0
00000008:00100000:1.0:1788575014.051428:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575014.051445:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361159808/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575014.051455:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575014.051458:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575014.051462:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788575014.051462:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361159296:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788575014.051470:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3359
00000100:00080000:1.0:1788575014.051474:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575014.051478:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575014.051484:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575014.051501:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361159936/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788575014.051502:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575014.051523:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575014/real 1788575014]  req@ffff8dc005dc3800 x1875453361159296/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575039 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575014.051541:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361159296/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575039 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575014.051553:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575014.051557:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575014.051561:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361159296:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575014.051567:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361159424:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575014.051590:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575014.051603:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575014/real 1788575014]  req@ffff8dc005dc0700 x1875453361159424/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575039 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575014.051617:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361159424/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575039 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575014.051626:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575014.051630:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575014.051634:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361159424:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575014.051641:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361159552:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575014.051659:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575014.051670:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575014/real 1788575014]  req@ffff8dc005dc3b80 x1875453361159552/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575039 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575014.051683:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361159552/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575039 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575014.051693:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575014.051697:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575014.051701:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361159552:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575014.051707:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361159680:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575014.051743:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575014.051755:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575014/real 1788575014]  req@ffff8dc005dc2d80 x1875453361159680/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575039 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575014.051769:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361159680/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575039 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575014.051779:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575014.051783:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575014.051787:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361159680:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575014.051793:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361159808:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575014.051815:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575014.051835:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575014/real 1788575014]  req@ffff8dc005dc1180 x1875453361159808/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575039 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575014.051849:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361159808/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575039 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575014.051858:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575014.051861:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575014.051904:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361159808:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575014.051926:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361159936:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575014.051948:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575014.051960:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575014/real 1788575014]  req@ffff8dc005dc0a80 x1875453361159936/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575039 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575014.051973:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361159936/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575039 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575014.051983:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575014.051986:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575014.051990:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361159936:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575014.435003:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575014.435007:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575014.435029:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575014.435051:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575014.435058:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575014.435076:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575015.075055:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575015.459036:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575015.459036:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575015.459038:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575015.459081:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575015.459099:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575015.459123:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575016.099010:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575016.482934:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575016.482997:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575016.483012:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575016.483028:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575016.483058:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575016.483076:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575017.123052:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575017.506984:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575017.507021:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575017.507021:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575017.507135:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575017.507145:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575017.507189:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575018.147035:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575018.531007:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575018.531007:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575018.531007:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575018.531007:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575018.531044:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575018.531101:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1788575019.171007:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788575019.171015:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575019.171021:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575019.171036:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575019.171049:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3364
00000100:00080000:1.0:1788575019.171059:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575019.171067:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575019.171110:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361160064/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575019.171150:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575019.171154:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575019.171156:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575019.171161:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3364
00000100:00080000:1.0:1788575019.171164:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575019.171169:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575019.171179:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575019.171196:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361160192/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575019.171213:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361160064:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788575019.171216:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575019.171224:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575019.171226:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575019.171231:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3364
00000100:00080000:1.0:1788575019.171235:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575019.171239:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575019.171245:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575019.171260:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361160320/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575019.171284:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575019.171288:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575019.171291:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575019.171295:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3364
00000100:00080000:1.0:1788575019.171300:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575019.171305:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575019.171311:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575019.171327:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361160448/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575019.171336:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361160192:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788575019.171344:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575019.171350:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575019.171351:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575019.171357:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3364
00000100:00080000:1.0:1788575019.171361:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575019.171366:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575019.171372:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361160320:192.168.202.140@tcp:8:kworker.0
00000008:00100000:1.0:1788575019.171373:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575019.171394:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361160576/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575019.171407:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575019.171411:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:3.0:1788575019.171413:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361160448:192.168.202.140@tcp:8:kworker.0
00000100:00080000:1.0:1788575019.171415:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575019.171425:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3364
00000100:00080000:1.0:1788575019.171430:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575019.171435:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575019.171439:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361160576:192.168.202.140@tcp:38:kworker.0
00000008:00100000:1.0:1788575019.171441:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575019.171459:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361160704/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575019.171478:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575019.171482:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575019.171484:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575019.171489:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3364
00000100:00080000:1.0:1788575019.171493:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575019.171498:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575019.171504:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575019.171511:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361160704:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575019.171519:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361160832/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575019.171556:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361160832:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575019.554979:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575019.554979:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575019.554994:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575019.555001:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575019.555031:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575019.555087:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575020.195030:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575020.579032:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575020.579032:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575020.579051:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575020.579051:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575020.579102:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575020.579129:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575021.219035:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575021.602967:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575021.602979:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575021.602986:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575021.603007:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575021.603014:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575021.603018:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575022.242996:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000400:00000100:2.0:1788575022.243179:0:2337:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.140:988
00000400:00000100:2.0:1788575022.243221:0:2337:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.140@tcp at host 192.168.202.140 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:2.0:1788575022.243239:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:2.0:1788575022.243291:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:2.0:1788575022.243310:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:2.0:1788575022.243319:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:2.0:1788575022.243328:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:2.0:1788575022.243337:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:2.0:1788575022.243379:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:3.0:1788575022.243494:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575019/real 1788575022]  req@ffff8dc005dc3800 x1875453361160832/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575044 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575022.243527:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361160832/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575044 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575022.243542:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575022.243548:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575022.243553:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361160832:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575022.243563:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575019/real 1788575022]  req@ffff8dc005dc0700 x1875453361160704/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575044 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575022.243578:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361160704/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575044 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575022.243586:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575022.243590:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575022.243595:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361160704:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575022.243603:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575019/real 1788575022]  req@ffff8dc005dc2d80 x1875453361160448/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575044 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575022.243614:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361160448/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575044 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575022.243624:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575022.243633:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575022.243638:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361160448:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575022.243646:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575019/real 1788575022]  req@ffff8dc005dc3b80 x1875453361160576/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575044 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575022.243658:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361160576/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575044 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575022.243669:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575022.243672:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575022.243675:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361160576:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575022.243683:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575019/real 1788575022]  req@ffff8dc005dc0a80 x1875453361160192/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575044 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575022.243695:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361160192/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575044 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575022.243707:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575022.243711:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575022.243715:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361160192:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575022.243724:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575019/real 1788575022]  req@ffff8dc005dc1180 x1875453361160320/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575044 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575022.243738:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361160320/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575044 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575022.243748:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575022.243752:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575022.243756:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361160320:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575022.243764:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575019/real 1788575022]  req@ffff8dc005dc1500 x1875453361160064/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575044 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575022.243779:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361160064/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575044 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575022.243787:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575022.243791:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575022.243794:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361160064:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788575022.627002:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575022.627002:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575022.627005:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575022.627036:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575022.627042:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575022.627045:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575023.267105:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575023.651005:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575023.651044:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575023.651053:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575023.651064:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575023.651076:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575023.651085:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575024.290995:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575024.291010:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575024.291016:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575024.291030:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3369
00000100:00080000:1.0:1788575024.291043:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575024.291054:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575024.291063:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575024.291102:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361160960/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575024.291139:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575024.291144:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575024.291146:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575024.291151:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3369
00000100:00080000:1.0:1788575024.291155:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575024.291159:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575024.291171:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575024.291185:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361161088/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575024.291195:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575024.291199:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575024.291201:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575024.291205:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3369
00000100:00080000:1.0:1788575024.291207:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575024.291211:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575024.291216:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575024.291224:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361161216/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575024.291233:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575024.291237:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575024.291239:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575024.291243:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3369
00000100:00080000:1.0:1788575024.291247:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575024.291252:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575024.291257:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575024.291267:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361161344/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575024.291277:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575024.291281:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575024.291283:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575024.291288:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3369
00000100:00080000:1.0:1788575024.291290:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575024.291294:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575024.291299:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575024.291308:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361161472/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575024.291313:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361160960:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788575024.291324:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575024.291330:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575024.291332:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575024.291337:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3369
00000100:00080000:1.0:1788575024.291339:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575024.291343:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575024.291348:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575024.291359:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361161600/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575024.291368:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575024.291372:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575024.291374:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575024.291379:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3369
00000100:00080000:1.0:1788575024.291385:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575024.291406:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575024.291412:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575024.291423:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361161728/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788575024.291469:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575024.291529:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575024/real 1788575024]  req@ffff8dc005dc1c00 x1875453361160960/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575049 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575024.291569:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361160960/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575049 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575024.291584:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575024.291589:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575024.291594:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361160960:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788575024.291604:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361161088:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575024.291633:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575024.291663:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575024/real 1788575024]  req@ffff8dc005dc1500 x1875453361161088/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575049 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575024.291678:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361161088/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575049 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575024.291692:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575024.291696:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575024.291699:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361161088:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575024.291707:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361161216:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575024.291733:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575024.291747:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575024/real 1788575024]  req@ffff8dc005dc1180 x1875453361161216/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575049 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575024.291760:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361161216/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575049 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575024.291771:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575024.291775:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575024.291778:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361161216:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575024.291785:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361161344:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575024.291808:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575024.291820:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575024/real 1788575024]  req@ffff8dc005dc0a80 x1875453361161344/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575049 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575024.291833:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361161344/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575049 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575024.291842:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575024.291846:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575024.291849:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361161344:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575024.292012:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361161472:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575024.292040:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575024.292054:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575024/real 1788575024]  req@ffff8dc005dc3b80 x1875453361161472/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575049 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575024.292066:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361161472/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575049 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575024.292076:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575024.292081:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575024.292084:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361161472:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575024.292090:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361161600:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575024.292109:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575024.292119:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575024/real 1788575024]  req@ffff8dc005dc2d80 x1875453361161600/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575049 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575024.292132:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361161600/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575049 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575024.292152:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575024.292155:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575024.292159:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361161600:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575024.292165:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361161728:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575024.292187:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575024.292199:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575024/real 1788575024]  req@ffff8dc005dc0700 x1875453361161728/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575049 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575024.292213:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361161728/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575049 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575024.292222:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575024.292226:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575024.292230:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361161728:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575024.675005:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575024.675022:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575024.675024:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575024.675070:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575024.675077:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575024.675096:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575025.315148:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575025.698979:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575025.698979:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575025.698980:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575025.699013:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575025.699018:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575025.699019:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575026.338963:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575026.722964:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575026.722998:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575026.723001:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575026.723028:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575026.723033:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575026.723064:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575027.362999:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575027.746974:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575027.746976:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575027.746987:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575027.746992:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575027.747014:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575027.747063:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575028.386928:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575028.771032:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575028.771032:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575028.771033:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575028.771088:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575028.771134:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788575028.771148:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575029.411030:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788575029.411033:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575029.411045:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788575029.411050:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575029.411060:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3375
00000100:00080000:3.0:1788575029.411069:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575029.411075:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575029.411105:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e680 x1875453361161856/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575029.411129:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575029.411132:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575029.411134:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575029.411137:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3375
00000100:00080000:3.0:1788575029.411140:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575029.411143:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575029.411150:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575029.411161:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d180 x1875453361161984/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575029.411169:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361161856:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788575029.411176:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575029.411179:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575029.411181:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575029.411184:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3375
00000100:00080000:3.0:1788575029.411186:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575029.411188:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575029.411191:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575029.411203:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f480 x1875453361162112/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575029.411212:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575029.411214:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575029.411215:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575029.411218:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3375
00000100:00080000:3.0:1788575029.411222:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575029.411227:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575029.411233:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575029.411248:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c380 x1875453361162240/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575029.411259:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:2.0:1788575029.411266:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788575029.411267:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575029.411273:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575029.411280:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3375
00000100:00080000:3.0:1788575029.411288:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575029.411293:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575029.411298:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575029.411313:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d500 x1875453361162368/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575029.411322:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575029.411324:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:2.0:1788575029.411328:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575029/real 1788575029]  req@ffff8dc00644e680 x1875453361161856/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575054 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575029.411329:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575029.411350:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3375
00000100:00100000:2.0:1788575029.411356:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453361161856/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575054 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575029.411356:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575029.411371:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575029.411385:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1788575029.411390:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575029.411399:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575029.411400:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ea00 x1875453361162496/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575029.411413:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361161856:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788575029.411422:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575029.411427:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575029.411428:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575029.411432:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3375
00000100:00080000:3.0:1788575029.411433:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575029.411441:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575029.411449:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575029.411457:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ca80 x1875453361162624/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575029.411469:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361161984:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575029.411495:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575029.411506:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575029/real 1788575029]  req@ffff8dc00644d180 x1875453361161984/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575054 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575029.411543:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453361161984/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575054 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575029.411552:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575029.411554:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575029.411557:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361161984:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575029.411562:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361162112:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575029.411579:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575029.411586:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575029/real 1788575029]  req@ffff8dc00644f480 x1875453361162112/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575054 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575029.411594:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453361162112/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575054 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575029.411600:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575029.411603:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575029.411605:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361162112:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575029.411609:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361162240:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575029.411620:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575029.411625:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575029/real 1788575029]  req@ffff8dc00644c380 x1875453361162240/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575054 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575029.411638:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453361162240/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575054 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575029.411643:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575029.411645:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575029.411647:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361162240:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575029.411651:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361162368:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575029.411662:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575029.411668:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575029/real 1788575029]  req@ffff8dc00644d500 x1875453361162368/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575054 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575029.411676:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d500 x1875453361162368/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575054 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575029.411681:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575029.411683:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575029.411685:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361162368:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575029.411689:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361162496:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575029.411701:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575029.411707:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575029/real 1788575029]  req@ffff8dc00644ea00 x1875453361162496/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575054 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575029.411714:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ea00 x1875453361162496/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575054 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575029.411723:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575029.411726:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575029.411728:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361162496:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575029.411741:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361162624:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575029.411752:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575029.411758:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575029/real 1788575029]  req@ffff8dc00644ca80 x1875453361162624/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575054 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575029.411765:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ca80 x1875453361162624/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575054 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575029.411771:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575029.411773:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575029.411775:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361162624:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575029.795005:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575029.795005:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575029.795005:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575029.795029:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575029.795061:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575029.795116:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575030.435046:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575030.818980:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575030.818980:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575030.818995:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575030.819019:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575030.819046:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788575030.819050:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575031.458992:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575031.842954:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575031.842955:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575031.842957:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575031.842958:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575031.842986:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575031.843013:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575032.482989:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575032.867021:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575032.867038:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575032.867038:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788575032.867065:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575032.867072:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575032.867091:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575033.506982:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575033.890927:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575033.890939:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575033.890942:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575033.890956:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575033.890977:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575033.890998:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1788575034.530985:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788575034.530986:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575034.530996:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788575034.531000:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575034.531011:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3380
00000100:00080000:0.0:1788575034.531022:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575034.531029:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575034.531070:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361162752/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575034.531096:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575034.531101:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575034.531103:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575034.531109:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3380
00000100:00080000:0.0:1788575034.531114:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575034.531119:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575034.531123:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361162752:192.168.202.140@tcp:250:kworker.0
00000008:00100000:0.0:1788575034.531132:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575034.531161:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361162880/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575034.531177:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575034.531183:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000800:00000100:2.0:1788575034.531183:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788575034.531185:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575034.531191:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3380
00000100:00080000:0.0:1788575034.531195:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575034.531199:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575034.531204:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575034.531216:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361163008/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575034.531227:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575034.531230:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575034.531232:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575034.531237:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3380
00000100:00080000:0.0:1788575034.531242:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1788575034.531243:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575034/real 1788575034]  req@ffff8dc006713800 x1875453361162752/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575059 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575034.531251:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575034.531262:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575034.531274:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361162752/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575059 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575034.531279:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361163136/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575034.531289:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575034.531292:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575034.531295:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788575034.531297:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575034.531300:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788575034.531301:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361162752:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788575034.531308:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3380
00000100:00080000:0.0:1788575034.531312:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575034.531315:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575034.531319:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575034.531327:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361162880:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575034.531328:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361163264/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575034.531339:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575034.531342:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575034.531343:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575034.531347:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3380
00000100:00080000:0.0:1788575034.531350:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1788575034.531354:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788575034.531356:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575034.531361:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575034.531369:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575034/real 1788575034]  req@ffff8dc006711880 x1875453361162880/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575059 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575034.531372:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361163392/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575034.531393:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788575034.531395:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361162880/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575059 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575034.531396:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575034.531400:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575034.531407:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3380
00000100:00080000:0.0:1788575034.531413:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575034.531414:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575034.531416:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575034.531422:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1788575034.531422:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575034.531428:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361162880:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575034.531432:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361163520/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575034.531436:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361163008:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575034.531459:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575034.531469:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575034/real 1788575034]  req@ffff8dc006712a00 x1875453361163008/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575059 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575034.531478:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361163008/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575059 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575034.531488:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575034.531490:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575034.531492:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361163008:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575034.531495:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361163136:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575034.531506:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575034.531512:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575034/real 1788575034]  req@ffff8dc006710e00 x1875453361163136/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575059 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575034.531518:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361163136/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575059 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575034.531525:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575034.531527:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575034.531529:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361163136:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575034.531538:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361163264:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575034.531549:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575034.531555:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575034/real 1788575034]  req@ffff8dc006713100 x1875453361163264/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575059 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575034.531562:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361163264/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575059 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575034.531567:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575034.531569:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575034.531572:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361163264:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575034.531576:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361163392:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575034.531586:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575034.531591:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575034/real 1788575034]  req@ffff8dc006713b80 x1875453361163392/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575059 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575034.531598:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361163392/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575059 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575034.531603:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575034.531605:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575034.531607:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361163392:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575034.531610:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361163520:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575034.531620:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575034.531657:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575034/real 1788575034]  req@ffff8dc006713800 x1875453361163520/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575059 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575034.531673:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361163520/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575059 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575034.531682:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575034.531685:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575034.531687:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361163520:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575034.914980:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575034.914981:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575034.915006:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575034.915020:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788575034.915023:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575034.915038:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575035.555014:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575035.939020:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575035.939039:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575035.939060:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575035.939082:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575035.939086:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575035.939109:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575036.578979:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575036.962989:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575036.962999:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575036.963013:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788575036.963049:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575036.963069:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575036.963073:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575037.602975:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575037.987002:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575037.987019:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575037.987020:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575037.987032:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575037.987046:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575037.987057:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575038.626997:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575039.010983:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575039.011001:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575039.011002:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575039.011008:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575039.011039:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575039.011071:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575039.650960:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788575039.650978:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575039.650983:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788575039.650987:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575039.650995:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3385
00000100:00080000:3.0:1788575039.651002:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575039.651008:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575039.651040:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ce00 x1875453361163648/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575039.651065:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575039.651068:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575039.651070:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575039.651073:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3385
00000100:00080000:3.0:1788575039.651075:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575039.651078:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575039.651085:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575039.651095:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f800 x1875453361163776/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575039.651102:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575039.651104:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575039.651105:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575039.651108:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3385
00000100:00080000:3.0:1788575039.651110:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575039.651112:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575039.651115:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575039.651120:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361163648:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788575039.651125:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c000 x1875453361163904/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575039.651133:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575039.651134:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575039.651135:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575039.651137:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3385
00000100:00080000:3.0:1788575039.651139:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575039.651141:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575039.651143:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575039.651149:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644dc00 x1875453361164032/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575039.651155:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575039.651157:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575039.651158:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575039.651161:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3385
00000100:00080000:3.0:1788575039.651169:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575039.651172:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575039.651174:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788575039.651181:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575039.651182:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ca80 x1875453361164160/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575039.651190:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575039.651193:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575039.651194:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575039.651197:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3385
00000100:00080000:3.0:1788575039.651200:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575039.651202:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575039.651205:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575039.651210:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ea00 x1875453361164288/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575039.651214:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575039.651216:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575039.651217:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575039.651219:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3385
00000100:00080000:3.0:1788575039.651222:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575039.651224:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575039.651227:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575039.651232:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575039/real 1788575039]  req@ffff8dc00644ce00 x1875453361163648/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575064 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575039.651235:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d500 x1875453361164416/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575039.651268:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ce00 x1875453361163648/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575064 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575039.651276:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575039.651279:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575039.651282:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361163648:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788575039.651287:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361163776:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575039.651301:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575039.651308:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575039/real 1788575039]  req@ffff8dc00644f800 x1875453361163776/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575064 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575039.651320:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f800 x1875453361163776/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575064 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575039.651326:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575039.651328:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575039.651330:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361163776:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575039.651345:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361163904:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575039.651356:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575039.651361:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575039/real 1788575039]  req@ffff8dc00644c000 x1875453361163904/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575064 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575039.651368:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c000 x1875453361163904/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575064 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575039.651373:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575039.651375:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575039.651377:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361163904:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575039.651380:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361164032:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575039.651388:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575039.651393:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575039/real 1788575039]  req@ffff8dc00644dc00 x1875453361164032/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575064 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575039.651399:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644dc00 x1875453361164032/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575064 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575039.651408:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575039.651409:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575039.651411:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361164032:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575039.651414:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361164160:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575039.651422:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575039.651427:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575039/real 1788575039]  req@ffff8dc00644ca80 x1875453361164160/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575064 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575039.651433:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ca80 x1875453361164160/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575064 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575039.651438:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575039.651440:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575039.651441:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361164160:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575039.651444:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361164288:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575039.651453:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575039.651458:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575039/real 1788575039]  req@ffff8dc00644ea00 x1875453361164288/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575064 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575039.651464:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ea00 x1875453361164288/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575064 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575039.651468:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575039.651470:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575039.651472:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361164288:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575039.651476:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361164416:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575039.651484:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575039.651489:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575039/real 1788575039]  req@ffff8dc00644d500 x1875453361164416/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575064 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575039.651495:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d500 x1875453361164416/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575064 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575039.651499:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575039.651501:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575039.651502:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361164416:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575040.034977:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575040.034977:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575040.034991:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575040.035007:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575040.035012:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575040.035012:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575040.674965:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575041.058954:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575041.058954:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575041.058969:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575041.058985:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575041.058993:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788575041.059000:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575041.698926:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575042.082972:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575042.083018:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575042.083018:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575042.083020:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575042.083027:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575042.083056:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575042.722928:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575043.106951:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575043.106951:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575043.106991:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575043.106994:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575043.107015:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575043.107015:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575043.746932:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575044.130978:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575044.130979:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575044.130979:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575044.131023:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575044.131032:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788575044.131065:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575044.771002:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575044.771022:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575044.771027:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788575044.771030:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575044.771038:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3390
00000100:00080000:0.0:1788575044.771046:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575044.771051:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575044.771081:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361164544/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575044.771099:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575044.771101:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575044.771102:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575044.771105:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3390
00000100:00080000:0.0:1788575044.771107:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575044.771109:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575044.771116:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575044.771129:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361164544:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788575044.771130:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361164672/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575044.771145:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575044.771148:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575044.771150:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575044.771153:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3390
00000100:00080000:0.0:1788575044.771156:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575044.771160:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575044.771165:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575044.771177:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453361164800/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575044.771182:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575044.771184:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575044.771186:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:2.0:1788575044.771191:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788575044.771192:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3390
00000100:00080000:0.0:1788575044.771197:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575044.771199:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575044.771202:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575044.771209:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361164928/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575044.771214:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575044.771216:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575044.771217:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575044.771220:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3390
00000100:00080000:0.0:1788575044.771222:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575044.771224:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575044.771227:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575044.771233:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361165056/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575044.771238:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575044.771241:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575044.771244:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788575044.771245:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575044/real 1788575044]  req@ffff8dc006711c00 x1875453361164544/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575069 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575044.771248:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3390
00000100:00080000:0.0:1788575044.771252:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575044.771256:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575044.771262:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575044.771270:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361165184/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575044.771274:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361164544/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575069 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575044.771278:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575044.771283:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575044.771286:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575044.771292:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3390
00000100:00080000:0.0:1788575044.771294:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575044.771296:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575044.771297:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575044.771303:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1788575044.771305:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575044.771311:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361165312/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575044.771313:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361164544:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788575044.771341:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361164672:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575044.771363:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575044.771375:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575044/real 1788575044]  req@ffff8dc006712300 x1875453361164672/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575069 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575044.771387:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361164672/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575069 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575044.771397:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575044.771400:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575044.771404:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361164672:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575044.771409:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361164800:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575044.771426:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575044.771436:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575044/real 1788575044]  req@ffff8dc006710380 x1875453361164800/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575069 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575044.771455:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453361164800/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575069 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575044.771470:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575044.771473:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575044.771476:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361164800:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575044.771482:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361164928:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575044.771499:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575044.771508:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575044/real 1788575044]  req@ffff8dc006712680 x1875453361164928/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575069 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575044.771519:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361164928/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575069 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575044.771527:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575044.771530:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575044.771533:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361164928:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575044.771539:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361165056:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575044.771554:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575044.771564:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575044/real 1788575044]  req@ffff8dc006713480 x1875453361165056/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575069 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575044.771575:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361165056/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575069 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575044.771583:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575044.771586:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575044.771590:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361165056:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575044.771596:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361165184:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575044.771612:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575044.771622:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575044/real 1788575044]  req@ffff8dc006711500 x1875453361165184/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575069 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575044.771633:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361165184/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575069 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575044.771640:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575044.771643:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575044.771647:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361165184:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575044.771652:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361165312:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575044.771668:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575044.771678:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575044/real 1788575044]  req@ffff8dc006713800 x1875453361165312/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575069 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575044.771689:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361165312/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575069 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575044.771696:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575044.771700:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575044.771703:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361165312:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575045.154975:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575045.154983:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575045.155009:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575045.155020:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575045.155037:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788575045.155136:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575045.794946:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575046.178949:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575046.178950:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575046.178972:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575046.178989:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575046.179108:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575046.179162:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575046.818973:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575047.202978:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575047.202979:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575047.202979:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575047.202982:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575047.203006:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788575047.203079:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575047.842915:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575048.226979:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575048.226979:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575048.226979:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788575048.227011:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575048.227014:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575048.227032:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575048.867010:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575049.250958:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575049.250959:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575049.250982:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575049.250985:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575049.251006:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788575049.251032:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1788575049.890967:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788575049.890967:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575049.890975:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575049.890997:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575049.891005:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3395
00000100:00080000:1.0:1788575049.891013:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575049.891019:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575049.891047:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361165440/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575049.891069:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575049.891071:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575049.891072:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575049.891075:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3395
00000100:00080000:1.0:1788575049.891077:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575049.891080:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575049.891087:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575049.891094:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361165440:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788575049.891098:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361165568/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575049.891105:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575049.891107:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575049.891108:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575049.891110:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3395
00000100:00080000:1.0:1788575049.891112:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575049.891114:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575049.891116:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575049.891139:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361165696/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575049.891148:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:2.0:1788575049.891149:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788575049.891154:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575049.891156:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575049.891161:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3395
00000100:00080000:1.0:1788575049.891166:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575049.891170:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575049.891175:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575049.891186:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575049/real 1788575049]  req@ffff8dc005dc3800 x1875453361165440/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575074 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575049.891191:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361165824/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575049.891202:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788575049.891205:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361165440/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575074 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575049.891206:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575049.891209:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575049.891216:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3395
00000100:00080000:1.0:1788575049.891220:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575049.891221:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575049.891224:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:2.0:1788575049.891227:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000008:00100000:1.0:1788575049.891231:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575049.891232:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361165440:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788575049.891243:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361165952/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575049.891251:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788575049.891254:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361165568:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788575049.891255:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575049.891258:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575049.891262:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3395
00000100:00080000:1.0:1788575049.891264:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575049.891267:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575049.891270:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788575049.891274:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575049.891278:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361166080/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575049.891285:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575049/real 1788575049]  req@ffff8dc005dc0700 x1875453361165568/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575074 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575049.891297:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575049.891301:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575049.891302:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788575049.891305:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361165568/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575074 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575049.891307:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3395
00000100:00080000:1.0:1788575049.891312:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575049.891317:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:2.0:1788575049.891320:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:1.0:1788575049.891321:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1788575049.891325:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575049.891328:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361165568:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788575049.891331:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361166208/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575049.891336:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361165696:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575049.891362:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575049.891373:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575049/real 1788575049]  req@ffff8dc005dc2d80 x1875453361165696/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575074 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575049.891399:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361165696/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575074 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575049.891408:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575049.891411:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575049.891414:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361165696:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575049.891420:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361165824:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575049.891438:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575049.891448:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575049/real 1788575049]  req@ffff8dc005dc3b80 x1875453361165824/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575074 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575049.891459:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361165824/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575074 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575049.891468:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575049.891471:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575049.891474:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361165824:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575049.891489:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361165952:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575049.891506:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575049.891516:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575049/real 1788575049]  req@ffff8dc005dc0a80 x1875453361165952/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575074 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575049.891527:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361165952/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575074 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575049.891537:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575049.891540:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575049.891543:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361165952:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575049.891549:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361166080:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575049.891564:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575049.891573:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575049/real 1788575049]  req@ffff8dc005dc1180 x1875453361166080/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575074 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575049.891584:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361166080/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575074 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575049.891591:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575049.891594:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575049.891597:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361166080:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575049.891602:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361166208:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575049.891617:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575049.891627:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575049/real 1788575049]  req@ffff8dc005dc1500 x1875453361166208/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575074 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575049.891637:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361166208/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575074 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575049.891645:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575049.891647:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575049.891650:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361166208:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575050.274959:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575050.274959:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575050.274960:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788575050.275010:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575050.275010:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575050.275010:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575050.914946:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575051.298966:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575051.298966:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575051.298969:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575051.298973:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575051.299004:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788575051.299078:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575051.938976:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575052.322962:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575052.322962:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575052.322967:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575052.322995:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575052.323009:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575052.323014:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575052.962942:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575053.346946:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575053.346948:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575053.346960:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575053.346978:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788575053.346989:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575053.346996:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575053.986966:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575054.370967:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575054.370976:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575054.370980:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575054.370994:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575054.371004:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788575054.371014:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1788575055.010985:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575055.010994:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788575055.010998:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788575055.010999:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788575055.011009:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3400
00000100:00080000:3.0:1788575055.011026:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575055.011033:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575055.011065:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c380 x1875453361166336/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575055.011085:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575055.011088:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575055.011089:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575055.011093:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3400
00000100:00080000:3.0:1788575055.011107:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575055.011111:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575055.011121:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575055.011141:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f480 x1875453361166464/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575055.011143:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361166336:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788575055.011163:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575055.011167:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575055.011169:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575055.011175:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3400
00000100:00080000:3.0:1788575055.011180:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575055.011186:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575055.011192:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575055.011207:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d180 x1875453361166592/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788575055.011218:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788575055.011224:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575055.011230:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575055.011232:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575055.011238:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3400
00000100:00080000:3.0:1788575055.011242:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575055.011247:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575055.011252:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575055.011267:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575055/real 1788575055]  req@ffff8dc00644c380 x1875453361166336/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575080 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575055.011288:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453361166336/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575080 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575055.011300:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575055.011304:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575055.011309:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361166336:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788575055.011333:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361166464:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575055.011336:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e680 x1875453361166720/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575055.011348:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575055.011351:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575055.011353:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575055.011356:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3400
00000100:00080000:3.0:1788575055.011360:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575055.011365:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:2.0:1788575055.011367:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:3.0:1788575055.011371:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575055.011384:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c700 x1875453361166848/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575055.011388:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575055/real 1788575055]  req@ffff8dc00644f480 x1875453361166464/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575080 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575055.011398:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575055.011406:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575055.011409:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575055.011415:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3400
00000100:00080000:3.0:1788575055.011419:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1788575055.011424:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453361166464/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575080 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575055.011425:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575055.011432:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575055.011442:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e300 x1875453361166976/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575055.011446:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575055.011453:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575055.011457:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361166464:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575055.011464:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361166592:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575055.011489:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575055.011508:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575055/real 1788575055]  req@ffff8dc00644d180 x1875453361166592/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575080 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575055.011520:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453361166592/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575080 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575055.011526:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575055.011529:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575055.011531:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361166592:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575055.011543:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361166720:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575055.011561:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788575055.011570:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575055.011573:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:2.0:1788575055.011577:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575055/real 1788575055]  req@ffff8dc00644e680 x1875453361166720/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575080 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575055.011577:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575055.011586:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3400
00000100:00080000:3.0:1788575055.011595:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1788575055.011600:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453361166720/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575080 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575055.011607:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575055.011609:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575055.011612:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361166720:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575055.011617:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361166848:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575055.011634:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788575055.011637:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575055.011645:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575055.011652:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575055/real 1788575055]  req@ffff8dc00644c700 x1875453361166848/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575080 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575055.011661:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644df80 x1875453361167104/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575055.011667:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453361166848/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575080 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575055.011681:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575055.011684:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575055.011686:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361166848:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575055.011697:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361166976:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575055.011709:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575055.011721:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575055/real 1788575055]  req@ffff8dc00644e300 x1875453361166976/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575080 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575055.011729:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453361166976/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575080 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575055.011734:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575055.011737:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575055.011739:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361166976:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575055.011742:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361167104:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575055.011752:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575055.011757:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575055/real 1788575055]  req@ffff8dc00644df80 x1875453361167104/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575080 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575055.011764:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644df80 x1875453361167104/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575080 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575055.011769:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575055.011771:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575055.011773:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361167104:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575055.394950:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575055.394956:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575055.394982:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575055.394988:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575055.395016:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575055.395020:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575056.034976:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575056.418981:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575056.418981:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575056.419008:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788575056.419011:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575056.419014:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575056.419029:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575057.059012:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575057.443004:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575057.443005:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575057.443041:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575057.443044:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575057.443081:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575057.443094:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575058.083027:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575058.466956:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575058.466965:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575058.467005:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575058.467021:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575058.467021:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575058.467028:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575059.106999:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575059.491030:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575059.491050:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575059.491059:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575059.491074:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575059.491084:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575059.491098:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575060.131026:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788575060.131035:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575060.131038:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788575060.131043:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575060.131056:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3405
00000100:00080000:0.0:1788575060.131068:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575060.131077:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575060.131120:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361167232/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575060.131146:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575060.131149:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575060.131151:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575060.131154:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3405
00000100:00080000:0.0:1788575060.131156:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575060.131159:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575060.131169:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575060.131181:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361167360/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575060.131202:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788575060.131202:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361167232:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788575060.131210:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575060.131226:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575060.131233:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3405
00000100:00080000:0.0:1788575060.131237:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575060.131243:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575060.131249:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575060.131265:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361167488/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575060.131273:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575060.131276:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575060.131277:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575060.131280:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3405
00000100:00080000:0.0:1788575060.131285:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575060.131288:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575060.131291:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788575060.131298:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575060.131303:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361167616/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575060.131310:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575060.131313:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575060.131315:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575060.131318:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3405
00000100:00080000:0.0:1788575060.131322:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575060.131326:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575060.131329:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575060.131337:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361167744/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575060.131343:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575060.131346:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575060.131347:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575060.131352:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3405
00000100:00080000:0.0:1788575060.131356:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1788575060.131356:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575060/real 1788575060]  req@ffff8dc006713b80 x1875453361167232/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575085 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575060.131364:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575060.131371:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575060.131382:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361167872/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575060.131386:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361167232/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575085 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575060.131397:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575060.131403:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575060.131405:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575060.131405:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575060.131410:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3405
00000100:00080000:2.0:1788575060.131414:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788575060.131416:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575060.131422:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575060.131422:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361167232:192.168.202.140@tcp:250:kworker.0
00000008:00100000:0.0:1788575060.131431:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575060.131440:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361168000/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575060.131454:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361167360:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575060.131474:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575060.131486:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575060/real 1788575060]  req@ffff8dc006713100 x1875453361167360/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575085 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575060.131495:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361167360/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575085 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575060.131503:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575060.131506:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575060.131509:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361167360:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575060.131513:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361167488:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575060.131525:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575060.131532:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575060/real 1788575060]  req@ffff8dc006710e00 x1875453361167488/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575085 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575060.131544:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361167488/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575085 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575060.131550:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575060.131552:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575060.131554:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361167488:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575060.131558:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361167616:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575060.131570:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575060.131581:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575060/real 1788575060]  req@ffff8dc006712a00 x1875453361167616/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575085 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575060.131593:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361167616/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575085 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575060.131603:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575060.131607:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575060.131611:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361167616:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575060.131618:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361167744:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575060.131637:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575060.131646:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575060/real 1788575060]  req@ffff8dc006711880 x1875453361167744/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575085 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575060.131654:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361167744/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575085 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575060.131665:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575060.131667:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575060.131669:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361167744:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575060.131673:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361167872:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575060.131685:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575060.131691:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575060/real 1788575060]  req@ffff8dc006713800 x1875453361167872/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575085 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575060.131698:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361167872/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575085 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575060.131704:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575060.131706:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575060.131707:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361167872:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575060.131720:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361168000:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575060.131731:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575060.131737:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575060/real 1788575060]  req@ffff8dc006711500 x1875453361168000/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575085 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575060.131744:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361168000/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575085 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575060.131749:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575060.131751:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575060.131754:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361168000:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575060.514976:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575060.515008:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575060.515028:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575060.515041:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575060.515045:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575060.515057:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575061.154992:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575061.539015:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575061.539022:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575061.539028:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575061.539063:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575061.539064:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575061.539128:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575062.178978:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575062.563019:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575062.563020:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575062.563036:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575062.563063:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575062.563070:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788575062.563083:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575063.202981:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575063.586993:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575063.586993:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575063.587037:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575063.587039:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575063.587060:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575063.587107:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575064.226986:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575064.610979:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575064.610980:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575064.610999:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575064.611029:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575064.611033:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575064.611082:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1788575065.250992:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575065.251002:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575065.251006:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575065.251017:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3410
00000100:00080000:1.0:1788575065.251027:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788575065.251029:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575065.251036:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575065.251077:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361168128/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575065.251118:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575065.251123:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575065.251125:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575065.251130:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3410
00000100:00080000:1.0:1788575065.251134:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575065.251141:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575065.251153:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575065.251173:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361168256/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575065.251182:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361168128:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788575065.251197:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575065.251202:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575065.251204:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575065.251210:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3410
00000100:00080000:1.0:1788575065.251214:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575065.251219:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575065.251227:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575065.251248:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361168384/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575065.251259:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575065.251262:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575065.251264:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575065.251268:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3410
00000100:00080000:1.0:1788575065.251274:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575065.251278:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575065.251284:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788575065.251289:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575065.251313:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361168512/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575065.251325:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575065.251330:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575065.251345:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575065.251350:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3410
00000100:00080000:1.0:1788575065.251357:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1788575065.251361:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575065/real 1788575065]  req@ffff8dc005dc1c00 x1875453361168128/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575090 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575065.251369:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575065.251385:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575065.251396:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361168128/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575090 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575065.251407:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361168640/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575065.251408:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575065.251413:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575065.251421:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361168128:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788575065.251446:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575065.251450:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575065.251453:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788575065.251458:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361168256:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788575065.251464:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3410
00000100:00080000:1.0:1788575065.251471:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575065.251477:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575065.251484:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788575065.251488:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575065.251508:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361168768/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575065.251514:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575065/real 1788575065]  req@ffff8dc005dc1500 x1875453361168256/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575090 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575065.251543:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575065.251549:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:2.0:1788575065.251551:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361168256/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575090 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575065.251552:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575065.251565:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3410
00000100:00080000:1.0:1788575065.251574:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575065.251580:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575065.251582:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:2.0:1788575065.251594:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000008:00100000:1.0:1788575065.251595:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575065.251604:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361168256:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575065.251618:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361168384:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575065.251631:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361168896/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788575065.251649:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575065.251681:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575065/real 1788575065]  req@ffff8dc005dc1180 x1875453361168384/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575090 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575065.251697:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361168384/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575090 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575065.251706:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575065.251708:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575065.251711:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361168384:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575065.251717:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361168512:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575065.251733:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575065.251741:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575065/real 1788575065]  req@ffff8dc005dc0a80 x1875453361168512/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575090 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575065.251749:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361168512/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575090 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575065.251755:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575065.251757:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575065.251759:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361168512:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575065.251763:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361168640:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575065.251774:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575065.251781:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575065/real 1788575065]  req@ffff8dc005dc3b80 x1875453361168640/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575090 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575065.251788:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361168640/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575090 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575065.251794:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575065.251796:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575065.251799:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361168640:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575065.251813:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361168768:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575065.251824:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575065.251830:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575065/real 1788575065]  req@ffff8dc005dc2d80 x1875453361168768/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575090 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575065.251838:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361168768/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575090 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575065.251843:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575065.251846:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575065.251848:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361168768:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575065.251852:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361168896:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575065.251862:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575065.251907:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575065/real 1788575065]  req@ffff8dc005dc0700 x1875453361168896/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575090 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575065.251919:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361168896/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575090 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575065.251929:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575065.251932:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575065.251936:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361168896:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575065.635022:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575065.635022:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575065.635022:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575065.635039:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575065.635076:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575065.635108:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575066.275028:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575066.659005:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575066.659005:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575066.659033:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575066.659034:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575066.659054:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788575066.659134:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575067.299007:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575067.682979:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575067.682986:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575067.683018:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575067.683029:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788575067.683038:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575067.683051:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575068.323055:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575068.706937:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575068.706951:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575068.706956:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575068.706977:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575068.706992:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575068.707061:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575069.346973:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575069.730947:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575069.730952:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575069.730977:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575069.730992:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575069.730992:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788575069.731063:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1788575070.370972:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788575070.370976:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788575070.370985:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788575070.370990:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575070.371002:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3416
00000100:00080000:2.0:1788575070.371012:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575070.371021:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575070.371067:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453361169024/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575070.371097:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575070.371101:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575070.371107:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575070.371111:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3416
00000100:00080000:2.0:1788575070.371114:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575070.371117:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575070.371126:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575070.371139:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453361169152/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575070.371153:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788575070.371154:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361169024:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788575070.371162:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575070.371166:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575070.371171:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3416
00000100:00080000:2.0:1788575070.371175:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575070.371179:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575070.371185:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575070.371209:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361169280/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575070.371221:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575070.371225:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575070.371228:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575070.371232:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3416
00000800:00000100:3.0:1788575070.371237:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788575070.371240:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575070.371247:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575070.371252:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575070.371263:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453361169408/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575070.371270:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575070.371273:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575070.371275:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575070.371278:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3416
00000100:00080000:2.0:1788575070.371281:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575070.371283:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575070.371287:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575070.371298:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575070/real 1788575070]  req@ffff8dc020494e00 x1875453361169024/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575095 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575070.371300:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453361169536/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575070.371327:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575070.371333:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:3.0:1788575070.371334:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453361169024/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575095 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575070.371337:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575070.371348:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3416
00000100:00080000:3.0:1788575070.371352:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575070.371354:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575070.371363:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:3.0:1788575070.371363:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000008:00100000:2.0:1788575070.371372:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575070.371373:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361169024:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788575070.371386:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453361169664/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575070.371393:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575070.371395:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575070.371397:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575070.371400:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3416
00000100:00100000:3.0:1788575070.371404:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361169152:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788575070.371405:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575070.371415:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575070.371421:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575070.371436:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453361169792/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788575070.371441:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575070.371478:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575070/real 1788575070]  req@ffff8dc020496d80 x1875453361169152/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575095 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575070.371495:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453361169152/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575095 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575070.371507:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575070.371511:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575070.371515:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361169152:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575070.371521:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361169280:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575070.371544:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575070.371556:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575070/real 1788575070]  req@ffff8dc020494700 x1875453361169280/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575095 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575070.371569:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361169280/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575095 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575070.371579:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575070.371582:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575070.371586:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361169280:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575070.371592:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361169408:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575070.371610:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575070.371618:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575070/real 1788575070]  req@ffff8dc020494380 x1875453361169408/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575095 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575070.371626:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453361169408/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575095 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575070.371632:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575070.371634:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575070.371636:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361169408:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575070.371640:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361169536:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575070.371651:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575070.371657:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575070/real 1788575070]  req@ffff8dc020497100 x1875453361169536/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575095 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575070.371664:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453361169536/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575095 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575070.371670:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575070.371672:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575070.371674:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361169536:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575070.371677:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361169664:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575070.371687:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575070.371697:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575070/real 1788575070]  req@ffff8dc020496a00 x1875453361169664/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575095 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575070.371709:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453361169664/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575095 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575070.371717:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575070.371721:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575070.371724:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361169664:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575070.371745:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361169792:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575070.371764:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575070.371775:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575070/real 1788575070]  req@ffff8dc020494e00 x1875453361169792/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575095 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575070.371788:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453361169792/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575095 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575070.371796:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575070.371799:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575070.371803:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361169792:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575070.754976:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575070.754982:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575070.755014:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575070.755014:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575070.755049:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788575070.755102:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575071.395000:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575071.778990:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575071.778990:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575071.778990:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575071.778998:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575071.779026:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788575071.779082:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575072.418952:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575072.802966:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575072.802982:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575072.803014:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575072.803039:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575072.803041:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788575072.803104:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575073.442981:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575073.826971:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575073.826971:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575073.827092:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788575073.827095:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575073.827107:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575073.827197:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575074.467018:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575074.851036:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575074.851038:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575074.851058:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575074.851059:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575074.851106:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575074.851174:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575075.491020:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575075.491021:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575075.491033:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575075.491038:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575075.491052:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3421
00000100:00080000:1.0:1788575075.491065:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575075.491074:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575075.491125:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361169920/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575075.491158:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575075.491161:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575075.491163:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575075.491168:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3421
00000100:00080000:1.0:1788575075.491171:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575075.491174:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575075.491186:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575075.491211:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361170048/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575075.491223:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788575075.491227:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361169920:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788575075.491229:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575075.491234:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575075.491243:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3421
00000100:00080000:1.0:1788575075.491247:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575075.491252:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575075.491259:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575075.491273:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361170176/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575075.491283:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575075.491287:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575075.491289:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575075.491293:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3421
00000100:00080000:1.0:1788575075.491300:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575075.491304:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575075.491310:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788575075.491314:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575075.491336:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361170304/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575075.491347:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575075.491351:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575075.491353:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575075.491358:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3421
00000100:00080000:1.0:1788575075.491363:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788575075.491364:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575075/real 1788575075]  req@ffff8dc005dc3800 x1875453361169920/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575100 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575075.491372:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575075.491381:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575075.491386:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361169920/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575100 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575075.491396:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361170432/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575075.491397:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575075.491407:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575075.491415:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361169920:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788575075.491418:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575075.491424:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575075.491427:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575075.491433:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3421
00000100:00080000:1.0:1788575075.491437:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788575075.491443:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361170048:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788575075.491445:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575075.491455:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575075.491469:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361170560/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788575075.491471:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575075.491485:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575075/real 1788575075]  req@ffff8dc005dc0700 x1875453361170048/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575100 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575075.491486:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575075.491497:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575075.491502:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788575075.491507:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361170048/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575100 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575075.491508:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3421
00000100:00080000:1.0:1788575075.491517:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575075.491526:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:3.0:1788575075.491535:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:1.0:1788575075.491536:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788575075.491558:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575075.491563:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361170048:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788575075.491568:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361170688/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575075.491573:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361170176:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575075.491601:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575075.491611:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575075/real 1788575075]  req@ffff8dc005dc2d80 x1875453361170176/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575100 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575075.491620:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361170176/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575100 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575075.491627:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575075.491630:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575075.491632:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361170176:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575075.491636:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361170304:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575075.491647:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575075.491653:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575075/real 1788575075]  req@ffff8dc005dc3b80 x1875453361170304/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575100 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575075.491661:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361170304/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575100 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575075.491666:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575075.491668:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575075.491671:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361170304:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575075.491675:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361170432:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575075.491687:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575075.491693:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575075/real 1788575075]  req@ffff8dc005dc0a80 x1875453361170432/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575100 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575075.491700:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361170432/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575100 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575075.491706:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575075.491708:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575075.491709:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361170432:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575075.491721:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361170560:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575075.491733:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575075.491739:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575075/real 1788575075]  req@ffff8dc005dc1180 x1875453361170560/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575100 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575075.491747:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361170560/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575100 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575075.491752:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575075.491754:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575075.491755:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361170560:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575075.491759:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361170688:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575075.491769:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575075.491775:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575075/real 1788575075]  req@ffff8dc005dc1500 x1875453361170688/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575100 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575075.491783:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361170688/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575100 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575075.491788:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575075.491790:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575075.491792:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361170688:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575075.875027:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575075.875029:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575075.875030:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575075.875086:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788575075.875092:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575075.875107:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575076.515031:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575076.898999:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575076.899008:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575076.899020:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575076.899020:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575076.899063:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575076.899132:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575077.539013:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575077.922998:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575077.923029:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788575077.923036:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575077.923063:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575077.923069:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575077.923083:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575078.563036:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575078.947001:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575078.947001:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575078.947008:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575078.947020:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575078.947036:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575078.947126:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575079.587013:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575079.971034:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575079.971041:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575079.971066:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788575079.971100:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575079.971109:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575079.971141:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575080.610961:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788575080.610975:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575080.610976:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575080.610981:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575080.610994:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3426
00000100:00080000:1.0:1788575080.611008:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575080.611017:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575080.611066:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361170816/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575080.611096:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575080.611100:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575080.611101:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575080.611104:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3426
00000100:00080000:1.0:1788575080.611107:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575080.611111:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575080.611122:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575080.611135:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361170944/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575080.611140:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361170816:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788575080.611145:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575080.611149:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575080.611150:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575080.611154:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3426
00000100:00080000:1.0:1788575080.611156:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575080.611158:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575080.611162:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575080.611171:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361171072/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575080.611176:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575080.611179:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575080.611180:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575080.611183:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3426
00000100:00080000:1.0:1788575080.611184:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575080.611187:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575080.611190:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575080.611196:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361171200/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575080.611201:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575080.611204:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575080.611211:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575080.611216:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3426
00000800:00000100:3.0:1788575080.611217:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788575080.611220:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575080.611224:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575080.611227:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575080.611234:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361171328/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575080.611240:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575080.611243:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575080.611244:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575080.611247:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3426
00000100:00080000:1.0:1788575080.611251:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575080.611253:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575080.611256:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575080.611263:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361171456/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575080.611268:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575080.611271:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575080.611273:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575080.611276:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3426
00000100:00080000:1.0:1788575080.611279:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788575080.611279:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575080/real 1788575080]  req@ffff8dc005dc1c00 x1875453361170816/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575105 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575080.611283:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575080.611288:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575080.611304:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361171584/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575080.611309:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361170816/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575105 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575080.611318:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575080.611324:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575080.611327:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361170816:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788575080.611350:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361170944:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575080.611369:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575080.611378:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575080/real 1788575080]  req@ffff8dc005dc1500 x1875453361170944/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575105 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575080.611385:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361170944/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575105 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575080.611393:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575080.611395:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575080.611396:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361170944:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575080.611400:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361171072:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575080.611412:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575080.611417:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575080/real 1788575080]  req@ffff8dc005dc1180 x1875453361171072/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575105 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575080.611423:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361171072/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575105 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575080.611429:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575080.611430:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575080.611432:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361171072:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575080.611435:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361171200:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575080.611445:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575080.611450:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575080/real 1788575080]  req@ffff8dc005dc0a80 x1875453361171200/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575105 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575080.611463:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361171200/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575105 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575080.611471:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575080.611474:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575080.611477:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361171200:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575080.611482:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361171328:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575080.611501:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575080.611512:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575080/real 1788575080]  req@ffff8dc005dc3b80 x1875453361171328/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575105 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575080.611524:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361171328/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575105 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575080.611530:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575080.611532:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575080.611534:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361171328:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575080.611538:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361171456:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575080.611552:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575080.611559:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575080/real 1788575080]  req@ffff8dc005dc2d80 x1875453361171456/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575105 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575080.611565:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361171456/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575105 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575080.611574:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575080.611576:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575080.611578:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361171456:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575080.611581:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361171584:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575080.611590:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575080.611595:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575080/real 1788575080]  req@ffff8dc005dc0700 x1875453361171584/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575105 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575080.611601:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361171584/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575105 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575080.611606:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575080.611608:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575080.611609:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361171584:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575080.995002:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575080.995004:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575080.995008:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575080.995036:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575080.995042:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575080.995053:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575081.635002:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575082.018973:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575082.018980:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575082.018981:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575082.019014:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575082.019017:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575082.019036:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575082.658960:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575083.043007:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575083.043011:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575083.043014:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788575083.043045:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575083.043046:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575083.043058:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575083.682983:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575084.066995:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575084.067001:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575084.067003:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575084.067037:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575084.067054:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788575084.067094:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575084.706957:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575085.091003:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575085.091004:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575085.091004:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575085.091043:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575085.091054:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575085.091064:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575085.730993:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788575085.730998:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575085.731006:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788575085.731010:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575085.731019:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3431
00000100:00080000:2.0:1788575085.731030:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575085.731038:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575085.731082:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361171712/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575085.731113:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575085.731117:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575085.731119:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575085.731123:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3431
00000100:00080000:2.0:1788575085.731127:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575085.731131:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575085.731144:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575085.731155:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361171712:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788575085.731160:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453361171840/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575085.731173:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575085.731177:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575085.731178:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575085.731181:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3431
00000100:00080000:2.0:1788575085.731184:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575085.731187:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575085.731192:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575085.731201:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361171968/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575085.731207:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575085.731210:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575085.731212:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575085.731214:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3431
00000100:00080000:2.0:1788575085.731217:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575085.731219:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575085.731222:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575085.731230:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361172096/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575085.731236:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575085.731238:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575085.731239:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575085.731242:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3431
00000100:00080000:2.0:1788575085.731244:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575085.731246:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575085.731249:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575085.731255:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453361172224/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575085.731260:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575085.731263:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575085.731265:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575085.731268:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3431
00000100:00080000:2.0:1788575085.731270:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575085.731272:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575085.731276:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575085.731280:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361171840:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575085.731285:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361172352/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575085.731292:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575085.731294:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575085.731295:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575085.731298:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3431
00000100:00080000:2.0:1788575085.731300:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575085.731303:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575085.731306:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575085.731314:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453361172480/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575085.731316:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361171968:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575085.731341:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361172096:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575085.731354:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361172224:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575085.731368:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361172352:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575085.731386:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361172480:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575086.115018:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575086.115018:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575086.115158:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575086.115172:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575086.115231:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788575086.115274:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575086.755019:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575087.138999:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575087.138999:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575087.138999:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575087.139035:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575087.139048:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575087.139059:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575087.778996:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575088.162984:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575088.162984:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788575088.163048:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575088.163056:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575088.163074:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575088.163079:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575088.803004:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000400:00000100:1.0:1788575088.803180:0:2336:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.140:988
00000400:00000100:1.0:1788575088.803222:0:2336:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.140@tcp at host 192.168.202.140 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:1.0:1788575088.803239:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788575088.803290:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788575088.803299:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788575088.803309:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788575088.803318:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788575088.803326:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788575088.803336:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:3.0:1788575088.803347:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575085/real 1788575088]  req@ffff8dc020495500 x1875453361172352/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575110 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575088.803376:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361172352/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575110 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575088.803390:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575088.803395:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575088.803400:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361172352:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575088.803408:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575085/real 1788575088]  req@ffff8dc020494e00 x1875453361172480/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575110 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575088.803421:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453361172480/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575110 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575088.803429:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575088.803433:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575088.803436:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361172480:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575088.803442:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575085/real 1788575088]  req@ffff8dc020494a80 x1875453361171840/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575110 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575088.803454:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453361171840/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575110 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575088.803464:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575088.803468:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575088.803471:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361171840:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575088.803477:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575085/real 1788575088]  req@ffff8dc020495180 x1875453361171968/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575110 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575088.803488:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361171968/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575110 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575088.803497:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575088.803501:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575088.803504:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361171968:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575088.803511:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575085/real 1788575088]  req@ffff8dc020495880 x1875453361172096/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575110 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575088.803522:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361172096/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575110 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575088.803530:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575088.803534:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575088.803536:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361172096:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575088.803544:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575085/real 1788575088]  req@ffff8dc020497480 x1875453361172224/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575110 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575088.803554:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453361172224/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575110 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575088.803562:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575088.803565:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575088.803568:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361172224:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575088.803574:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575085/real 1788575088]  req@ffff8dc020494000 x1875453361171712/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575110 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575088.803586:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361171712/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575110 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575088.803593:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575088.803596:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575088.803599:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361171712:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788575089.187006:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575089.187209:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575089.187222:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575089.187270:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788575089.187299:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575089.187308:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575089.826984:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575090.210960:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575090.210960:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575090.210971:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575090.210994:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788575090.211018:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575090.211023:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575090.851491:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575090.851500:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:2.0:1788575090.851501:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575090.851510:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575090.851526:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3436
00000100:00080000:1.0:1788575090.851540:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575090.851550:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575090.851595:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361172608/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575090.851622:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575090.851626:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575090.851628:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575090.851633:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3436
00000100:00080000:1.0:1788575090.851636:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575090.851641:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575090.851655:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575090.851666:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361172608:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788575090.851671:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361172736/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575090.851683:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575090.851687:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575090.851688:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575090.851693:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3436
00000100:00080000:1.0:1788575090.851696:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575090.851699:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575090.851704:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575090.851715:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361172864/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575090.851724:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575090.851728:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575090.851730:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575090.851747:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3436
00000100:00080000:1.0:1788575090.851753:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1788575090.851758:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788575090.851761:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575090.851769:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575090.851784:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361172992/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575090.851793:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575090.851808:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575090.851810:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575090.851815:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3436
00000100:00080000:1.0:1788575090.851819:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575090.851824:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575090.851831:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575090.851836:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575090/real 1788575090]  req@ffff8dc005dc3800 x1875453361172608/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575115 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575090.851845:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361173120/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575090.851857:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575090.851860:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575090.851862:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575090.851888:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3436
00000100:00080000:1.0:1788575090.851892:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575090.851896:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575090.851902:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575090.851908:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361172608/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575115 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575090.851915:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361173248/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575090.851925:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575090.851930:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575090.851932:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788575090.851938:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:3.0:1788575090.851939:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361172608:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788575090.851942:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575090.851949:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3436
00000100:00080000:1.0:1788575090.851954:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575090.851960:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575090.851967:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575090.851977:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361172736:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788575090.851982:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361173376/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788575090.852008:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575090.852022:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575090/real 1788575090]  req@ffff8dc005dc0700 x1875453361172736/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575115 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575090.852034:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361172736/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575115 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575090.852062:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575090.852066:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575090.852070:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361172736:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575090.852309:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361172864:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575090.852339:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575090.852352:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575090/real 1788575090]  req@ffff8dc005dc2d80 x1875453361172864/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575115 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575090.852364:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361172864/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575115 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575090.852371:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575090.852374:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575090.852376:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361172864:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575090.852381:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361172992:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575090.852402:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575090.852413:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575090/real 1788575090]  req@ffff8dc005dc3b80 x1875453361172992/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575115 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575090.852429:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361172992/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575115 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575090.852438:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575090.852441:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575090.852444:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361172992:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575090.852450:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361173120:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575090.852471:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575090.852482:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575090/real 1788575090]  req@ffff8dc005dc0a80 x1875453361173120/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575115 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575090.852492:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361173120/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575115 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575090.852501:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575090.852504:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575090.852506:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361173120:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575090.852511:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361173248:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575090.852528:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575090.852539:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575090/real 1788575090]  req@ffff8dc005dc1180 x1875453361173248/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575115 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575090.852550:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361173248/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575115 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575090.852564:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575090.852567:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575090.852570:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361173248:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575090.852591:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361173376:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575090.852611:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575090.852621:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575090/real 1788575090]  req@ffff8dc005dc1500 x1875453361173376/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575115 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575090.852633:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361173376/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575115 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575090.852641:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575090.852644:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575090.852647:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361173376:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575091.235010:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575091.235010:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575091.235010:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788575091.235560:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575091.235580:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575091.235589:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575091.875002:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575092.258932:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575092.258958:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575092.258959:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575092.258969:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575092.258976:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575092.258982:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575092.898982:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575093.282962:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575093.282962:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575093.282962:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575093.282996:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575093.283025:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788575093.283076:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575093.922920:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575094.306939:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575094.306955:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575094.306961:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575094.306968:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575094.306972:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575094.306980:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575094.946969:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575095.330974:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575095.330974:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575095.330974:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575095.330990:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575095.331003:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788575095.331068:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575095.970979:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575095.970983:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575095.970991:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788575095.970995:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575095.971004:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3441
00000100:00080000:0.0:1788575095.971014:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575095.971021:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575095.971057:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361173504/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575095.971077:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575095.971080:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575095.971082:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575095.971084:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3441
00000100:00080000:0.0:1788575095.971087:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575095.971090:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575095.971097:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575095.971106:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361173632/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575095.971112:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575095.971114:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575095.971115:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575095.971118:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3441
00000100:00080000:0.0:1788575095.971121:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575095.971127:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575095.971128:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361173504:192.168.202.140@tcp:250:kworker.0
00000008:00100000:0.0:1788575095.971135:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575095.971151:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453361173760/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575095.971160:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575095.971163:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575095.971165:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575095.971169:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3441
00000100:00080000:0.0:1788575095.971172:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575095.971177:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575095.971181:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788575095.971190:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575095.971195:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361173888/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575095.971211:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575095.971214:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575095.971216:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575095.971220:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3441
00000100:00080000:0.0:1788575095.971224:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575095.971228:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575095.971237:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575095/real 1788575095]  req@ffff8dc006713480 x1875453361173504/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575120 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1788575095.971241:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575095.971258:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361174016/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575095.971264:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361173504/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575120 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575095.971270:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575095.971278:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575095.971282:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575095.971285:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575095.971286:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3441
00000100:00080000:0.0:1788575095.971293:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575095.971295:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788575095.971299:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575095.971304:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575095.971304:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361173504:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788575095.971317:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361174144/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575095.971318:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361173632:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788575095.971331:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575095.971334:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575095.971335:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575095.971338:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3441
00000100:00080000:0.0:1788575095.971341:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575095.971344:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575095.971347:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788575095.971353:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575095.971356:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361174272/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575095.971369:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575095/real 1788575095]  req@ffff8dc006712680 x1875453361173632/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575120 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575095.971382:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361173632/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575120 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575095.971393:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575095.971396:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575095.971399:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361173632:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575095.971420:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361173760:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575095.971438:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575095.971448:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575095/real 1788575095]  req@ffff8dc006710380 x1875453361173760/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575120 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575095.971458:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453361173760/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575120 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575095.971466:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575095.971469:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575095.971472:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361173760:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575095.971477:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361173888:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575095.971492:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575095.971501:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575095/real 1788575095]  req@ffff8dc006712300 x1875453361173888/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575120 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575095.971511:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361173888/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575120 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575095.971519:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575095.971522:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575095.971525:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361173888:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575095.971530:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361174016:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575095.971545:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575095.971553:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575095/real 1788575095]  req@ffff8dc006711c00 x1875453361174016/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575120 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575095.971563:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361174016/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575120 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575095.971571:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575095.971574:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575095.971577:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361174016:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575095.971582:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361174144:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575095.971599:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575095.971608:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575095/real 1788575095]  req@ffff8dc006711500 x1875453361174144/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575120 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575095.971619:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361174144/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575120 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575095.971625:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575095.971628:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575095.971630:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361174144:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575095.971635:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361174272:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575095.971651:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575095.971671:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575095/real 1788575095]  req@ffff8dc006713800 x1875453361174272/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575120 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575095.971682:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361174272/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575120 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575095.971689:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575095.971693:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575095.971696:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361174272:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575096.354978:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575096.354978:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575096.354994:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575096.355017:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575096.355022:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788575096.355041:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575096.994978:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575097.378962:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575097.378989:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575097.378990:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575097.379006:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575097.379024:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788575097.379048:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575098.018989:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575098.402986:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575098.402986:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575098.402992:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575098.403015:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575098.403018:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575098.403020:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575099.043014:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575099.426923:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575099.426959:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575099.426969:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575099.426987:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575099.426992:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575099.426996:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575100.066989:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575100.450976:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575100.450976:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575100.450979:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575100.451007:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575100.451009:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575100.451024:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575101.090978:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575101.090986:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575101.090992:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788575101.090995:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575101.091002:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3446
00000100:00080000:0.0:1788575101.091012:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575101.091019:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575101.091051:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361174400/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575101.091074:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575101.091076:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575101.091078:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575101.091082:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3446
00000100:00080000:0.0:1788575101.091085:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575101.091088:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575101.091098:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575101.091110:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361174528/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575101.091120:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575101.091124:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575101.091126:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575101.091131:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3446
00000100:00080000:0.0:1788575101.091134:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575101.091137:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575101.091141:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575101.091147:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361174400:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788575101.091156:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361174656/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575101.091164:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575101.091166:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575101.091168:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575101.091172:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3446
00000100:00080000:0.0:1788575101.091175:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575101.091180:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575101.091183:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575101.091189:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361174784/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575101.091194:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575101.091196:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575101.091198:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575101.091201:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3446
00000100:00080000:0.0:1788575101.091206:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575101.091210:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575101.091213:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575101.091219:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361174912/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575101.091225:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575101.091227:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575101.091228:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575101.091233:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3446
00000800:00000100:3.0:1788575101.091239:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788575101.091241:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575101.091246:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575101.091249:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575101.091259:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361175040/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575101.091265:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575101.091266:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575101.091267:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575101.091270:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3446
00000100:00080000:0.0:1788575101.091272:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575101.091274:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575101.091279:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575101.091292:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575101/real 1788575101]  req@ffff8dc006711880 x1875453361174400/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575126 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575101.091297:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361175168/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575101.091323:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361174400/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575126 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575101.091334:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575101.091338:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575101.091341:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361174400:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788575101.091348:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361174528:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575101.091367:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575101.091375:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575101/real 1788575101]  req@ffff8dc006712a00 x1875453361174528/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575126 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575101.091383:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361174528/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575126 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575101.091389:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575101.091392:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575101.091394:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361174528:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575101.091415:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361174656:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575101.091427:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575101.091432:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575101/real 1788575101]  req@ffff8dc006710e00 x1875453361174656/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575126 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575101.091439:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361174656/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575126 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575101.091445:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575101.091447:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575101.091449:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361174656:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575101.091453:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361174784:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575101.091462:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575101.091468:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575101/real 1788575101]  req@ffff8dc006713100 x1875453361174784/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575126 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575101.091474:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361174784/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575126 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575101.091479:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575101.091481:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575101.091483:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361174784:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575101.091486:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361174912:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575101.091496:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575101.091501:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575101/real 1788575101]  req@ffff8dc006713b80 x1875453361174912/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575126 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575101.091508:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361174912/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575126 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575101.091513:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575101.091515:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575101.091516:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361174912:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575101.091520:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361175040:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575101.091529:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575101.091534:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575101/real 1788575101]  req@ffff8dc006713800 x1875453361175040/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575126 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575101.091541:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361175040/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575126 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575101.091544:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575101.091546:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575101.091548:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361175040:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575101.091551:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361175168:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575101.091560:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575101.091565:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575101/real 1788575101]  req@ffff8dc006711500 x1875453361175168/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575126 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575101.091571:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361175168/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575126 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575101.091576:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575101.091578:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575101.091579:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361175168:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575101.475022:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575101.475022:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575101.475028:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575101.475064:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575101.475090:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575101.475090:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575102.114978:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575102.499055:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575102.499072:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575102.499303:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575102.499318:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575102.499353:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575102.499403:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575103.138994:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575103.522965:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575103.522965:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575103.522965:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575103.523017:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575103.523038:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575103.523047:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575104.163008:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575104.546962:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575104.546962:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575104.546962:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575104.546991:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788575104.547009:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575104.547014:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575105.186975:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575105.570963:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575105.570963:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575105.570963:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575105.570990:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575105.570995:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575105.571003:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575106.210911:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575106.210917:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575106.210922:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788575106.210925:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575106.210933:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3451
00000100:00080000:0.0:1788575106.210941:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575106.210946:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575106.210973:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361175296/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575106.210994:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575106.210997:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575106.210998:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575106.211000:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3451
00000100:00080000:0.0:1788575106.211002:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575106.211004:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575106.211011:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575106.211019:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361175424/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575106.211026:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575106.211028:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575106.211029:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575106.211031:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3451
00000100:00080000:0.0:1788575106.211033:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575106.211035:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575106.211039:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575106.211042:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361175296:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788575106.211048:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453361175552/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575106.211070:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575106.211073:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575106.211074:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575106.211076:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3451
00000100:00080000:0.0:1788575106.211079:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575106.211081:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575106.211085:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575106.211099:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361175680/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575106.211104:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575106.211107:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575106.211110:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1788575106.211111:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788575106.211113:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3451
00000100:00080000:0.0:1788575106.211116:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575106.211122:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575106.211125:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575106.211132:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361175808/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575106.211139:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575106.211141:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575106.211142:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575106.211144:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3451
00000100:00080000:0.0:1788575106.211146:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575106.211148:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575106.211150:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575106.211158:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361175936/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575106.211163:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575106/real 1788575106]  req@ffff8dc006711c00 x1875453361175296/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575131 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575106.211165:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575106.211173:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575106.211176:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575106.211181:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3451
00000100:00080000:0.0:1788575106.211185:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575106.211187:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575106.211190:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575106.211196:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361175296/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575131 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575106.211197:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361176064/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575106.211228:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575106.211235:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575106.211241:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361175296:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788575106.211249:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361175424:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575106.211269:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575106.211278:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575106/real 1788575106]  req@ffff8dc006712300 x1875453361175424/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575131 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575106.211286:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361175424/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575131 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575106.211293:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575106.211295:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575106.211297:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361175424:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575106.211312:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361175552:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575106.211324:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575106.211329:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575106/real 1788575106]  req@ffff8dc006710380 x1875453361175552/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575131 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575106.211336:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453361175552/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575131 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575106.211345:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575106.211347:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575106.211349:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361175552:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575106.211352:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361175680:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575106.211360:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575106.211365:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575106/real 1788575106]  req@ffff8dc006712680 x1875453361175680/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575131 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575106.211371:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361175680/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575131 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575106.211376:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575106.211378:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575106.211379:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361175680:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575106.211382:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361175808:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575106.211391:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575106.211396:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575106/real 1788575106]  req@ffff8dc006713480 x1875453361175808/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575131 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575106.211403:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361175808/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575131 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575106.211407:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575106.211409:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575106.211411:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361175808:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575106.211414:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361175936:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575106.211423:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575106.211428:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575106/real 1788575106]  req@ffff8dc006711500 x1875453361175936/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575131 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575106.211433:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361175936/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575131 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575106.211438:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575106.211440:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575106.211441:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361175936:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575106.211444:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361176064:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575106.211452:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575106.211457:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575106/real 1788575106]  req@ffff8dc006713800 x1875453361176064/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575131 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575106.211464:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361176064/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575131 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575106.211468:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575106.211469:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575106.211471:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361176064:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575106.595020:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575106.595020:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575106.595020:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575106.595020:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575106.595078:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788575106.595137:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575107.235029:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575107.618967:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575107.618971:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575107.619001:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575107.619001:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575107.619026:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575107.619121:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575108.258981:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575108.643008:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575108.643009:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575108.643010:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575108.643030:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575108.643058:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788575108.643146:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575109.282968:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575109.666996:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575109.667056:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575109.667127:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575109.667283:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575109.667337:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575109.667380:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575110.306989:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575110.691000:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788575110.691019:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575110.691020:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575110.691046:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575110.691061:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575110.691080:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00080000:0.0:1788575111.330945:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575111.330953:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788575111.330957:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575111.330964:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3456
00000100:00100000:2.0:1788575111.330964:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575111.330975:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575111.330981:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575111.331011:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361176192/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575111.331028:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575111.331031:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575111.331032:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575111.331035:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3456
00000100:00080000:0.0:1788575111.331037:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575111.331039:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575111.331046:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575111.331053:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361176320/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575111.331059:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575111.331061:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575111.331063:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575111.331065:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3456
00000100:00080000:0.0:1788575111.331066:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575111.331069:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575111.331072:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575111.331078:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361176448/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575111.331084:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575111.331086:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575111.331088:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788575111.331089:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361176192:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788575111.331092:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3456
00000100:00080000:0.0:1788575111.331097:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575111.331099:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575111.331102:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575111.331110:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361176576/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575111.331115:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575111.331117:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575111.331119:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575111.331121:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3456
00000100:00080000:0.0:1788575111.331132:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575111.331136:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575111.331153:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788575111.331164:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575111.331166:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361176704/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575111.331178:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575111.331182:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575111.331183:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575111.331188:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3456
00000100:00080000:0.0:1788575111.331192:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575111.331195:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575111.331199:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575111/real 1788575111]  req@ffff8dc006713b80 x1875453361176192/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575136 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1788575111.331200:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575111.331215:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361176832/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575111.331223:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361176192/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575136 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575111.331240:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575111.331241:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575111.331246:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788575111.331248:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:3.0:1788575111.331251:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361176192:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788575111.331252:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788575111.331258:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361176320:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788575111.331259:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3456
00000100:00080000:0.0:1788575111.331264:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575111.331267:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575111.331272:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788575111.331280:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575111.331285:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361176960/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575111.331291:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575111/real 1788575111]  req@ffff8dc006713100 x1875453361176320/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575136 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575111.331300:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361176320/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575136 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575111.331308:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575111.331310:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575111.331313:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361176320:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575111.331330:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361176448:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575111.331342:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575111.331348:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575111/real 1788575111]  req@ffff8dc006710e00 x1875453361176448/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575136 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575111.331354:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361176448/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575136 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575111.331360:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575111.331361:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575111.331363:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361176448:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575111.331366:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361176576:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575111.331375:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575111.331380:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575111/real 1788575111]  req@ffff8dc006712a00 x1875453361176576/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575136 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575111.331387:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361176576/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575136 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575111.331392:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575111.331393:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575111.331395:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361176576:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575111.331398:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361176704:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575111.331406:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575111.331411:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575111/real 1788575111]  req@ffff8dc006711880 x1875453361176704/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575136 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575111.331417:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361176704/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575136 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575111.331422:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575111.331424:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575111.331426:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361176704:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575111.331429:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361176832:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575111.331437:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575111.331443:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575111/real 1788575111]  req@ffff8dc006713800 x1875453361176832/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575136 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575111.331449:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361176832/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575136 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575111.331453:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575111.331455:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575111.331456:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361176832:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575111.331459:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361176960:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575111.331467:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575111.331471:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575111/real 1788575111]  req@ffff8dc006711500 x1875453361176960/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575136 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575111.331478:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361176960/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575136 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575111.331486:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575111.331488:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575111.331489:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361176960:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575111.714933:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575111.714946:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575111.714948:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575111.714965:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575111.714982:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575111.715004:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575112.354968:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575112.738923:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575112.738936:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575112.738951:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575112.738966:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575112.738970:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788575112.739004:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575113.378944:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575113.762968:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575113.762968:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575113.763009:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575113.763063:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575113.763089:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575113.763109:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575114.403014:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575114.786949:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575114.786949:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575114.786952:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575114.786963:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575114.786979:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788575114.787025:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575115.426957:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575115.810969:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575115.810969:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575115.810969:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575115.810969:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575115.811001:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575115.811039:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575116.450989:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788575116.450989:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575116.450997:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788575116.451001:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575116.451011:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3462
00000100:00080000:3.0:1788575116.451021:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575116.451028:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575116.451064:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f100 x1875453361177088/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575116.451088:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575116.451091:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575116.451094:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575116.451097:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3462
00000100:00080000:3.0:1788575116.451101:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575116.451104:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575116.451108:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361177088:192.168.202.140@tcp:250:kworker.0
00000008:00100000:3.0:1788575116.451113:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575116.451123:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d880 x1875453361177216/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575116.451130:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575116.451132:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575116.451134:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575116.451136:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3462
00000100:00080000:3.0:1788575116.451138:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575116.451140:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575116.451143:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575116.451149:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644fb80 x1875453361177344/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575116.451154:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575116.451156:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575116.451158:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575116.451160:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3462
00000100:00080000:3.0:1788575116.451162:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575116.451164:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575116.451167:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575116.451175:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ed80 x1875453361177472/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788575116.451178:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788575116.451186:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575116.451188:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575116.451190:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575116.451193:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3462
00000100:00080000:3.0:1788575116.451196:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575116.451199:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575116.451202:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575116.451209:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644df80 x1875453361177600/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575116.451215:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575116.451217:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575116.451218:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575116.451221:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3462
00000100:00080000:3.0:1788575116.451236:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575116.451239:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575116.451242:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575116.451249:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e300 x1875453361177728/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575116.451254:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575116/real 1788575116]  req@ffff8dc00644f100 x1875453361177088/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575141 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575116.451256:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575116.451263:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575116.451265:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575116.451271:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3462
00000100:00080000:3.0:1788575116.451276:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575116.451279:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575116.451281:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575116.451289:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f100 x1875453361177088/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575141 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575116.451292:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c700 x1875453361177856/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575116.451311:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575116.451315:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575116.451320:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361177088:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788575116.451340:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361177216:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575116.451372:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575116.451386:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575116/real 1788575116]  req@ffff8dc00644d880 x1875453361177216/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575141 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575116.451399:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d880 x1875453361177216/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575141 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575116.451408:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575116.451411:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575116.451414:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361177216:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575116.451420:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361177344:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575116.451440:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575116.451451:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575116/real 1788575116]  req@ffff8dc00644fb80 x1875453361177344/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575141 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575116.451463:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644fb80 x1875453361177344/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575141 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575116.451472:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575116.451475:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575116.451478:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361177344:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575116.451483:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361177472:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575116.451502:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575116.451513:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575116/real 1788575116]  req@ffff8dc00644ed80 x1875453361177472/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575141 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575116.451524:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ed80 x1875453361177472/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575141 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575116.451533:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575116.451542:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575116.451545:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361177472:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575116.451549:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361177600:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575116.451563:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575116.451570:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575116/real 1788575116]  req@ffff8dc00644df80 x1875453361177600/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575141 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575116.451582:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644df80 x1875453361177600/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575141 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575116.451587:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575116.451589:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575116.451591:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361177600:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575116.451595:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361177728:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575116.451605:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575116.451611:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575116/real 1788575116]  req@ffff8dc00644e300 x1875453361177728/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575141 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575116.451618:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453361177728/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575141 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575116.451622:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575116.451623:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575116.451625:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361177728:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575116.451628:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361177856:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575116.451639:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575116.451648:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575116/real 1788575116]  req@ffff8dc00644c700 x1875453361177856/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575141 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575116.451658:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453361177856/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575141 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575116.451666:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575116.451669:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575116.451671:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361177856:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575116.834953:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575116.834953:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575116.834958:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575116.834964:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575116.834985:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788575116.835064:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575117.474964:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575117.858981:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575117.858981:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575117.858981:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575117.859078:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575117.859089:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575117.859117:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575118.498985:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575118.882947:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575118.882947:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575118.882947:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575118.882952:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575118.882973:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788575118.883033:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575119.522946:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575119.906962:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575119.906962:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575119.906963:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575119.906988:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575119.907001:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575119.907002:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575120.546967:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575120.930942:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575120.930963:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575120.930965:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575120.930983:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575120.931003:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575120.931024:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1788575121.570960:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788575121.570967:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788575121.570969:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788575121.570975:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575121.570986:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3467
00000100:00080000:3.0:1788575121.570996:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575121.571002:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575121.571036:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e680 x1875453361177984/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575121.571060:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575121.571062:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575121.571064:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575121.571067:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3467
00000100:00080000:3.0:1788575121.571070:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575121.571074:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575121.571082:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575121.571093:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d180 x1875453361178112/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575121.571097:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361177984:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788575121.571109:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575121.571113:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575121.571114:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575121.571118:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3467
00000100:00080000:3.0:1788575121.571122:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575121.571125:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575121.571129:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575121.571141:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f480 x1875453361178240/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575121.571149:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575121.571152:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575121.571154:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575121.571157:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3467
00000100:00080000:3.0:1788575121.571159:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575121.571164:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:2.0:1788575121.571167:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:3.0:1788575121.571169:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575121.571181:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c380 x1875453361178368/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575121.571189:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575121.571192:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575121.571193:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575121.571197:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3467
00000100:00080000:3.0:1788575121.571200:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575121.571204:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575121.571209:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575121/real 1788575121]  req@ffff8dc00644e680 x1875453361177984/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575146 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1788575121.571210:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575121.571228:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453361177984/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575146 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575121.571230:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d500 x1875453361178496/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575121.571241:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575121.571245:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575121.571247:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575121.571253:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361177984:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788575121.571253:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575121.571256:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575121.571262:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3467
00000100:00080000:3.0:1788575121.571265:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575121.571268:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575121.571272:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575121.571275:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361178112:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575121.571285:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ea00 x1875453361178624/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788575121.571294:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788575121.571295:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575121.571300:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575121.571302:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575121.571307:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3467
00000100:00100000:2.0:1788575121.571308:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575121/real 1788575121]  req@ffff8dc00644d180 x1875453361178112/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575146 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575121.571322:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575121.571329:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575121.571335:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453361178112/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575146 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1788575121.571335:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1788575121.571347:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1788575121.571351:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ca80 x1875453361178752/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575121.571358:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575121.571366:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361178112:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575121.571373:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361178240:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575121.571396:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575121.571407:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575121/real 1788575121]  req@ffff8dc00644f480 x1875453361178240/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575146 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575121.571417:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453361178240/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575146 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575121.571423:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575121.571424:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575121.571426:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361178240:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575121.571430:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361178368:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575121.571443:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575121.571449:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575121/real 1788575121]  req@ffff8dc00644c380 x1875453361178368/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575146 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575121.571455:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453361178368/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575146 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575121.571460:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575121.571462:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575121.571463:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361178368:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575121.571466:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361178496:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575121.571475:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575121.571481:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575121/real 1788575121]  req@ffff8dc00644d500 x1875453361178496/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575146 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575121.571498:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d500 x1875453361178496/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575146 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575121.571504:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575121.571506:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575121.571508:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361178496:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575121.571518:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361178624:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575121.571529:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575121.571535:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575121/real 1788575121]  req@ffff8dc00644ea00 x1875453361178624/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575146 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575121.571541:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ea00 x1875453361178624/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575146 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575121.571546:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575121.571547:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575121.571549:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361178624:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575121.571552:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361178752:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575121.571560:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575121.571565:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575121/real 1788575121]  req@ffff8dc00644ca80 x1875453361178752/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575146 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575121.571571:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ca80 x1875453361178752/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575146 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575121.571579:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575121.571580:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575121.571582:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361178752:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575121.954969:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575121.954969:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575121.954994:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575121.954997:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575121.955022:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575121.955023:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575122.594971:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575122.978972:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575122.978973:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575122.978977:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788575122.978996:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575122.979002:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575122.979022:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575123.618930:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575124.002972:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575124.002972:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575124.002979:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575124.003000:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575124.003004:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575124.003005:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575124.642963:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575125.027042:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575125.027043:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575125.027050:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788575125.027075:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575125.027093:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575125.027093:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575125.666944:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575126.050972:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575126.050972:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575126.050972:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575126.050989:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575126.050998:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575126.051004:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575126.690977:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788575126.690977:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575126.690991:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788575126.690996:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575126.691008:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3472
00000100:00080000:3.0:1788575126.691020:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575126.691027:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575126.691065:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644dc00 x1875453361178880/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575126.691099:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575126.691103:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575126.691105:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575126.691112:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3472
00000100:00080000:3.0:1788575126.691117:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575126.691123:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575126.691136:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575126.691143:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361178880:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788575126.691153:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c000 x1875453361179008/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575126.691164:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575126.691167:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575126.691169:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575126.691174:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3472
00000100:00080000:3.0:1788575126.691178:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575126.691182:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575126.691187:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575126.691199:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f800 x1875453361179136/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575126.691208:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575126.691211:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575126.691212:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575126.691216:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3472
00000100:00080000:3.0:1788575126.691219:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575126.691221:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575126.691224:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575126.691233:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ce00 x1875453361179264/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1788575126.691236:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788575126.691246:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575126.691250:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575126.691252:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575126.691258:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3472
00000100:00080000:3.0:1788575126.691261:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575126.691266:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575126.691285:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575126/real 1788575126]  req@ffff8dc00644dc00 x1875453361178880/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575151 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575126.691306:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644dc00 x1875453361178880/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575151 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575126.691319:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575126.691324:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575126.691329:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361178880:192.168.202.140@tcp:250:kworker.0
00000008:00100000:3.0:1788575126.691333:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575126.691346:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ca80 x1875453361179392/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575126.691353:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575126.691356:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575126.691358:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788575126.691359:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361179008:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788575126.691364:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3472
00000100:00080000:3.0:1788575126.691369:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575126.691372:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575126.691375:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575126.691383:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ea00 x1875453361179520/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575126.691391:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1788575126.691393:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788575126.691409:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575126.691410:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575126.691413:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3472
00000100:00080000:3.0:1788575126.691416:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575126.691418:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575126.691422:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575126.691430:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d500 x1875453361179648/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575126.691522:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575126/real 1788575126]  req@ffff8dc00644c000 x1875453361179008/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575151 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575126.691537:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c000 x1875453361179008/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575151 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575126.691546:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575126.691548:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575126.691551:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361179008:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575126.691556:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361179136:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575126.691574:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575126.691586:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575126/real 1788575126]  req@ffff8dc00644f800 x1875453361179136/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575151 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575126.691600:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f800 x1875453361179136/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575151 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575126.691610:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575126.691614:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575126.691618:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361179136:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575126.691625:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361179264:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575126.691649:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575126.691660:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575126/real 1788575126]  req@ffff8dc00644ce00 x1875453361179264/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575151 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575126.691669:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ce00 x1875453361179264/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575151 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575126.691676:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575126.691678:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575126.691681:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361179264:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575126.691685:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361179392:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575126.691701:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575126.691711:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575126/real 1788575126]  req@ffff8dc00644ca80 x1875453361179392/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575151 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575126.691722:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ca80 x1875453361179392/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575151 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575126.691731:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575126.691734:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575126.691737:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361179392:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575126.691751:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361179520:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575126.691764:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575126.691771:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575126/real 1788575126]  req@ffff8dc00644ea00 x1875453361179520/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575151 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575126.691778:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ea00 x1875453361179520/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575151 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575126.691783:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575126.691785:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575126.691787:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361179520:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575126.691790:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361179648:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575126.691799:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575126.691804:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575126/real 1788575126]  req@ffff8dc00644d500 x1875453361179648/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575151 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575126.691811:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d500 x1875453361179648/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575151 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575126.691815:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575126.691817:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575126.691818:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361179648:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575127.074961:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575127.074968:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575127.074996:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575127.075009:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575127.075028:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575127.075029:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575127.715030:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575128.099020:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575128.099020:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575128.099020:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575128.099023:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575128.099081:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575128.099116:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575128.738987:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575129.122945:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575129.122985:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575129.123008:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575129.123018:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575129.123034:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575129.123041:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575129.763005:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575130.147012:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575130.147012:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575130.147051:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575130.147064:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788575130.147158:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575130.147173:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575130.787011:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575131.170963:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575131.170978:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575131.171003:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788575131.171021:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575131.171029:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575131.171035:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575131.811010:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575131.811011:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575131.811022:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788575131.811028:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575131.811041:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3477
00000100:00080000:0.0:1788575131.811052:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575131.811060:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575131.811107:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361179776/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575131.811130:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575131.811132:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575131.811133:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575131.811136:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3477
00000100:00080000:0.0:1788575131.811138:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575131.811141:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575131.811156:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575131.811165:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361179904/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575131.811172:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575131.811176:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575131.811178:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575131.811182:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3477
00000100:00100000:2.0:1788575131.811182:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361179776:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788575131.811184:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575131.811194:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575131.811198:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575131.811206:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453361180032/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575131.811215:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575131.811218:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575131.811219:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575131.811221:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3477
00000100:00080000:0.0:1788575131.811223:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575131.811225:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575131.811228:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575131.811235:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361180160/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575131.811241:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575131.811243:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575131.811244:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575131.811246:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3477
00000100:00080000:0.0:1788575131.811249:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575131.811251:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575131.811253:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575131.811258:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361180288/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575131.811264:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575131.811266:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575131.811267:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575131.811269:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3477
00000100:00080000:0.0:1788575131.811272:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575131.811278:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:2.0:1788575131.811278:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:0.0:1788575131.811284:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575131.811293:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361180416/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575131.811299:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575131.811301:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575131.811303:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575131.811305:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3477
00000100:00080000:0.0:1788575131.811307:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575131.811309:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575131.811312:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575131.811324:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361180544/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575131.811329:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575131/real 1788575131]  req@ffff8dc006713480 x1875453361179776/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575156 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575131.811346:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361179776/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575156 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575131.811355:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575131.811358:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575131.811361:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361179776:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788575131.811382:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361179904:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575131.811400:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575131.811410:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575131/real 1788575131]  req@ffff8dc006712680 x1875453361179904/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575156 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575131.811429:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361179904/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575156 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575131.811440:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575131.811443:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575131.811447:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361179904:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575131.811453:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361180032:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575131.811477:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575131.811509:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575131/real 1788575131]  req@ffff8dc006710380 x1875453361180032/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575156 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575131.811518:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453361180032/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575156 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575131.811524:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575131.811526:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575131.811528:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361180032:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575131.811532:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361180160:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575131.811546:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575131.811552:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575131/real 1788575131]  req@ffff8dc006712300 x1875453361180160/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575156 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575131.811558:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361180160/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575156 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575131.811564:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575131.811566:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575131.811568:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361180160:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575131.811571:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361180288:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575131.811580:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575131.811586:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575131/real 1788575131]  req@ffff8dc006711c00 x1875453361180288/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575156 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575131.811592:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361180288/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575156 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575131.811601:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575131.811603:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575131.811605:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361180288:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575131.811608:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361180416:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575131.811625:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575131.811632:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575131/real 1788575131]  req@ffff8dc006711500 x1875453361180416/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575156 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575131.811642:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361180416/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575156 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575131.811650:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575131.811653:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575131.811656:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361180416:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575131.811662:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361180544:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575131.811682:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575131.811690:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575131/real 1788575131]  req@ffff8dc006713800 x1875453361180544/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575156 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575131.811697:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361180544/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575156 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575131.811702:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575131.811704:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575131.811706:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361180544:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575132.194988:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575132.195000:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575132.195000:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575132.195018:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575132.195038:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788575132.195116:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575132.834950:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575133.218947:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788575133.218973:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575133.219001:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575133.219013:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575133.219036:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575133.219043:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575133.858973:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575134.242977:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575134.242982:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575134.242986:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575134.243011:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575134.243033:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575134.243094:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575134.882970:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575135.266933:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575135.266988:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575135.267025:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575135.267028:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788575135.267048:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575135.267061:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575135.906999:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575136.290957:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575136.290986:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575136.290994:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575136.291002:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575136.291025:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575136.291037:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575136.930986:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575136.930995:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575136.931002:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575136.931008:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575136.931019:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3482
00000100:00080000:1.0:1788575136.931030:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575136.931037:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575136.931068:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361180672/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575136.931097:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575136.931100:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575136.931101:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575136.931104:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3482
00000100:00080000:1.0:1788575136.931107:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575136.931110:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575136.931118:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575136.931118:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361180672:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788575136.931132:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361180800/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575136.931138:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575136.931140:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575136.931141:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575136.931143:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3482
00000100:00080000:1.0:1788575136.931145:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575136.931147:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575136.931151:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575136.931158:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361180928/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575136.931164:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575136.931167:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575136.931168:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575136.931170:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3482
00000100:00080000:1.0:1788575136.931173:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575136.931178:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:2.0:1788575136.931178:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:1.0:1788575136.931185:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575136.931198:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361181056/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575136.931207:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575136.931210:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575136.931214:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788575136.931215:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575136/real 1788575136]  req@ffff8dc005dc1c00 x1875453361180672/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575161 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575136.931222:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3482
00000100:00080000:1.0:1788575136.931227:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575136.931239:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575136.931243:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361180672/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575161 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1788575136.931245:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1788575136.931259:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1788575136.931263:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361181184/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575136.931265:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575136.931276:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361180672:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788575136.931278:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575136.931283:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575136.931285:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575136.931291:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3482
00000100:00080000:1.0:1788575136.931294:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575136.931299:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575136.931299:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361180800:192.168.202.140@tcp:38:kworker.0
00000008:00100000:1.0:1788575136.931307:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575136.931319:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361181312/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788575136.931327:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788575136.931337:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575136.931339:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575136.931342:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788575136.931342:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575136/real 1788575136]  req@ffff8dc005dc1500 x1875453361180800/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575161 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575136.931345:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3482
00000100:00080000:1.0:1788575136.931350:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575136.931355:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575136.931359:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575136.931363:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361180800/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575161 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575136.931369:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361181440/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575136.931371:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575136.931379:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575136.931384:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361180800:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575136.931390:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361180928:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575136.931403:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575136.931409:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575136/real 1788575136]  req@ffff8dc005dc1180 x1875453361180928/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575161 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575136.931415:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361180928/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575161 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575136.931420:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575136.931422:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575136.931424:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361180928:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575136.931427:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361181056:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575136.931436:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575136.931441:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575136/real 1788575136]  req@ffff8dc005dc0a80 x1875453361181056/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575161 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575136.931447:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361181056/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575161 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575136.931456:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575136.931458:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575136.931459:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361181056:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575136.931462:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361181184:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575136.931471:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575136.931476:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575136/real 1788575136]  req@ffff8dc005dc3b80 x1875453361181184/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575161 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575136.931483:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361181184/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575161 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575136.931516:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575136.931520:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575136.931523:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361181184:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575136.931539:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361181312:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575136.931553:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575136.931561:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575136/real 1788575136]  req@ffff8dc005dc2d80 x1875453361181312/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575161 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575136.931567:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361181312/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575161 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575136.931572:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575136.931574:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575136.931576:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361181312:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575136.931580:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361181440:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575136.931594:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575136.931604:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575136/real 1788575136]  req@ffff8dc005dc0700 x1875453361181440/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575161 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575136.931616:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361181440/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575161 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575136.931623:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575136.931626:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575136.931628:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361181440:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575137.314958:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575137.314958:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575137.314958:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575137.314959:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575137.314985:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788575137.315019:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575137.954964:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575138.338946:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575138.338977:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575138.338977:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575138.339007:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575138.339017:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788575138.339034:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575138.978994:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575139.362997:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575139.362998:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575139.363004:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575139.363042:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575139.363044:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575139.363052:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575140.002965:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575140.386943:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575140.386943:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575140.386943:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575140.386974:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575140.386975:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788575140.387006:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575141.026962:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575141.410970:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575141.410970:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575141.410989:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575141.411018:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575141.411024:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575141.411069:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575142.051015:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575142.051017:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575142.051027:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788575142.051032:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575142.051045:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3487
00000100:00080000:0.0:1788575142.051058:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575142.051067:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575142.051115:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361181568/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575142.051148:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575142.051152:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575142.051154:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575142.051158:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3487
00000100:00080000:0.0:1788575142.051162:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575142.051167:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575142.051193:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575142.051199:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361181568:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788575142.051215:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361181696/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575142.051227:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575142.051230:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575142.051232:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575142.051236:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3487
00000100:00080000:0.0:1788575142.051240:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575142.051246:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575142.051252:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575142.051265:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361181824/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575142.051273:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575142.051277:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575142.051279:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575142.051285:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3487
00000800:00000100:2.0:1788575142.051285:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788575142.051292:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575142.051296:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575142.051301:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575142.051313:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361181952/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575142.051321:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575142.051325:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575142.051327:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575142.051331:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3487
00000100:00080000:0.0:1788575142.051335:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575142.051339:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575142.051344:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575142/real 1788575142]  req@ffff8dc006711880 x1875453361181568/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575167 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1788575142.051346:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575142.051362:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361182080/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575142.051366:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361181568/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575167 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575142.051381:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575142.051384:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575142.051385:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575142.051388:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575142.051389:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575142.051395:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361181568:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788575142.051398:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3487
00000100:00080000:0.0:1788575142.051403:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575142.051407:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575142.051411:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575142.051421:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361181696:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575142.051423:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361182208/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575142.051436:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575142.051439:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575142.051443:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:2.0:1788575142.051443:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788575142.051450:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3487
00000100:00080000:0.0:1788575142.051454:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1788575142.051456:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575142/real 1788575142]  req@ffff8dc006712a00 x1875453361181696/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575167 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575142.051461:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575142.051470:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575142.051474:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361181696/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575167 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575142.051482:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1788575142.051484:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361182336/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575142.051487:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575142.051493:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361181696:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575142.051506:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361181824:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575142.051538:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575142.051552:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575142/real 1788575142]  req@ffff8dc006710e00 x1875453361181824/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575167 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575142.051564:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361181824/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575167 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575142.051579:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575142.051582:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575142.051585:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361181824:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575142.051589:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361181952:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575142.051604:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575142.051611:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575142/real 1788575142]  req@ffff8dc006713100 x1875453361181952/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575167 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575142.051617:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361181952/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575167 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575142.051623:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575142.051625:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575142.051627:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361181952:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575142.051630:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361182080:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575142.051639:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575142.051644:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575142/real 1788575142]  req@ffff8dc006713b80 x1875453361182080/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575167 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575142.051652:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361182080/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575167 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575142.051661:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575142.051663:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575142.051667:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361182080:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575142.051683:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361182208:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575142.051702:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575142.051710:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575142/real 1788575142]  req@ffff8dc006711880 x1875453361182208/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575167 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575142.051718:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361182208/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575167 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575142.051723:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575142.051725:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575142.051727:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361182208:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575142.051730:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361182336:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575142.051741:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575142.051746:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575142/real 1788575142]  req@ffff8dc006713800 x1875453361182336/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575167 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575142.051753:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361182336/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575167 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575142.051757:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575142.051759:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575142.051760:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361182336:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575142.435009:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575142.435009:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575142.435009:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575142.435056:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575142.435118:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575142.435209:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575143.074994:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575143.458964:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575143.458964:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575143.458991:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575143.458997:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575143.459005:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575143.459020:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575144.098975:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575144.483018:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575144.483018:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575144.483018:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575144.483020:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575144.483070:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788575144.483146:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575145.122963:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575145.506964:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575145.506966:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575145.506968:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575145.507006:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575145.507019:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575145.507027:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575146.146988:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575146.530954:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575146.530961:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575146.530962:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575146.530991:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575146.530997:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788575146.531027:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1788575147.170967:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788575147.170970:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575147.170977:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788575147.170981:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575147.170989:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3492
00000100:00080000:0.0:1788575147.170996:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575147.171002:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575147.171030:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361182464/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575147.171049:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575147.171051:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575147.171052:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575147.171055:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3492
00000100:00080000:0.0:1788575147.171057:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575147.171060:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575147.171066:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575147.171074:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361182464:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788575147.171076:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361182592/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575147.171085:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575147.171087:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575147.171088:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575147.171090:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3492
00000100:00080000:0.0:1788575147.171093:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575147.171095:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575147.171097:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575147.171105:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361182720/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575147.171114:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575147.171117:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575147.171118:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575147.171121:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3492
00000100:00080000:0.0:1788575147.171123:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575147.171125:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575147.171128:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788575147.171131:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575147.171138:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453361182848/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575147.171145:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575147.171147:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575147.171149:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575147.171151:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3492
00000100:00080000:0.0:1788575147.171152:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575147.171154:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575147.171157:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575147.171164:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361182976/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575147.171168:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575147/real 1788575147]  req@ffff8dc006711500 x1875453361182464/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575172 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575147.171177:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575147.171181:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575147.171183:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575147.171187:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3492
00000100:00100000:2.0:1788575147.171189:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361182464/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575172 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575147.171191:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575147.171197:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575147.171204:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1788575147.171205:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575147.171210:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575147.171211:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361183104/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575147.171216:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361182464:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788575147.171226:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575147.171228:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575147.171229:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575147.171232:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3492
00000100:00080000:0.0:1788575147.171234:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575147.171236:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575147.171239:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575147.171240:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361182592:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575147.171249:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361183232/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788575147.171261:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575147.171271:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575147/real 1788575147]  req@ffff8dc006711c00 x1875453361182592/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575172 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575147.171278:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361182592/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575172 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575147.171293:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575147.171296:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575147.171299:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361182592:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575147.171305:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361182720:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575147.171324:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575147.171334:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575147/real 1788575147]  req@ffff8dc006712300 x1875453361182720/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575172 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575147.171342:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361182720/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575172 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575147.171347:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575147.171349:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575147.171351:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361182720:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575147.171354:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361182848:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575147.171365:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575147.171371:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575147/real 1788575147]  req@ffff8dc006710380 x1875453361182848/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575172 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575147.171377:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453361182848/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575172 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575147.171382:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575147.171384:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575147.171386:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361182848:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575147.171389:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361182976:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575147.171397:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575147.171402:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575147/real 1788575147]  req@ffff8dc006712680 x1875453361182976/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575172 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575147.171408:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361182976/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575172 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575147.171413:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575147.171415:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575147.171416:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361182976:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575147.171419:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361183104:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575147.171427:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575147.171433:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575147/real 1788575147]  req@ffff8dc006713480 x1875453361183104/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575172 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575147.171439:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361183104/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575172 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575147.171443:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575147.171444:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575147.171446:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361183104:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575147.171456:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361183232:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575147.171464:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575147.171470:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575147/real 1788575147]  req@ffff8dc006711500 x1875453361183232/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575172 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575147.171476:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361183232/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575172 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575147.171480:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575147.171482:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575147.171483:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361183232:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575147.554953:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575147.554953:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575147.554958:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575147.554995:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575147.554995:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575147.554997:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575148.194969:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575148.578947:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575148.578952:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575148.578952:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575148.578975:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575148.578990:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575148.579012:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575149.218936:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575149.602956:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575149.602964:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575149.602968:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575149.602989:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575149.602996:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788575149.603017:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575150.242928:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575150.626943:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575150.626944:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575150.626954:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575150.626979:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575150.626988:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788575150.626993:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575151.266973:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575151.650949:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575151.650952:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575151.650953:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575151.650977:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788575151.650983:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575151.650993:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00080000:0.0:1788575152.290954:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575152.290962:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:2.0:1788575152.290964:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575152.290967:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575152.290977:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3497
00000100:00080000:0.0:1788575152.290986:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575152.290993:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575152.291027:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361183360/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575152.291052:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575152.291056:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575152.291059:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575152.291064:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3497
00000100:00080000:0.0:1788575152.291069:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575152.291074:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575152.291077:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361183360:192.168.202.140@tcp:250:kworker.0
00000008:00100000:0.0:1788575152.291086:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575152.291102:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361183488/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575152.291119:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575152.291125:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575152.291127:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575152.291130:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3497
00000100:00080000:0.0:1788575152.291133:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575152.291136:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575152.291141:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575152.291153:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361183616/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575152.291169:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575152.291173:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575152.291175:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575152.291179:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3497
00000100:00080000:0.0:1788575152.291185:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1788575152.291185:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361183488:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788575152.291194:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575152.291201:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575152.291215:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361183744/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575152.291225:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788575152.291226:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361183616:192.168.202.140@tcp:8:kworker.0
00000100:00080000:0.0:1788575152.291235:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575152.291237:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575152.291242:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3497
00000100:00080000:0.0:1788575152.291246:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575152.291250:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575152.291257:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575152.291261:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361183744:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575152.291271:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361183872/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575152.291293:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575152.291297:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575152.291299:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575152.291304:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3497
00000100:00100000:2.0:1788575152.291307:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361183872:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788575152.291311:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575152.291318:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575152.291324:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575152.291338:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361184000/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575152.291354:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575152.291358:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575152.291360:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575152.291365:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3497
00000100:00080000:0.0:1788575152.291370:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1788575152.291370:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361184000:192.168.202.140@tcp:8:kworker.0
00000100:00080000:0.0:1788575152.291380:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575152.291386:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575152.291399:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361184128/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575152.291426:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361184128:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575152.674936:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575152.674939:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575152.674940:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575152.674941:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575152.674971:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788575152.675029:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575153.315018:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575153.698999:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575153.699001:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575153.699067:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575153.699069:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575153.699069:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575153.699097:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575154.338951:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575154.722953:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575154.722981:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575154.723007:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575154.723014:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575154.723035:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575154.723039:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575155.362965:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000400:00000100:0.0:1788575155.363393:0:2334:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.140:988
00000400:00000100:0.0:1788575155.363459:0:2334:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.140@tcp at host 192.168.202.140 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:0.0:1788575155.363489:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:0.0:1788575155.363550:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:0.0:1788575155.363561:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:0.0:1788575155.363573:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:0.0:1788575155.363587:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:0.0:1788575155.363598:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:0.0:1788575155.363608:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:2.0:1788575155.363638:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575152/real 1788575155]  req@ffff8dc006711500 x1875453361184128/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575177 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575155.363682:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361184128/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575177 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575155.363694:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575155.363699:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575155.363703:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361184128:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575155.363713:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575152/real 1788575155]  req@ffff8dc006712a00 x1875453361184000/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575177 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575155.363726:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361184000/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575177 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575155.363735:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575155.363738:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575155.363742:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361184000:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575155.363750:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575152/real 1788575155]  req@ffff8dc006710e00 x1875453361183872/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575177 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575155.363762:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361183872/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575177 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575155.363771:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575155.363774:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575155.363777:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361183872:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575155.363784:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575152/real 1788575155]  req@ffff8dc006713100 x1875453361183744/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575177 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575155.363796:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361183744/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575177 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575155.363805:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575155.363808:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575155.363812:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361183744:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575155.363819:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575152/real 1788575155]  req@ffff8dc006711880 x1875453361183488/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575177 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575155.363830:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361183488/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575177 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575155.363840:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575155.363844:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575155.363847:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361183488:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575155.363855:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575152/real 1788575155]  req@ffff8dc006713b80 x1875453361183616/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575177 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575155.363914:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361183616/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575177 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575155.363928:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575155.363933:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575155.363942:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361183616:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575155.363952:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575152/real 1788575155]  req@ffff8dc006713800 x1875453361183360/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575177 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575155.363968:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361183360/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575177 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575155.363976:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575155.363986:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575155.363990:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361183360:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788575155.746991:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575155.746992:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575155.747010:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575155.747036:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575155.747039:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575155.747053:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575156.387021:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575156.770977:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575156.770980:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575156.770988:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575156.770992:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575156.771041:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575156.771083:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1788575157.410986:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575157.410995:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788575157.410999:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575157.411008:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3503
00000100:00080000:2.0:1788575157.411017:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788575157.411023:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788575157.411024:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575157.411057:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453361184256/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575157.411080:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575157.411082:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575157.411083:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575157.411092:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3503
00000100:00080000:2.0:1788575157.411095:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575157.411098:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575157.411107:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575157.411110:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361184256:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788575157.411123:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453361184384/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575157.411135:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575157.411139:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575157.411141:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575157.411154:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3503
00000100:00080000:2.0:1788575157.411159:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575157.411163:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575157.411170:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788575157.411180:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575157.411187:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453361184512/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575157.411198:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575157.411201:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575157.411203:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575157.411207:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3503
00000100:00080000:2.0:1788575157.411211:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575157.411216:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575157.411222:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575157.411226:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575157/real 1788575157]  req@ffff8dc020496a00 x1875453361184256/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575182 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575157.411239:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361184640/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575157.411265:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575157.411268:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:0.0:1788575157.411273:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453361184256/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575182 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575157.411273:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575157.411282:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3503
00000100:00080000:0.0:1788575157.411297:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575157.411300:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575157.411305:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788575157.411311:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575157.411314:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361184256:192.168.202.140@tcp:250:kworker.0
00000008:00100000:2.0:1788575157.411321:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575157.411338:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453361184768/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575157.411350:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788575157.411354:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361184384:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788575157.411355:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575157.411361:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575157.411369:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3503
00000100:00080000:2.0:1788575157.411373:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575157.411378:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575157.411384:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575157.411397:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453361184896/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1788575157.411401:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788575157.411413:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575157.411417:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575157.411420:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788575157.411425:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575157/real 1788575157]  req@ffff8dc020497100 x1875453361184384/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575182 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575157.411427:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3503
00000100:00080000:2.0:1788575157.411436:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575157.411444:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575157.411449:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453361184384/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575182 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1788575157.411452:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1788575157.411469:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1788575157.411474:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361185024/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575157.411477:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575157.411487:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361184384:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575157.411501:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361184512:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575157.411526:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575157.411538:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575157/real 1788575157]  req@ffff8dc020494380 x1875453361184512/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575182 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575157.411550:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453361184512/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575182 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575157.411559:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575157.411563:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575157.411567:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361184512:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575157.411573:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361184640:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575157.411597:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575157.411618:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575157/real 1788575157]  req@ffff8dc020494700 x1875453361184640/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575182 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575157.411630:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361184640/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575182 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575157.411638:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575157.411641:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575157.411645:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361184640:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575157.411663:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361184768:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575157.411685:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575157.411699:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575157/real 1788575157]  req@ffff8dc020496d80 x1875453361184768/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575182 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575157.411710:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453361184768/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575182 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575157.411719:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575157.411722:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575157.411726:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361184768:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575157.411731:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361184896:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575157.411752:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575157.411763:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575157/real 1788575157]  req@ffff8dc020496a00 x1875453361184896/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575182 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575157.411775:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453361184896/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575182 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575157.411783:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575157.411786:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575157.411789:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361184896:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575157.411795:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361185024:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575157.411823:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575157.411833:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575157/real 1788575157]  req@ffff8dc020494000 x1875453361185024/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575182 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575157.411844:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361185024/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575182 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575157.411853:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575157.411857:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575157.411860:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361185024:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575157.794947:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575157.794954:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575157.794961:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575157.794988:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575157.794992:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788575157.795005:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575158.435029:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575158.818988:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575158.819007:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575158.819015:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575158.819016:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575158.819063:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575158.819088:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575159.459030:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575159.842959:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575159.842993:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575159.842993:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575159.843043:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575159.843048:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575159.843052:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575160.482955:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575160.866988:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575160.866988:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575160.866988:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575160.866991:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575160.867024:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575160.867073:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575161.507084:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575161.890977:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575161.890977:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575161.890977:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575161.890978:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575161.891020:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788575161.891078:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575162.530963:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575162.531010:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575162.531017:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788575162.531021:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575162.531030:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3508
00000100:00080000:0.0:1788575162.531041:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575162.531049:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575162.531083:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361185152/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575162.531106:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575162.531110:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575162.531111:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575162.531114:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3508
00000100:00080000:0.0:1788575162.531118:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575162.531122:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575162.531132:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575162.531147:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361185280/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575162.531150:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361185152:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788575162.531169:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575162.531173:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575162.531176:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575162.531181:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3508
00000100:00080000:0.0:1788575162.531187:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575162.531193:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575162.531198:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575162.531209:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453361185408/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575162.531217:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575162.531219:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575162.531220:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575162.531223:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3508
00000100:00080000:0.0:1788575162.531226:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575162.531229:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:2.0:1788575162.531234:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:0.0:1788575162.531235:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575162.531245:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361185536/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575162.531252:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575162.531254:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575162.531256:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575162.531259:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3508
00000100:00080000:0.0:1788575162.531260:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575162.531263:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575162.531265:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575162.531271:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361185664/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575162.531278:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575162.531280:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575162.531282:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575162.531285:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3508
00000100:00080000:0.0:1788575162.531287:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575162.531289:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575162.531293:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575162.531298:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575162/real 1788575162]  req@ffff8dc006713480 x1875453361185152/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575187 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575162.531308:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361185792/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575162.531321:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788575162.531326:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361185152/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575187 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575162.531327:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575162.531331:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575162.531344:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575162.531348:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788575162.531352:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3508
00000100:00100000:2.0:1788575162.531354:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361185152:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788575162.531359:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575162.531364:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575162.531369:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575162.531378:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361185280:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575162.531383:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361185920/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788575162.531405:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575162.531417:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575162/real 1788575162]  req@ffff8dc006712680 x1875453361185280/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575187 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575162.531427:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361185280/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575187 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575162.531435:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575162.531437:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575162.531439:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361185280:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575162.531444:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361185408:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575162.531458:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575162.531464:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575162/real 1788575162]  req@ffff8dc006710380 x1875453361185408/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575187 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575162.531475:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453361185408/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575187 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575162.531481:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575162.531483:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575162.531485:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361185408:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575162.531489:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361185536:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575162.531503:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575162.531510:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575162/real 1788575162]  req@ffff8dc006712300 x1875453361185536/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575187 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575162.531520:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361185536/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575187 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575162.531526:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575162.531529:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575162.531531:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361185536:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575162.531537:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361185664:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575162.531562:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575162.531573:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575162/real 1788575162]  req@ffff8dc006711c00 x1875453361185664/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575187 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575162.531580:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361185664/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575187 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575162.531586:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575162.531588:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575162.531590:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361185664:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575162.531594:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361185792:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575162.531610:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575162.531617:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575162/real 1788575162]  req@ffff8dc006713800 x1875453361185792/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575187 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575162.531624:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361185792/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575187 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575162.531633:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575162.531635:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575162.531637:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361185792:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575162.531650:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361185920:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575162.531668:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575162.531679:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575162/real 1788575162]  req@ffff8dc006713b80 x1875453361185920/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575187 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575162.531692:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361185920/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575187 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575162.531701:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575162.531704:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575162.531708:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361185920:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575162.914980:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575162.914980:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575162.914980:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575162.915012:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575162.915026:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575162.915027:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575163.554980:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575163.938976:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575163.938990:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575163.939008:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575163.939031:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575163.939031:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575163.939033:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575164.578953:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575164.962971:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575164.962971:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575164.962978:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575164.963004:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575164.963022:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788575164.963035:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575165.602961:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575165.986957:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575165.986958:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575165.986958:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788575165.987054:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575165.987131:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575165.987160:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575166.626959:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575167.010953:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575167.010977:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575167.010983:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575167.010997:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575167.011000:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575167.011007:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00080000:1.0:1788575167.650956:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788575167.650959:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575167.650968:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575167.650972:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575167.650982:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3513
00000100:00080000:1.0:1788575167.650992:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575167.650999:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575167.651044:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361186048/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575167.651071:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575167.651075:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575167.651077:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575167.651081:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3513
00000100:00080000:1.0:1788575167.651085:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575167.651088:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575167.651098:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575167.651125:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361186048:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788575167.651126:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361186176/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575167.651143:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575167.651148:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575167.651150:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575167.651155:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3513
00000100:00080000:1.0:1788575167.651159:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575167.651163:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575167.651169:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575167.651182:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361186304/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575167.651191:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575167.651195:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575167.651199:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:2.0:1788575167.651200:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788575167.651216:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3513
00000100:00080000:1.0:1788575167.651221:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575167.651225:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575167.651231:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575167.651243:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575167/real 1788575167]  req@ffff8dc005dc3800 x1875453361186048/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575192 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575167.651246:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361186432/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575167.651275:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575167.651279:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:2.0:1788575167.651283:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361186048/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575192 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575167.651284:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575167.651293:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3513
00000100:00080000:1.0:1788575167.651300:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575167.651306:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575167.651307:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:2.0:1788575167.651316:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000008:00100000:1.0:1788575167.651317:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575167.651323:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361186048:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788575167.651333:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361186560/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575167.651344:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575167.651350:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:2.0:1788575167.651351:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361186176:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788575167.651355:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575167.651363:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3513
00000100:00080000:1.0:1788575167.651366:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575167.651371:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575167.651376:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788575167.651393:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575167.651399:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361186688/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575167.651411:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575167/real 1788575167]  req@ffff8dc005dc0700 x1875453361186176/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575192 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575167.651412:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575167.651421:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575167.651426:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575167.651435:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3513
00000100:00080000:1.0:1788575167.651440:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1788575167.651440:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361186176/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575192 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575167.651449:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575167.651460:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1788575167.651460:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575167.651467:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575167.651473:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361186176:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575167.651483:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361186304:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575167.651485:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361186816/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788575167.651511:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575167.651525:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575167/real 1788575167]  req@ffff8dc005dc2d80 x1875453361186304/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575192 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575167.651544:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361186304/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575192 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575167.651552:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575167.651556:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575167.651559:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361186304:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575167.651564:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361186432:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575167.651583:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575167.651594:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575167/real 1788575167]  req@ffff8dc005dc3b80 x1875453361186432/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575192 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575167.651606:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361186432/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575192 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575167.651615:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575167.651619:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575167.651623:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361186432:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575167.651646:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361186560:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575167.651667:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575167.651678:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575167/real 1788575167]  req@ffff8dc005dc0a80 x1875453361186560/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575192 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575167.651688:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361186560/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575192 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575167.651704:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575167.651708:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575167.651711:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361186560:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575167.651728:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361186688:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575167.651750:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575167.651762:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575167/real 1788575167]  req@ffff8dc005dc1180 x1875453361186688/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575192 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575167.651773:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361186688/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575192 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575167.651780:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575167.651783:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575167.651786:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361186688:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575167.651792:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361186816:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575167.651808:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575167.651818:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575167/real 1788575167]  req@ffff8dc005dc1500 x1875453361186816/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575192 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575167.651830:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361186816/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575192 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575167.651838:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575167.651841:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575167.651845:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361186816:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575168.034958:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575168.034958:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575168.034982:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575168.034986:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575168.034995:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788575168.034996:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575168.674953:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575169.058981:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575169.058995:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575169.059012:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575169.059036:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575169.059058:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575169.059082:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575169.698990:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575170.082953:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575170.082954:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575170.082961:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575170.082989:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788575170.083004:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575170.083015:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575170.723037:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575171.106972:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575171.106993:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575171.107003:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575171.107007:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575171.107033:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575171.107035:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575171.746925:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575172.130987:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575172.130987:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575172.130987:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575172.131014:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575172.131016:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575172.131095:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575172.770973:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575172.770986:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575172.770992:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788575172.770995:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575172.771004:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3518
00000100:00080000:0.0:1788575172.771014:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575172.771022:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575172.771061:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361186944/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575172.771081:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575172.771084:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575172.771085:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575172.771089:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3518
00000100:00080000:0.0:1788575172.771092:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575172.771096:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575172.771107:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575172.771119:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361186944:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788575172.771124:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361187072/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575172.771138:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575172.771141:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575172.771143:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575172.771146:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3518
00000100:00080000:0.0:1788575172.771149:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575172.771153:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575172.771157:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575172.771167:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361187200/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575172.771174:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575172.771176:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575172.771178:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575172.771180:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3518
00000100:00080000:0.0:1788575172.771183:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575172.771187:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:2.0:1788575172.771189:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:0.0:1788575172.771191:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575172.771200:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361187328/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575172.771206:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575172.771209:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575172.771210:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575172.771213:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3518
00000100:00080000:0.0:1788575172.771215:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575172.771217:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575172.771220:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575172.771228:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361187456/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575172.771233:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575172.771238:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575172.771239:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788575172.771239:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575172/real 1788575172]  req@ffff8dc006711880 x1875453361186944/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575197 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575172.771247:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3518
00000100:00080000:0.0:1788575172.771251:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575172.771257:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575172.771263:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575172.771277:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361187584/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575172.771277:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361186944/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575197 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575172.771297:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575172.771304:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575172.771305:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575172.771307:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575172.771309:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3518
00000100:00080000:0.0:1788575172.771315:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575172.771318:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788575172.771338:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575172.771343:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361186944:192.168.202.140@tcp:250:kworker.0
00000008:00100000:0.0:1788575172.771346:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575172.771359:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361187712/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575172.771372:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361187072:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575172.771400:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575172.771415:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575172/real 1788575172]  req@ffff8dc006713100 x1875453361187072/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575197 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575172.771430:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361187072/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575197 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575172.771442:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575172.771446:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575172.771450:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361187072:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575172.771457:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361187200:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575172.771480:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575172.771492:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575172/real 1788575172]  req@ffff8dc006710e00 x1875453361187200/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575197 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575172.771504:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361187200/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575197 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575172.771510:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575172.771513:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575172.771515:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361187200:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575172.771520:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361187328:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575172.771539:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575172.771551:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575172/real 1788575172]  req@ffff8dc006712a00 x1875453361187328/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575197 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575172.771563:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361187328/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575197 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575172.771579:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575172.771582:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575172.771586:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361187328:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575172.771593:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361187456:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575172.771613:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575172.771632:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575172/real 1788575172]  req@ffff8dc006711500 x1875453361187456/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575197 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575172.771644:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361187456/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575197 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575172.771653:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575172.771657:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575172.771660:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361187456:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575172.771667:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361187584:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575172.771694:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575172.771707:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575172/real 1788575172]  req@ffff8dc006713b80 x1875453361187584/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575197 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575172.771720:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361187584/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575197 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575172.771729:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575172.771732:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575172.771737:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361187584:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575172.771743:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361187712:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575172.771762:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575172.771770:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575172/real 1788575172]  req@ffff8dc006713800 x1875453361187712/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575197 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575172.771778:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361187712/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575197 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575172.771783:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575172.771785:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575172.771787:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361187712:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575173.154971:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575173.154971:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575173.155026:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575173.155026:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575173.155073:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575173.155084:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575173.794992:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575174.179004:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575174.179036:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575174.179039:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788575174.179039:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575174.179053:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575174.179064:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575174.819013:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575175.202961:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575175.202985:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575175.202986:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575175.202986:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575175.203021:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575175.203067:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575175.843034:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575176.226973:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575176.226973:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575176.226973:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575176.227008:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575176.227030:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575176.227031:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575176.867023:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575177.250941:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575177.250941:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575177.250945:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575177.250967:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575177.250981:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575177.251005:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575177.890954:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788575177.890964:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575177.890970:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788575177.890974:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575177.890983:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3523
00000100:00080000:3.0:1788575177.890991:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575177.890998:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575177.891047:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c380 x1875453361187840/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575177.891064:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575177.891066:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575177.891068:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575177.891070:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3523
00000100:00080000:3.0:1788575177.891072:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575177.891075:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575177.891081:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575177.891089:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f480 x1875453361187968/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575177.891097:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575177.891100:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575177.891101:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575177.891105:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3523
00000100:00100000:2.0:1788575177.891106:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361187840:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788575177.891107:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575177.891113:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575177.891119:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575177.891131:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d180 x1875453361188096/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575177.891140:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575177.891143:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575177.891145:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575177.891149:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3523
00000100:00080000:3.0:1788575177.891155:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575177.891159:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575177.891164:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788575177.891170:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575177.891177:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e680 x1875453361188224/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575177.891187:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575177.891190:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575177.891192:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575177.891196:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3523
00000100:00080000:3.0:1788575177.891200:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575177.891205:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575177.891210:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575177/real 1788575177]  req@ffff8dc00644c380 x1875453361187840/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575202 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1788575177.891212:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575177.891228:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c700 x1875453361188352/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575177.891241:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575177.891245:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:2.0:1788575177.891246:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453361187840/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575202 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575177.891247:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575177.891253:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3523
00000100:00080000:3.0:1788575177.891257:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575177.891262:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:2.0:1788575177.891267:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:3.0:1788575177.891267:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1788575177.891276:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575177.891279:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e300 x1875453361188480/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575177.891285:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361187840:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788575177.891288:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575177.891291:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575177.891294:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575177.891297:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3523
00000100:00080000:3.0:1788575177.891300:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575177.891302:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575177.891305:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575177.891310:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644df80 x1875453361188608/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575177.891317:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361187968:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575177.891341:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575177.891352:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575177/real 1788575177]  req@ffff8dc00644f480 x1875453361187968/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575202 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575177.891367:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453361187968/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575202 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575177.891374:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575177.891376:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575177.891378:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361187968:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575177.891382:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361188096:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575177.891395:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575177.891402:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575177/real 1788575177]  req@ffff8dc00644d180 x1875453361188096/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575202 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575177.891408:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453361188096/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575202 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575177.891417:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575177.891419:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575177.891420:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361188096:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575177.891423:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361188224:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575177.891432:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575177.891437:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575177/real 1788575177]  req@ffff8dc00644e680 x1875453361188224/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575202 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575177.891443:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453361188224/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575202 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575177.891449:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575177.891450:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575177.891452:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361188224:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575177.891455:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361188352:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575177.891463:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575177.891469:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575177/real 1788575177]  req@ffff8dc00644c700 x1875453361188352/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575202 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575177.891475:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453361188352/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575202 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575177.891480:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575177.891481:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575177.891485:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361188352:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575177.891490:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361188480:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575177.891508:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575177.891518:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575177/real 1788575177]  req@ffff8dc00644e300 x1875453361188480/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575202 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575177.891530:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453361188480/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575202 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575177.891537:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575177.891540:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575177.891543:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361188480:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575177.891561:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361188608:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575177.891581:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575177.891592:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575177/real 1788575177]  req@ffff8dc00644df80 x1875453361188608/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575202 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575177.891604:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644df80 x1875453361188608/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575202 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575177.891611:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575177.891614:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575177.891625:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361188608:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575178.274943:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575178.274943:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575178.274945:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575178.274966:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575178.274978:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575178.274982:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575178.914984:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575179.298959:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575179.298959:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575179.298962:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575179.298978:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575179.298993:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575179.298998:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575179.938971:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575180.322972:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575180.322973:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575180.322974:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788575180.323058:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575180.323085:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575180.323125:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575180.962967:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575181.346955:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575181.346968:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575181.346972:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575181.346993:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575181.346999:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788575181.347029:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575181.986933:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575182.370956:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575182.370956:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575182.370956:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575182.370957:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575182.370986:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575182.371035:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1788575183.010961:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788575183.010967:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788575183.010969:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788575183.010975:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575183.010985:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3528
00000100:00080000:3.0:1788575183.010996:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575183.011003:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575183.011038:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ed80 x1875453361188736/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575183.011061:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575183.011065:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575183.011066:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575183.011070:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3528
00000100:00080000:3.0:1788575183.011074:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575183.011078:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575183.011086:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361188736:192.168.202.140@tcp:250:kworker.0
00000008:00100000:3.0:1788575183.011088:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575183.011104:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644fb80 x1875453361188864/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575183.011114:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575183.011118:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575183.011120:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575183.011124:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3528
00000100:00080000:3.0:1788575183.011129:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575183.011133:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575183.011138:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788575183.011143:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575183.011153:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d880 x1875453361188992/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575183.011163:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575183.011166:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575183.011168:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575183.011173:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3528
00000100:00080000:3.0:1788575183.011176:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1788575183.011177:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575183/real 1788575183]  req@ffff8dc00644ed80 x1875453361188736/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575208 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575183.011185:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575183.011192:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575183.011196:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ed80 x1875453361188736/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575208 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575183.011205:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1788575183.011205:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f100 x1875453361189120/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575183.011211:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575183.011219:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361188736:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788575183.011223:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575183.011227:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575183.011229:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575183.011233:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3528
00000100:00080000:3.0:1788575183.011237:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1788575183.011238:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361188864:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788575183.011244:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575183.011250:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788575183.011257:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575183.011265:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ed80 x1875453361189248/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575183.011268:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575183/real 1788575183]  req@ffff8dc00644fb80 x1875453361188864/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575208 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575183.011287:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644fb80 x1875453361188864/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575208 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575183.011307:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575183.011308:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575183.011315:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788575183.011316:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:2.0:1788575183.011319:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361188864:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788575183.011321:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788575183.011326:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361188992:192.168.202.140@tcp:8:kworker.0
00000100:00080000:3.0:1788575183.011330:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3528
00000100:00080000:3.0:1788575183.011336:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575183.011340:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575183.011346:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788575183.011354:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575183.011359:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644df80 x1875453361189376/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575183.011369:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575183/real 1788575183]  req@ffff8dc00644d880 x1875453361188992/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575208 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575183.011371:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575183.011379:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575183.011383:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788575183.011391:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d880 x1875453361188992/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575208 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575183.011398:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3528
00000100:00080000:2.0:1788575183.011404:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575183.011405:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575183.011410:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788575183.011413:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575183.011415:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361188992:192.168.202.140@tcp:8:kworker.0
00000008:00100000:3.0:1788575183.011422:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575183.011423:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361189120:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575183.011439:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e300 x1875453361189504/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788575183.011447:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575183.011459:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575183/real 1788575183]  req@ffff8dc00644f100 x1875453361189120/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575208 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575183.011467:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f100 x1875453361189120/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575208 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575183.011476:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575183.011479:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575183.011482:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361189120:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575183.011491:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361189248:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575183.011501:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575183.011506:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575183/real 1788575183]  req@ffff8dc00644ed80 x1875453361189248/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575208 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575183.011512:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ed80 x1875453361189248/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575208 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575183.011518:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575183.011520:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575183.011521:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361189248:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575183.011524:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361189376:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575183.011533:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575183.011537:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575183/real 1788575183]  req@ffff8dc00644df80 x1875453361189376/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575208 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575183.011543:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644df80 x1875453361189376/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575208 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575183.011548:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575183.011549:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575183.011551:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361189376:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575183.011554:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361189504:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575183.011562:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575183.011567:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575183/real 1788575183]  req@ffff8dc00644e300 x1875453361189504/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575208 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575183.011572:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453361189504/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575208 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575183.011577:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575183.011578:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575183.011580:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361189504:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575183.394946:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575183.394950:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575183.394958:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788575183.394973:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575183.394977:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575183.394984:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575184.034944:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575184.418962:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575184.418963:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575184.418963:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575184.418964:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575184.418990:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575184.419045:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575185.058967:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575185.442944:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575185.442949:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575185.442949:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788575185.442974:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575185.442981:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575185.442985:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575186.082972:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575186.466962:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575186.466962:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575186.466962:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575186.466962:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575186.466991:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575186.467047:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575187.106954:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575187.490952:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575187.490952:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575187.490976:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788575187.490982:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575187.490984:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575187.491011:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575188.130944:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575188.130960:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575188.130966:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788575188.130970:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575188.130980:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3533
00000100:00080000:0.0:1788575188.130990:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575188.130997:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575188.131028:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361189632/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575188.131050:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575188.131052:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575188.131054:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575188.131056:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3533
00000100:00080000:0.0:1788575188.131060:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575188.131063:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575188.131071:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575188.131077:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361189632:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788575188.131082:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361189760/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575188.131089:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575188.131091:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575188.131092:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575188.131095:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3533
00000100:00080000:0.0:1788575188.131097:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575188.131100:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575188.131103:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575188.131110:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453361189888/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575188.131115:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575188.131117:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575188.131119:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575188.131122:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3533
00000100:00080000:0.0:1788575188.131126:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575188.131130:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575188.131134:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575188.131146:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361190016/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788575188.131153:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788575188.131159:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575188.131164:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575188.131166:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575188.131176:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3533
00000100:00080000:0.0:1788575188.131180:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575188.131185:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575188.131191:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575188.131191:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575188/real 1788575188]  req@ffff8dc006711c00 x1875453361189632/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575213 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575188.131206:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361189632/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575213 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575188.131215:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361190144/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575188.131215:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575188.131222:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575188.131229:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361189632:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788575188.131236:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575188.131240:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575188.131243:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575188.131247:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3533
00000100:00080000:0.0:1788575188.131251:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1788575188.131252:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361189760:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788575188.131259:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575188.131264:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788575188.131274:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575188.131279:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361190272/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575188.131284:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575188/real 1788575188]  req@ffff8dc006712300 x1875453361189760/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575213 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575188.131302:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788575188.131304:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361189760/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575213 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575188.131309:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575188.131314:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575188.131316:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575188.131321:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3533
00000100:00080000:2.0:1788575188.131322:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575188.131327:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361189760:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788575188.131328:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575188.131336:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575188.131336:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361189888:192.168.202.140@tcp:8:kworker.0
00000008:00100000:0.0:1788575188.131344:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575188.131358:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361190400/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788575188.131363:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575188.131381:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575188/real 1788575188]  req@ffff8dc006710380 x1875453361189888/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575213 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575188.131408:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453361189888/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575213 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575188.131422:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575188.131425:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575188.131428:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361189888:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575188.131434:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361190016:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575188.131452:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575188.131463:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575188/real 1788575188]  req@ffff8dc006712680 x1875453361190016/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575213 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575188.131474:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361190016/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575213 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575188.131480:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575188.131482:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575188.131484:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361190016:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575188.131487:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361190144:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575188.131499:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575188.131506:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575188/real 1788575188]  req@ffff8dc006713480 x1875453361190144/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575213 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575188.131512:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361190144/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575213 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575188.131517:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575188.131519:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575188.131521:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361190144:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575188.131532:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361190272:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575188.131541:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575188.131546:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575188/real 1788575188]  req@ffff8dc006711c00 x1875453361190272/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575213 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575188.131552:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361190272/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575213 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575188.131557:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575188.131558:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575188.131559:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361190272:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575188.131562:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361190400:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575188.131570:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575188.131581:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575188/real 1788575188]  req@ffff8dc006713800 x1875453361190400/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575213 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575188.131587:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361190400/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575213 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575188.131591:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575188.131593:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575188.131595:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361190400:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575188.514963:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575188.514963:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575188.514968:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575188.514991:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575188.514992:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788575188.515057:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575189.154955:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575189.538972:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575189.538984:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575189.539007:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788575189.539031:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575189.539036:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575189.539071:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575190.178969:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575190.563000:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575190.563000:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575190.563024:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575190.563050:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788575190.563122:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575190.563139:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575191.202990:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575191.586959:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575191.586959:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575191.586968:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575191.586988:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575191.586997:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575191.587010:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575192.226956:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575192.610969:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575192.610969:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575192.610969:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788575192.611010:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575192.611019:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575192.611025:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575193.251003:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575193.251003:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575193.251013:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575193.251018:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575193.251033:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3538
00000100:00080000:1.0:1788575193.251042:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575193.251050:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575193.251098:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361190528/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575193.251123:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575193.251126:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575193.251128:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575193.251131:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3538
00000100:00080000:1.0:1788575193.251135:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575193.251138:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575193.251147:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575193.251164:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361190656/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575193.251173:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575193.251176:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575193.251178:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575193.251182:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3538
00000100:00080000:1.0:1788575193.251185:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575193.251194:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575193.251194:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361190528:192.168.202.140@tcp:250:kworker.0
00000008:00100000:1.0:1788575193.251212:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575193.251230:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361190784/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575193.251241:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575193.251244:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575193.251246:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575193.251250:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3538
00000100:00080000:1.0:1788575193.251254:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575193.251259:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575193.251263:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575193.251277:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361190912/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788575193.251285:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788575193.251288:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575193.251293:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575193.251296:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575193.251304:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3538
00000100:00080000:1.0:1788575193.251309:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575193.251315:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575193.251321:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575193.251334:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361191040/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575193.251344:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788575193.251347:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575193/real 1788575193]  req@ffff8dc005dc1c00 x1875453361190528/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575218 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575193.251349:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575193.251353:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575193.251365:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3538
00000100:00080000:1.0:1788575193.251373:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575193.251379:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575193.251384:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575193.251388:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361190528/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575218 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575193.251401:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361191168/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575193.251402:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575193.251416:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575193.251428:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361190528:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788575193.251433:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575193.251438:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:2.0:1788575193.251442:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361190656:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788575193.251443:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575193.251456:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3538
00000100:00080000:1.0:1788575193.251462:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575193.251467:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575193.251474:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788575193.251481:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575193.251490:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361191296/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575193.251497:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575193/real 1788575193]  req@ffff8dc005dc1500 x1875453361190656/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575218 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575193.251534:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361190656/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575218 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575193.251556:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575193.251560:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575193.251564:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361190656:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575193.251595:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361190784:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575193.251617:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575193.251629:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575193/real 1788575193]  req@ffff8dc005dc1180 x1875453361190784/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575218 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575193.251641:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361190784/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575218 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575193.251650:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575193.251653:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575193.251656:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361190784:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575193.251663:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361190912:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575193.251682:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575193.251693:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575193/real 1788575193]  req@ffff8dc005dc0a80 x1875453361190912/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575218 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575193.251705:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361190912/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575218 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575193.251713:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575193.251716:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575193.251720:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361190912:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575193.251726:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361191040:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575193.251743:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575193.251753:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575193/real 1788575193]  req@ffff8dc005dc3b80 x1875453361191040/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575218 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575193.251764:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361191040/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575218 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575193.251773:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575193.251776:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575193.251779:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361191040:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575193.251784:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361191168:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575193.251799:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575193.251806:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575193/real 1788575193]  req@ffff8dc005dc2d80 x1875453361191168/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575218 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575193.251816:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361191168/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575218 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575193.251823:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575193.251827:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575193.251830:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361191168:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575193.251836:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361191296:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575193.251854:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575193.251865:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575193/real 1788575193]  req@ffff8dc005dc0700 x1875453361191296/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575218 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575193.251921:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361191296/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575218 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575193.251929:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575193.251932:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575193.251935:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361191296:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575193.634985:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575193.635001:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575193.635041:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575193.635074:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575193.635130:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575193.635175:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575194.274988:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575194.658978:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575194.658994:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575194.659012:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575194.659034:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575194.659058:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575194.659059:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575195.298995:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575195.682970:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575195.682971:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575195.682972:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575195.682981:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575195.683011:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575195.683040:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575196.322975:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575196.706967:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575196.706979:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575196.706995:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575196.707100:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575196.707131:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788575196.707154:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575197.346957:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575197.730990:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575197.730996:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575197.731024:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575197.731032:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575197.731047:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575197.731066:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575198.370948:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575198.371058:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575198.371064:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575198.371068:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575198.371077:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3544
00000100:00080000:1.0:1788575198.371085:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575198.371092:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575198.371126:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361191424/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575198.371155:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575198.371159:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575198.371161:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575198.371165:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3544
00000100:00080000:1.0:1788575198.371169:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575198.371174:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575198.371183:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575198.371194:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361191424:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788575198.371200:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361191552/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575198.371218:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575198.371221:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575198.371224:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575198.371228:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3544
00000100:00080000:1.0:1788575198.371232:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575198.371236:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575198.371242:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788575198.371246:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575198.371257:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361191680/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575198.371266:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575198.371270:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575198.371272:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575198.371276:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3544
00000100:00100000:2.0:1788575198.371278:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575198/real 1788575198]  req@ffff8dc005dc3800 x1875453361191424/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575223 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575198.371282:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575198.371291:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575198.371296:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361191424/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575223 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1788575198.371298:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1788575198.371308:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575198.371311:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575198.371314:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361191424:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788575198.371317:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361191808/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575198.371326:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575198.371329:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575198.371330:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788575198.371333:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361191552:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788575198.371337:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3544
00000100:00080000:1.0:1788575198.371341:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575198.371344:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575198.371348:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788575198.371352:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575198.371360:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361191936/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575198.371363:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575198/real 1788575198]  req@ffff8dc005dc0700 x1875453361191552/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575223 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575198.371383:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575198.371387:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:2.0:1788575198.371387:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361191552/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575223 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575198.371391:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575198.371398:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3544
00000100:00080000:1.0:1788575198.371402:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575198.371403:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575198.371406:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:2.0:1788575198.371409:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000008:00100000:1.0:1788575198.371412:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575198.371413:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361191552:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575198.371420:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361191680:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575198.371424:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361192064/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575198.371431:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575198.371435:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000800:00000100:2.0:1788575198.371435:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788575198.371438:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575198.371442:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3544
00000100:00080000:1.0:1788575198.371445:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1788575198.371447:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575198/real 1788575198]  req@ffff8dc005dc2d80 x1875453361191680/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575223 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575198.371450:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575198.371456:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575198.371461:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361191680/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575223 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575198.371467:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361192192/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575198.371469:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575198.371476:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575198.371481:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361191680:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575198.371489:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361191808:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575198.371503:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575198.371509:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575198/real 1788575198]  req@ffff8dc005dc3b80 x1875453361191808/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575223 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575198.371517:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361191808/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575223 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575198.371523:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575198.371525:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575198.371527:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361191808:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575198.371535:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361191936:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575198.371546:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575198.371555:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575198/real 1788575198]  req@ffff8dc005dc0a80 x1875453361191936/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575223 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575198.371566:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361191936/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575223 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575198.371574:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575198.371578:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575198.371582:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361191936:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575198.371587:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361192064:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575198.371617:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575198.371627:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575198/real 1788575198]  req@ffff8dc005dc1180 x1875453361192064/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575223 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575198.371637:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361192064/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575223 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575198.371644:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575198.371647:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575198.371651:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361192064:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575198.371658:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361192192:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575198.371676:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575198.371688:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575198/real 1788575198]  req@ffff8dc005dc1500 x1875453361192192/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575223 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575198.371700:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361192192/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575223 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575198.371708:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575198.371711:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575198.371714:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361192192:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575198.754935:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575198.754940:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575198.754943:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575198.754980:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575198.754989:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575198.754993:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575199.394925:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575199.778962:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575199.778967:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575199.778989:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575199.779067:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575199.779102:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788575199.779145:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575200.418922:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575200.802969:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575200.802969:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575200.802971:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575200.802997:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575200.803002:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788575200.803008:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575201.442921:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575201.826950:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575201.826950:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575201.826950:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575201.826952:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575201.826977:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788575201.827038:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575202.466960:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575202.850976:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575202.850989:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575202.850994:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575202.851028:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575202.851047:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575202.851049:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575203.490952:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575203.490955:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575203.490964:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575203.490969:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575203.490979:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3549
00000100:00080000:1.0:1788575203.490990:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575203.490997:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575203.491038:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361192320/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575203.491064:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575203.491068:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575203.491070:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575203.491074:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3549
00000100:00080000:1.0:1788575203.491078:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575203.491082:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575203.491094:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575203.491110:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361192448/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575203.491120:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788575203.491120:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361192320:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788575203.491125:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575203.491127:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575203.491130:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3549
00000100:00080000:1.0:1788575203.491134:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575203.491138:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575203.491143:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575203.491153:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361192576/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575203.491161:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575203.491164:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575203.491166:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575203.491169:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3549
00000100:00080000:1.0:1788575203.491172:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575203.491175:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575203.491180:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575203.491191:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361192704/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788575203.491207:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788575203.491211:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575203.491214:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575203.491215:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575203.491219:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3549
00000100:00080000:1.0:1788575203.491222:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575203.491226:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575203.491232:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575203.491242:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361192832/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575203.491250:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575203.491254:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575203.491256:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788575203.491257:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575203/real 1788575203]  req@ffff8dc005dc1c00 x1875453361192320/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575228 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575203.491260:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3549
00000100:00080000:1.0:1788575203.491263:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575203.491277:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575203.491282:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575203.491283:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361192320/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575228 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575203.491292:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361192960/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575203.491294:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575203.491299:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575203.491303:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361192320:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788575203.491308:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575203.491311:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575203.491313:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575203.491316:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3549
00000100:00080000:1.0:1788575203.491320:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575203.491324:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575203.491327:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361192448:192.168.202.140@tcp:38:kworker.0
00000008:00100000:1.0:1788575203.491329:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575203.491340:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361193088/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788575203.491350:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575203.491375:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575203/real 1788575203]  req@ffff8dc005dc1500 x1875453361192448/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575228 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575203.491389:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361192448/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575228 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575203.491397:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575203.491400:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575203.491402:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361192448:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575203.491407:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361192576:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575203.491425:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575203.491433:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575203/real 1788575203]  req@ffff8dc005dc1180 x1875453361192576/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575228 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575203.491440:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361192576/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575228 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575203.491451:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575203.491453:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575203.491455:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361192576:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575203.491458:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361192704:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575203.491469:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575203.491475:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575203/real 1788575203]  req@ffff8dc005dc0a80 x1875453361192704/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575228 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575203.491482:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361192704/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575228 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575203.491488:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575203.491489:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575203.491491:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361192704:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575203.491494:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361192832:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575203.491505:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575203.491511:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575203/real 1788575203]  req@ffff8dc005dc3b80 x1875453361192832/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575228 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575203.491518:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361192832/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575228 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575203.491539:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575203.491541:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575203.491544:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361192832:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575203.491549:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361192960:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575203.491564:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575203.491572:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575203/real 1788575203]  req@ffff8dc005dc2d80 x1875453361192960/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575228 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575203.491579:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361192960/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575228 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575203.491585:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575203.491587:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575203.491589:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361192960:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575203.491602:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361193088:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575203.491612:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575203.491618:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575203/real 1788575203]  req@ffff8dc005dc0700 x1875453361193088/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575228 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575203.491625:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361193088/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575228 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575203.491630:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575203.491632:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575203.491634:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361193088:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575203.875010:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575203.875010:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575203.875010:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575203.875052:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575203.875056:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575203.875056:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575204.514989:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575204.899007:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575204.899007:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575204.899035:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575204.899050:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788575204.899066:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575204.899070:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575205.538946:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575205.922976:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575205.922976:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575205.923003:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575205.923005:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575205.923041:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788575205.923059:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575206.562992:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575206.946943:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575206.946946:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575206.946982:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788575206.947008:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575206.947017:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575206.947040:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575207.586957:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575207.971045:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575207.971046:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575207.971049:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575207.971090:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575207.971099:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575207.971110:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575208.610938:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788575208.610952:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575208.610957:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788575208.610960:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575208.610967:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3554
00000100:00080000:3.0:1788575208.610975:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575208.610980:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575208.611013:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c700 x1875453361193216/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575208.611038:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575208.611041:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575208.611042:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575208.611045:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3554
00000100:00080000:3.0:1788575208.611049:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575208.611051:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575208.611059:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575208.611072:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e680 x1875453361193344/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575208.611083:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788575208.611084:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361193216:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788575208.611088:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575208.611092:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575208.611097:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3554
00000100:00080000:3.0:1788575208.611101:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575208.611104:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575208.611109:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575208.611119:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d180 x1875453361193472/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575208.611125:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575208.611127:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575208.611129:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575208.611131:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3554
00000100:00080000:3.0:1788575208.611134:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575208.611136:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575208.611138:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788575208.611143:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575208.611147:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f480 x1875453361193600/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575208.611158:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575208.611161:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575208.611162:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575208.611167:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3554
00000100:00080000:3.0:1788575208.611171:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575208.611174:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575208.611179:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575208.611189:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575208/real 1788575208]  req@ffff8dc00644c700 x1875453361193216/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575233 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575208.611191:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c380 x1875453361193728/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575208.611217:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575208.611220:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:2.0:1788575208.611222:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453361193216/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575233 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575208.611223:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575208.611233:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3554
00000100:00080000:2.0:1788575208.611236:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575208.611238:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575208.611242:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788575208.611245:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575208.611248:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361193216:192.168.202.140@tcp:250:kworker.0
00000008:00100000:3.0:1788575208.611263:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575208.611272:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361193344:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575208.611277:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d500 x1875453361193856/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788575208.611292:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788575208.611294:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575208.611299:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575208.611301:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788575208.611303:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575208/real 1788575208]  req@ffff8dc00644e680 x1875453361193344/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575233 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575208.611307:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3554
00000100:00080000:3.0:1788575208.611324:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575208.611329:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575208.611333:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453361193344/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575233 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1788575208.611335:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1788575208.611345:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1788575208.611349:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ea00 x1875453361193984/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575208.611350:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575208.611358:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361193344:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575208.611366:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361193472:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575208.611383:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575208.611390:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575208/real 1788575208]  req@ffff8dc00644d180 x1875453361193472/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575233 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575208.611397:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453361193472/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575233 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575208.611402:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575208.611404:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575208.611406:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361193472:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575208.611410:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361193600:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575208.611419:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575208.611425:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575208/real 1788575208]  req@ffff8dc00644f480 x1875453361193600/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575233 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575208.611431:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453361193600/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575233 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575208.611436:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575208.611438:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575208.611439:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361193600:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575208.611442:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361193728:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575208.611451:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575208.611457:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575208/real 1788575208]  req@ffff8dc00644c380 x1875453361193728/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575233 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575208.611464:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453361193728/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575233 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575208.611472:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575208.611475:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575208.611478:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361193728:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575208.611493:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361193856:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575208.611513:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575208.611523:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575208/real 1788575208]  req@ffff8dc00644d500 x1875453361193856/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575233 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575208.611530:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d500 x1875453361193856/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575233 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575208.611535:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575208.611537:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575208.611539:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361193856:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575208.611542:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361193984:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575208.611553:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575208.611558:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575208/real 1788575208]  req@ffff8dc00644ea00 x1875453361193984/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575233 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575208.611564:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ea00 x1875453361193984/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575233 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575208.611569:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575208.611571:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575208.611573:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361193984:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575208.994947:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575208.994949:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575208.994975:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575208.994981:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575208.994995:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575208.995009:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575209.634972:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575210.018971:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575210.018971:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575210.018971:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575210.018975:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575210.019001:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788575210.019039:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575210.658925:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575211.042980:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575211.042993:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575211.043065:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575211.043206:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575211.043232:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575211.043271:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575211.682960:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575212.066969:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575212.066969:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575212.066975:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575212.067000:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575212.067002:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575212.067017:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575212.706989:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575213.090950:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575213.090950:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575213.090952:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575213.090976:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575213.090977:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575213.090981:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575213.730962:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575213.730964:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575213.730973:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788575213.730977:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575213.730987:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3559
00000100:00080000:0.0:1788575213.730996:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575213.731001:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575213.731030:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361194112/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575213.731054:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575213.731056:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575213.731057:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575213.731060:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3559
00000100:00080000:0.0:1788575213.731062:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575213.731064:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575213.731072:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575213.731082:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361194112:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788575213.731088:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361194240/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575213.731115:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575213.731119:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575213.731121:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575213.731125:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3559
00000100:00080000:0.0:1788575213.731129:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575213.731133:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575213.731138:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575213.731152:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361194368/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575213.731162:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575213.731165:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575213.731167:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575213.731180:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3559
00000800:00000100:2.0:1788575213.731180:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788575213.731187:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575213.731191:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575213.731197:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575213.731210:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361194496/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575213.731220:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788575213.731224:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575213/real 1788575213]  req@ffff8dc006713b80 x1875453361194112/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575238 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575213.731225:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575213.731228:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575213.731238:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3559
00000100:00080000:0.0:1788575213.731243:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575213.731249:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575213.731249:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361194112/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575238 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1788575213.731258:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1788575213.731266:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575213.731273:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575213.731274:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361194624/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575213.731280:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361194112:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788575213.731293:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575213.731296:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575213.731297:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575213.731302:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3559
00000100:00080000:0.0:1788575213.731305:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575213.731311:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575213.731311:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361194240:192.168.202.140@tcp:38:kworker.0
00000008:00100000:0.0:1788575213.731318:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575213.731328:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361194752/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575213.731336:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575213.731338:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575213.731339:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575213.731344:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3559
00000800:00000100:2.0:1788575213.731346:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788575213.731347:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575213.731352:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575213.731356:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575213.731362:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361194880/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575213.731368:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575213/real 1788575213]  req@ffff8dc006711500 x1875453361194240/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575238 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575213.731385:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361194240/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575238 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575213.731396:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575213.731399:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575213.731403:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361194240:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575213.731409:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361194368:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575213.731430:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575213.731440:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575213/real 1788575213]  req@ffff8dc006712a00 x1875453361194368/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575238 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575213.731451:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361194368/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575238 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575213.731457:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575213.731459:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575213.731461:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361194368:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575213.731464:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361194496:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575213.731476:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575213.731491:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575213/real 1788575213]  req@ffff8dc006710e00 x1875453361194496/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575238 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575213.731498:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361194496/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575238 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575213.731503:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575213.731505:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575213.731507:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361194496:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575213.731510:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361194624:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575213.731520:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575213.731525:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575213/real 1788575213]  req@ffff8dc006713100 x1875453361194624/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575238 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575213.731531:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361194624/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575238 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575213.731536:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575213.731538:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575213.731539:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361194624:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575213.731549:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361194752:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575213.731558:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575213.731564:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575213/real 1788575213]  req@ffff8dc006711880 x1875453361194752/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575238 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575213.731570:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361194752/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575238 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575213.731574:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575213.731575:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575213.731578:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361194752:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575213.731581:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361194880:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575213.731589:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575213.731593:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575213/real 1788575213]  req@ffff8dc006713b80 x1875453361194880/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575238 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575213.731599:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361194880/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575238 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575213.731603:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575213.731605:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575213.731606:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361194880:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575214.114960:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575214.114961:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575214.114962:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788575214.114990:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575214.114992:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575214.114996:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575214.754923:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575215.138994:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575215.139026:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575215.139026:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575215.139026:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575215.139088:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575215.139148:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575215.778973:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575216.162987:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575216.162987:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575216.162993:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575216.163013:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575216.163069:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788575216.163125:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575216.803017:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575217.187041:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575217.187051:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575217.187052:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575217.187058:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575217.187112:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575217.187170:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575217.827082:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575218.210998:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575218.211021:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575218.211021:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575218.211029:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575218.211068:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788575218.211147:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575218.851003:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575218.851005:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575218.851012:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575218.851016:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575218.851025:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3564
00000100:00080000:1.0:1788575218.851036:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575218.851043:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575218.851078:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361195008/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575218.851100:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575218.851104:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575218.851106:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575218.851110:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3564
00000100:00080000:1.0:1788575218.851114:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575218.851118:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575218.851128:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575218.851132:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361195008:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788575218.851143:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361195136/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575218.851152:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575218.851155:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575218.851157:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575218.851160:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3564
00000100:00080000:1.0:1788575218.851163:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575218.851167:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575218.851172:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575218.851181:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361195264/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575218.851189:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575218.851192:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575218.851194:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575218.851198:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3564
00000100:00080000:1.0:1788575218.851201:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575218.851205:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575218.851223:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575218.851232:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361195136:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788575218.851238:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361195392/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575218.851248:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575218.851251:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575218.851253:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575218.851257:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3564
00000100:00080000:1.0:1788575218.851261:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1788575218.851263:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361195264:192.168.202.140@tcp:8:kworker.0
00000100:00080000:1.0:1788575218.851265:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575218.851270:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575218.851283:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361195520/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575218.851292:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361195392:192.168.202.140@tcp:8:kworker.0
00000100:00080000:1.0:1788575218.851294:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575218.851298:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575218.851300:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575218.851304:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3564
00000100:00080000:1.0:1788575218.851308:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575218.851313:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575218.851316:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361195520:192.168.202.140@tcp:38:kworker.0
00000008:00100000:1.0:1788575218.851318:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575218.851327:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361195648/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575218.851343:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575218.851346:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:2.0:1788575218.851346:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361195648:192.168.202.140@tcp:8:kworker.0
00000100:00080000:1.0:1788575218.851349:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575218.851355:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3564
00000100:00080000:1.0:1788575218.851358:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575218.851361:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575218.851366:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575218.851377:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361195776/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575218.851406:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361195776:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575219.234988:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575219.234993:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575219.235036:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575219.235038:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575219.235079:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575219.235086:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575219.875018:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575220.259016:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788575220.259025:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575220.259027:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575220.259038:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575220.259065:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575220.259066:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575220.898941:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575221.282941:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575221.282957:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575221.282961:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575221.282989:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575221.283004:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575221.283047:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575221.922980:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000400:00000100:0.0:1788575221.923159:0:2335:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.140:988
00000400:00000100:0.0:1788575221.923209:0:2335:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.140@tcp at host 192.168.202.140 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:0.0:1788575221.923231:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:0.0:1788575221.923271:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:0.0:1788575221.923281:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:0.0:1788575221.923293:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:0.0:1788575221.923305:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:0.0:1788575221.923316:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:2.0:1788575221.923323:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575218/real 1788575221]  req@ffff8dc005dc3b80 x1875453361195392/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575243 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:0.0:1788575221.923331:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:2.0:1788575221.923361:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361195392/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575243 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575221.923376:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575221.923382:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575221.923387:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361195392:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575221.923396:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575218/real 1788575221]  req@ffff8dc005dc0700 x1875453361195136/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575243 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575221.923417:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361195136/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575243 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575221.923428:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575221.923432:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575221.923435:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361195136:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575221.923457:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575218/real 1788575221]  req@ffff8dc005dc2d80 x1875453361195264/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575243 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575221.923472:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361195264/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575243 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575221.923480:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575221.923482:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575221.923485:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361195264:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575221.923492:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575218/real 1788575221]  req@ffff8dc005dc3800 x1875453361195008/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575243 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575221.923518:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361195008/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575243 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575221.923528:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575221.923532:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575221.923536:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361195008:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788575221.923568:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575218/real 1788575221]  req@ffff8dc005dc1500 x1875453361195776/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575243 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575221.923582:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361195776/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575243 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575221.923591:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575221.923596:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575221.923599:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361195776:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575221.923606:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575218/real 1788575221]  req@ffff8dc005dc1180 x1875453361195648/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575243 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575221.923616:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361195648/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575243 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575221.923624:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575221.923627:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575221.923630:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361195648:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575221.923636:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575218/real 1788575221]  req@ffff8dc005dc0a80 x1875453361195520/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575243 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575221.923647:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361195520/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575243 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575221.923655:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575221.923659:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575221.923661:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361195520:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575222.306977:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575222.306978:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575222.307007:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575222.307023:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575222.307026:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575222.307046:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575222.946953:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575223.330966:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575223.330966:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575223.330966:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575223.330997:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575223.331002:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788575223.331017:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1788575223.970950:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575223.970958:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:2.0:1788575223.970958:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575223.970963:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575223.970973:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3569
00000100:00080000:1.0:1788575223.970983:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575223.970990:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575223.971029:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361195904/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575223.971055:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575223.971058:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575223.971060:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575223.971063:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3569
00000100:00080000:1.0:1788575223.971067:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575223.971072:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575223.971081:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575223.971100:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361195904:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788575223.971101:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361196032/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575223.971121:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575223.971125:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575223.971129:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575223.971134:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3569
00000100:00080000:1.0:1788575223.971138:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575223.971143:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575223.971150:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575223.971165:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361196160/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575223.971176:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:2.0:1788575223.971180:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788575223.971183:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575223.971186:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575223.971192:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3569
00000100:00080000:1.0:1788575223.971198:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575223.971203:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575223.971208:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575223.971223:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361196288/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575223.971234:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575223/real 1788575223]  req@ffff8dc005dc1c00 x1875453361195904/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575248 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575223.971237:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575223.971246:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575223.971251:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575223.971261:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3569
00000100:00080000:1.0:1788575223.971266:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1788575223.971271:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361195904/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575248 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575223.971280:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575223.971287:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1788575223.971298:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1788575223.971304:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361196416/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575223.971306:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575223.971316:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361195904:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788575223.971327:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575223.971332:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575223.971334:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575223.971340:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3569
00000100:00080000:1.0:1788575223.971345:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1788575223.971350:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361196032:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788575223.971356:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575223.971361:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575223.971379:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361196544/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575223.971390:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575223.971393:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575223.971395:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575223.971401:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3569
00000100:00080000:1.0:1788575223.971405:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575223.971413:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:2.0:1788575223.971414:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:1.0:1788575223.971420:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575223.971436:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361196672/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575223.971444:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575223/real 1788575223]  req@ffff8dc005dc0a80 x1875453361196032/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575248 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575223.971461:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361196032/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575248 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575223.971475:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575223.971479:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575223.971489:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361196032:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575223.971500:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361196160:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575223.971525:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575223.971538:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575223/real 1788575223]  req@ffff8dc005dc1180 x1875453361196160/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575248 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575223.971551:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361196160/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575248 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575223.971561:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575223.971565:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575223.971569:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361196160:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575223.971576:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361196288:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575223.971598:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575223.971611:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575223/real 1788575223]  req@ffff8dc005dc1500 x1875453361196288/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575248 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575223.971633:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361196288/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575248 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575223.971642:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575223.971645:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575223.971648:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361196288:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575223.971655:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361196416:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575223.971676:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575223.971728:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575223/real 1788575223]  req@ffff8dc005dc3800 x1875453361196416/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575248 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575223.971741:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361196416/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575248 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575223.971750:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575223.971753:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575223.971756:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361196416:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575223.971776:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361196544:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575223.971799:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575223.971812:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575223/real 1788575223]  req@ffff8dc005dc2d80 x1875453361196544/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575248 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575223.971825:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361196544/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575248 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575223.971847:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575223.971850:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575223.971854:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361196544:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575223.971860:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361196672:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575223.971909:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575223.971922:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575223/real 1788575223]  req@ffff8dc005dc0700 x1875453361196672/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575248 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575223.971936:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361196672/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575248 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575223.971949:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575223.971952:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575223.971955:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361196672:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575224.354942:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575224.354959:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575224.354981:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575224.355013:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575224.355015:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575224.355079:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575224.995013:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575225.379021:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575225.379029:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575225.379067:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575225.379069:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575225.379082:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575225.379099:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575226.018950:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575226.403006:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575226.403013:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575226.403016:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575226.403016:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575226.403055:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575226.403143:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575227.042963:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575227.426978:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575227.426978:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575227.426979:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575227.427014:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575227.427027:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788575227.427062:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575228.066926:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575228.450974:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575228.450975:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575228.450980:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788575228.451007:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575228.451021:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575228.451024:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575229.090974:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788575229.090985:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575229.090991:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788575229.090996:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575229.091007:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3574
00000100:00080000:3.0:1788575229.091017:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575229.091026:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575229.091061:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ca80 x1875453361196800/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575229.091088:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575229.091091:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575229.091093:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575229.091099:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3574
00000100:00080000:3.0:1788575229.091103:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575229.091108:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575229.091115:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361196800:192.168.202.140@tcp:250:kworker.0
00000008:00100000:3.0:1788575229.091118:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575229.091135:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ce00 x1875453361196928/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575229.091146:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575229.091150:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575229.091152:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575229.091156:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3574
00000100:00080000:3.0:1788575229.091160:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575229.091164:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575229.091170:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575229.091183:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f800 x1875453361197056/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788575229.091195:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788575229.091195:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575229.091201:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575229.091205:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575229.091210:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3574
00000100:00080000:3.0:1788575229.091215:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575229.091219:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575229.091225:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575229.091239:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575229/real 1788575229]  req@ffff8dc00644ca80 x1875453361196800/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575254 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575229.091241:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c000 x1875453361197184/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575229.091265:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575229.091269:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:2.0:1788575229.091271:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ca80 x1875453361196800/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575254 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575229.091272:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575229.091280:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3574
00000100:00080000:3.0:1788575229.091286:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575229.091293:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:2.0:1788575229.091296:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:3.0:1788575229.091299:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1788575229.091306:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575229.091312:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644dc00 x1875453361197312/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575229.091315:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361196800:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788575229.091333:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575229.091336:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575229.091338:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575229.091343:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3574
00000100:00080000:3.0:1788575229.091347:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575229.091351:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575229.091356:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575229.091357:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361196928:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575229.091372:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ca80 x1875453361197440/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575229.091383:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575229.091387:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575229.091389:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:2.0:1788575229.091393:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788575229.091397:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3574
00000100:00080000:3.0:1788575229.091403:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575229.091408:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575229.091413:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575229.091418:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575229/real 1788575229]  req@ffff8dc00644ce00 x1875453361196928/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575254 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575229.091427:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ea00 x1875453361197568/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575229.091442:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ce00 x1875453361196928/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575254 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575229.091452:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575229.091456:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575229.091459:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361196928:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575229.091465:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361197056:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575229.091522:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575229.091535:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575229/real 1788575229]  req@ffff8dc00644f800 x1875453361197056/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575254 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575229.091548:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f800 x1875453361197056/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575254 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575229.091558:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575229.091561:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575229.091565:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361197056:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575229.091572:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361197184:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575229.091595:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575229.091608:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575229/real 1788575229]  req@ffff8dc00644c000 x1875453361197184/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575254 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575229.091618:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c000 x1875453361197184/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575254 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575229.091625:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575229.091627:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575229.091629:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361197184:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575229.091633:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361197312:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575229.091648:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575229.091655:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575229/real 1788575229]  req@ffff8dc00644dc00 x1875453361197312/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575254 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575229.091663:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644dc00 x1875453361197312/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575254 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575229.091669:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575229.091671:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575229.091673:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361197312:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575229.091685:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361197440:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575229.091695:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575229.091701:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575229/real 1788575229]  req@ffff8dc00644ca80 x1875453361197440/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575254 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575229.091709:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ca80 x1875453361197440/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575254 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575229.091714:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575229.091716:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575229.091718:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361197440:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575229.091722:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361197568:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575229.091731:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575229.091736:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575229/real 1788575229]  req@ffff8dc00644ea00 x1875453361197568/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575254 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575229.091743:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ea00 x1875453361197568/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575254 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575229.091748:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575229.091750:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575229.091752:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361197568:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575229.474959:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575229.474960:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575229.474985:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788575229.474989:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575229.475002:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575229.475006:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575230.114997:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575230.498945:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575230.498949:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575230.498950:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575230.498950:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575230.498981:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788575230.499020:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575231.138971:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575231.522966:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575231.522966:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575231.522966:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575231.522995:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575231.523008:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575231.523017:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575232.162977:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575232.546972:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575232.546972:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575232.546972:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575232.546997:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788575232.547004:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575232.547026:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575233.187037:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575233.571009:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575233.571010:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575233.571016:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788575233.571056:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575233.571056:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575233.571061:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00080000:3.0:1788575234.210974:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575234.210982:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788575234.210986:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575234.210994:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3579
00000100:00080000:3.0:1788575234.211003:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788575234.211007:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788575234.211011:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575234.211060:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d500 x1875453361197696/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575234.211083:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575234.211086:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575234.211087:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575234.211090:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3579
00000100:00080000:3.0:1788575234.211093:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575234.211096:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575234.211105:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575234.211113:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c380 x1875453361197824/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575234.211121:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575234.211126:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:2.0:1788575234.211127:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361197696:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788575234.211127:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575234.211136:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3579
00000100:00080000:3.0:1788575234.211138:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575234.211141:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575234.211145:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575234.211155:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f480 x1875453361197952/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575234.211162:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575234.211164:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575234.211166:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575234.211169:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3579
00000100:00080000:3.0:1788575234.211172:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575234.211175:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575234.211178:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788575234.211185:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575234.211189:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d180 x1875453361198080/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575234.211197:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575234.211199:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575234.211201:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575234.211205:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3579
00000100:00080000:3.0:1788575234.211207:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575234.211215:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575234.211218:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575234.211224:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575234/real 1788575234]  req@ffff8dc00644d500 x1875453361197696/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575259 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575234.211229:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e680 x1875453361198208/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575234.211249:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575234.211252:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575234.211268:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575234.211273:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3579
00000100:00100000:2.0:1788575234.211276:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d500 x1875453361197696/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575259 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575234.211276:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575234.211283:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575234.211291:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1788575234.211296:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575234.211301:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575234.211305:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c700 x1875453361198336/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575234.211308:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361197696:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788575234.211321:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575234.211324:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575234.211325:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575234.211329:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3579
00000100:00080000:3.0:1788575234.211332:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1788575234.211336:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361197824:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788575234.211338:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575234.211345:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575234.211352:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e300 x1875453361198464/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788575234.211367:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575234.211380:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575234/real 1788575234]  req@ffff8dc00644c380 x1875453361197824/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575259 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575234.211391:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453361197824/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575259 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575234.211399:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575234.211401:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575234.211403:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361197824:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575234.211407:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361197952:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575234.211422:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575234.211431:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575234/real 1788575234]  req@ffff8dc00644f480 x1875453361197952/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575259 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575234.211439:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453361197952/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575259 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575234.211450:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575234.211453:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575234.211455:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361197952:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575234.211460:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361198080:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575234.211474:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575234.211481:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575234/real 1788575234]  req@ffff8dc00644d180 x1875453361198080/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575259 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575234.211488:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453361198080/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575259 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575234.211494:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575234.211497:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575234.211499:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361198080:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575234.211504:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361198208:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575234.211519:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575234.211530:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575234/real 1788575234]  req@ffff8dc00644e680 x1875453361198208/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575259 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575234.211540:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453361198208/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575259 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575234.211546:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575234.211549:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575234.211553:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361198208:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575234.211557:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361198336:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575234.211573:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575234.211581:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575234/real 1788575234]  req@ffff8dc00644c700 x1875453361198336/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575259 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575234.211589:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453361198336/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575259 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575234.211596:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575234.211600:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575234.211603:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361198336:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575234.211618:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361198464:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575234.211632:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575234.211642:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575234/real 1788575234]  req@ffff8dc00644e300 x1875453361198464/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575259 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575234.211652:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453361198464/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575259 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575234.211658:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575234.211660:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575234.211662:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361198464:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575234.594980:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575234.594980:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575234.595017:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575234.595023:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575234.595039:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575234.595058:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575235.234957:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575235.618967:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575235.618967:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575235.618967:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575235.619006:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575235.619017:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575235.619017:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575236.259027:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575236.642975:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575236.643017:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575236.643018:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575236.643021:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788575236.643064:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575236.643067:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575237.282980:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575237.666937:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575237.666941:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575237.666949:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575237.666973:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575237.666988:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788575237.667008:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575238.307006:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575238.691010:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575238.691011:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575238.691014:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575238.691051:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575238.691068:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788575238.691097:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1788575239.330966:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575239.330975:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788575239.330979:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575239.330990:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3584
00000100:00100000:0.0:1788575239.330993:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788575239.330999:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575239.331007:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575239.331040:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644df80 x1875453361198592/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575239.331076:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575239.331079:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575239.331081:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575239.331084:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3584
00000100:00080000:3.0:1788575239.331086:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575239.331089:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575239.331097:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575239.331108:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ed80 x1875453361198720/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575239.331116:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575239.331121:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575239.331123:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788575239.331128:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361198592:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788575239.331130:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3584
00000100:00080000:3.0:1788575239.331137:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575239.331142:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575239.331149:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575239.331166:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f100 x1875453361198848/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575239.331176:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575239.331180:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575239.331182:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575239.331185:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3584
00000100:00080000:3.0:1788575239.331190:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1788575239.331192:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788575239.331197:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575239.331202:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575239.331220:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d880 x1875453361198976/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575239.331228:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575239.331231:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575239.331232:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575239.331235:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3584
00000100:00100000:2.0:1788575239.331240:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575239/real 1788575239]  req@ffff8dc00644df80 x1875453361198592/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575264 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575239.331241:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575239.331247:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575239.331253:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575239.331265:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644fb80 x1875453361199104/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575239.331272:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644df80 x1875453361198592/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575264 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575239.331277:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575239.331284:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575239.331287:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575239.331292:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575239.331292:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3584
00000100:00080000:3.0:1788575239.331297:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575239.331300:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788575239.331304:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575239.331309:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361198592:192.168.202.140@tcp:250:kworker.0
00000008:00100000:3.0:1788575239.331310:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575239.331322:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361198720:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575239.331325:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e300 x1875453361199232/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575239.331333:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575239.331336:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575239.331338:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575239.331341:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3584
00000100:00080000:3.0:1788575239.331344:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1788575239.331347:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788575239.331349:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575239.331354:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575239.331362:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575239/real 1788575239]  req@ffff8dc00644ed80 x1875453361198720/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575264 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575239.331372:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c700 x1875453361199360/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575239.331374:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ed80 x1875453361198720/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575264 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575239.331400:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575239.331403:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575239.331406:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361198720:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575239.331426:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361198848:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575239.331439:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575239.331445:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575239/real 1788575239]  req@ffff8dc00644f100 x1875453361198848/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575264 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575239.331453:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f100 x1875453361198848/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575264 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575239.331458:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575239.331460:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575239.331462:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361198848:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575239.331466:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361198976:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575239.331476:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575239.331482:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575239/real 1788575239]  req@ffff8dc00644d880 x1875453361198976/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575264 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575239.331489:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d880 x1875453361198976/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575264 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575239.331494:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575239.331496:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575239.331498:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361198976:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575239.331501:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361199104:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575239.331511:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575239.331517:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575239/real 1788575239]  req@ffff8dc00644fb80 x1875453361199104/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575264 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575239.331525:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644fb80 x1875453361199104/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575264 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575239.331530:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575239.331532:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575239.331534:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361199104:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575239.331537:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361199232:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575239.331547:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575239.331552:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575239/real 1788575239]  req@ffff8dc00644e300 x1875453361199232/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575264 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575239.331559:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453361199232/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575264 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575239.331572:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575239.331574:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575239.331579:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361199232:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575239.331583:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361199360:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575239.331594:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575239.331600:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575239/real 1788575239]  req@ffff8dc00644c700 x1875453361199360/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575264 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575239.331619:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453361199360/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575264 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575239.331625:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575239.331627:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575239.331629:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361199360:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575239.714956:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575239.714963:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575239.714997:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575239.714998:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575239.715004:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575239.715028:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575240.354943:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575240.739012:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575240.739012:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575240.739012:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575240.739080:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788575240.739083:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575240.739105:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575241.378985:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575241.762961:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575241.762961:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575241.762963:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575241.762967:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575241.763003:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788575241.763037:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575242.402965:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575242.786985:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575242.786992:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788575242.787044:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575242.787129:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575242.787148:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575242.787149:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575243.426989:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575243.810970:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575243.810970:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575243.810975:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788575243.811003:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575243.811015:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575243.811015:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575244.450927:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788575244.450933:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575244.450939:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788575244.450943:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575244.450951:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3590
00000100:00080000:3.0:1788575244.450959:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575244.450965:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575244.450994:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e680 x1875453361199488/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575244.451016:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575244.451018:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575244.451020:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575244.451023:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3590
00000100:00080000:3.0:1788575244.451025:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575244.451027:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575244.451035:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575244.451043:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d180 x1875453361199616/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575244.451051:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575244.451053:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575244.451057:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788575244.451058:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361199488:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788575244.451062:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3590
00000100:00080000:3.0:1788575244.451067:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575244.451069:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575244.451073:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575244.451085:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f480 x1875453361199744/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575244.451094:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575244.451098:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575244.451100:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575244.451104:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3590
00000100:00080000:3.0:1788575244.451112:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575244.451117:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575244.451122:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788575244.451128:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575244.451138:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c380 x1875453361199872/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575244.451150:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575244.451153:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575244.451155:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575244.451158:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3590
00000100:00080000:3.0:1788575244.451162:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575244.451165:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575244.451170:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575244.451173:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575244/real 1788575244]  req@ffff8dc00644e680 x1875453361199488/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575269 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575244.451183:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d500 x1875453361200000/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575244.451190:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788575244.451193:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453361199488/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575269 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575244.451194:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575244.451200:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575244.451207:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575244.451209:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3590
00000100:00080000:2.0:1788575244.451213:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788575244.451218:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1788575244.451219:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361199488:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788575244.451229:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575244.451236:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575244.451243:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361199616:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575244.451252:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ea00 x1875453361200128/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788575244.451264:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788575244.451266:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575244.451271:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575244.451273:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788575244.451276:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575244/real 1788575244]  req@ffff8dc00644d180 x1875453361199616/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575269 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575244.451283:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3590
00000100:00100000:2.0:1788575244.451290:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453361199616/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575269 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575244.451291:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575244.451299:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:2.0:1788575244.451304:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:3.0:1788575244.451306:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1788575244.451309:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575244.451313:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361199616:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575244.451318:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361199744:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575244.451322:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ca80 x1875453361200256/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788575244.451336:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575244.451347:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575244/real 1788575244]  req@ffff8dc00644f480 x1875453361199744/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575269 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575244.451356:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453361199744/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575269 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575244.451363:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575244.451365:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575244.451367:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361199744:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575244.451371:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361199872:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575244.451381:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575244.451387:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575244/real 1788575244]  req@ffff8dc00644c380 x1875453361199872/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575269 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575244.451399:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453361199872/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575269 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575244.451408:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575244.451411:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575244.451414:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361199872:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575244.451420:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361200000:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575244.451441:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575244.451453:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575244/real 1788575244]  req@ffff8dc00644d500 x1875453361200000/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575269 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575244.451461:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d500 x1875453361200000/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575269 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575244.451468:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575244.451470:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575244.451472:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361200000:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575244.451485:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361200128:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575244.451498:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575244.451504:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575244/real 1788575244]  req@ffff8dc00644ea00 x1875453361200128/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575269 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575244.451511:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ea00 x1875453361200128/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575269 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575244.451521:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575244.451523:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575244.451525:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361200128:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575244.451529:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361200256:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575244.451538:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575244.451543:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575244/real 1788575244]  req@ffff8dc00644ca80 x1875453361200256/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575269 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575244.451550:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ca80 x1875453361200256/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575269 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575244.451555:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575244.451557:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575244.451559:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361200256:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575244.835028:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575244.835028:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575244.835028:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575244.835033:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575244.835077:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788575244.835171:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575245.474981:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575245.858987:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575245.859005:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575245.859008:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575245.859029:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575245.859047:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575245.859050:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575246.499004:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575246.883005:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575246.883005:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575246.883008:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575246.883054:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575246.883054:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788575246.883130:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575247.522953:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575247.906965:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575247.906966:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575247.906966:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575247.906999:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788575247.907015:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575247.907016:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575248.547004:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575248.931006:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575248.931006:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575248.931009:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575248.931043:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575248.931072:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575248.931092:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575249.571028:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575249.571044:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575249.571053:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575249.571059:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575249.571073:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3595
00000100:00080000:1.0:1788575249.571087:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575249.571097:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575249.571149:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361200384/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575249.571182:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575249.571186:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575249.571189:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575249.571194:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3595
00000100:00080000:1.0:1788575249.571198:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575249.571204:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575249.571215:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575249.571231:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361200512/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575249.571238:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361200384:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788575249.571244:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575249.571248:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575249.571250:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575249.571253:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3595
00000100:00080000:1.0:1788575249.571256:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575249.571259:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575249.571262:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575249.571272:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361200640/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575249.571284:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575249.571287:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575249.571288:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575249.571291:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3595
00000100:00080000:1.0:1788575249.571294:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575249.571296:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575249.571299:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575249.571306:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361200768/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575249.571313:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575249.571315:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575249.571317:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575249.571319:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3595
00000100:00080000:1.0:1788575249.571322:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575249.571327:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:2.0:1788575249.571327:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:1.0:1788575249.571330:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575249.571339:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361200896/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575249.571346:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575249.571349:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575249.571351:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575249.571354:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3595
00000100:00080000:1.0:1788575249.571357:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575249.571360:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575249.571364:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575249.571374:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361201024/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575249.571384:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788575249.571388:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575249/real 1788575249]  req@ffff8dc005dc3b80 x1875453361200384/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575274 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575249.571389:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575249.571393:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575249.571403:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3595
00000100:00080000:1.0:1788575249.571410:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575249.571415:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575249.571419:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361200384/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575274 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1788575249.571423:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1788575249.571438:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1788575249.571441:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361201152/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575249.571447:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575249.571456:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361200384:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788575249.571483:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361200512:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575249.571505:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575249.571517:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575249/real 1788575249]  req@ffff8dc005dc0700 x1875453361200512/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575274 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575249.571531:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361200512/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575274 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575249.571542:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575249.571546:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575249.571550:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361200512:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575249.571556:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361200640:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575249.571586:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575249.571597:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575249/real 1788575249]  req@ffff8dc005dc2d80 x1875453361200640/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575274 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575249.571614:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361200640/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575274 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575249.571662:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575249.571666:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575249.571670:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361200640:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575249.571676:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361200768:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575249.571696:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575249.571706:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575249/real 1788575249]  req@ffff8dc005dc3800 x1875453361200768/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575274 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575249.571719:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361200768/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575274 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575249.571729:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575249.571732:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575249.571736:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361200768:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575249.571741:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361200896:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575249.571756:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575249.571766:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575249/real 1788575249]  req@ffff8dc005dc1500 x1875453361200896/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575274 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575249.571777:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361200896/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575274 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575249.571787:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575249.571790:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575249.571795:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361200896:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575249.571801:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361201024:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575249.571819:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575249.571830:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575249/real 1788575249]  req@ffff8dc005dc1180 x1875453361201024/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575274 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575249.571843:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361201024/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575274 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575249.571852:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575249.571855:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575249.571858:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361201024:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575249.571864:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361201152:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575249.571914:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575249.571925:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575249/real 1788575249]  req@ffff8dc005dc0a80 x1875453361201152/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575274 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575249.571937:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361201152/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575274 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575249.571947:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575249.571950:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575249.571954:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361201152:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575249.954987:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575249.954988:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575249.954995:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575249.954998:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575249.955028:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788575249.955094:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575250.595006:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575250.979004:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575250.979004:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575250.979005:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575250.979005:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575250.979044:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788575250.979111:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575251.619039:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575252.002987:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575252.002994:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788575252.003049:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575252.003105:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575252.003111:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575252.003113:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575252.642978:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575253.026943:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575253.026957:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575253.026963:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575253.026963:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575253.026991:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575253.027038:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575253.666968:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575254.050980:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575254.050980:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575254.050982:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575254.051012:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575254.051013:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575254.051014:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575254.690963:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788575254.690964:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575254.690972:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575254.690977:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575254.690985:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3600
00000100:00080000:1.0:1788575254.690994:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575254.691001:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575254.691034:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361201280/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575254.691055:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575254.691058:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575254.691059:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575254.691062:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3600
00000100:00080000:1.0:1788575254.691064:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575254.691066:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575254.691074:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575254.691085:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361201408/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575254.691092:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575254.691097:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:2.0:1788575254.691097:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361201280:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788575254.691101:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575254.691108:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3600
00000100:00080000:1.0:1788575254.691110:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575254.691113:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575254.691116:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575254.691125:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361201536/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575254.691136:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575254.691138:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575254.691140:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575254.691142:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3600
00000100:00080000:1.0:1788575254.691145:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575254.691147:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575254.691149:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575254.691157:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361201664/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575254.691162:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575254.691165:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575254.691166:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:2.0:1788575254.691172:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788575254.691173:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3600
00000100:00080000:1.0:1788575254.691178:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575254.691181:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575254.691184:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575254.691193:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361201792/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575254.691199:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575254.691202:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575254.691203:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575254.691206:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3600
00000100:00080000:1.0:1788575254.691209:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575254.691212:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575254.691216:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575254.691225:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575254/real 1788575254]  req@ffff8dc005dc1c00 x1875453361201280/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575279 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575254.691226:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361201920/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575254.691246:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575254.691253:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575254.691256:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575254.691258:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3600
00000100:00080000:1.0:1788575254.691260:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575254.691263:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575254.691267:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361201280/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575279 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1788575254.691269:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1788575254.691281:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1788575254.691283:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361202048/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575254.691287:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575254.691294:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361201280:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788575254.691321:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361201408:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575254.691340:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575254.691349:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575254/real 1788575254]  req@ffff8dc005dc0a80 x1875453361201408/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575279 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575254.691357:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361201408/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575279 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575254.691363:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575254.691366:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575254.691368:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361201408:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575254.691372:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361201536:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575254.691384:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575254.691390:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575254/real 1788575254]  req@ffff8dc005dc1180 x1875453361201536/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575279 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575254.691397:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361201536/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575279 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575254.691403:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575254.691405:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575254.691407:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361201536:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575254.691410:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361201664:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575254.691442:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575254.691450:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575254/real 1788575254]  req@ffff8dc005dc1500 x1875453361201664/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575279 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575254.691458:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361201664/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575279 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575254.691464:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575254.691466:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575254.691468:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361201664:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575254.691472:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361201792:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575254.691482:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575254.691488:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575254/real 1788575254]  req@ffff8dc005dc3800 x1875453361201792/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575279 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575254.691496:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361201792/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575279 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575254.691502:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575254.691504:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575254.691505:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361201792:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575254.691509:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361201920:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575254.691519:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575254.691525:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575254/real 1788575254]  req@ffff8dc005dc2d80 x1875453361201920/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575279 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575254.691532:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361201920/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575279 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575254.691537:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575254.691538:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575254.691540:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361201920:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575254.691543:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361202048:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575254.691553:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575254.691558:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575254/real 1788575254]  req@ffff8dc005dc0700 x1875453361202048/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575279 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575254.691572:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361202048/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575279 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575254.691582:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575254.691584:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575254.691586:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361202048:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575255.074942:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575255.074952:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575255.074962:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575255.075013:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575255.075014:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575255.075127:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575255.715023:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575256.098991:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575256.098991:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575256.098991:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575256.098991:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575256.099028:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575256.099072:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575256.739004:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575257.122955:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575257.122965:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575257.123012:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575257.123015:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575257.123019:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575257.123038:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575257.762973:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575258.146990:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575258.146990:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575258.146990:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575258.146990:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575258.147028:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575258.147064:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575258.787027:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575259.171015:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575259.171015:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575259.171064:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575259.171149:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575259.171162:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575259.171237:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575259.810973:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575259.811011:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575259.811020:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788575259.811024:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575259.811032:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3605
00000100:00080000:0.0:1788575259.811041:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575259.811047:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575259.811078:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361202176/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575259.811105:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575259.811108:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575259.811109:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575259.811113:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3605
00000100:00080000:0.0:1788575259.811117:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575259.811121:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575259.811132:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575259.811148:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361202304/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575259.811162:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788575259.811162:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361202176:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788575259.811177:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575259.811181:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575259.811186:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3605
00000100:00080000:0.0:1788575259.811190:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575259.811195:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575259.811212:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575259.811226:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361202432/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575259.811234:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575259.811236:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575259.811238:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575259.811241:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3605
00000100:00080000:0.0:1788575259.811247:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575259.811250:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575259.811253:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575259.811259:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361202560/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575259.811266:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575259.811270:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575259.811272:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575259.811277:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3605
00000800:00000100:2.0:1788575259.811285:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788575259.811286:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575259.811302:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575259.811310:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575259.811323:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453361202688/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575259.811330:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575259.811333:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575259.811335:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575259.811339:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3605
00000100:00080000:0.0:1788575259.811343:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575259.811347:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575259.811354:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575259/real 1788575259]  req@ffff8dc006713800 x1875453361202176/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575284 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1788575259.811355:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575259.811373:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361202816/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575259.811402:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788575259.811403:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361202176/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575284 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575259.811416:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575259.811421:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575259.811430:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575259.811431:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3605
00000100:00080000:0.0:1788575259.811442:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575259.811445:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788575259.811451:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575259.811459:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361202176:192.168.202.140@tcp:250:kworker.0
00000008:00100000:0.0:1788575259.811460:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575259.811488:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361202944/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575259.811501:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361202304:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575259.811536:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575259.811551:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575259/real 1788575259]  req@ffff8dc006711c00 x1875453361202304/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575284 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575259.811565:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361202304/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575284 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575259.811578:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575259.811581:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575259.811585:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361202304:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575259.811592:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361202432:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575259.811614:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575259.811627:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575259/real 1788575259]  req@ffff8dc006713480 x1875453361202432/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575284 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575259.811638:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361202432/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575284 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575259.811647:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575259.811651:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575259.811654:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361202432:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575259.811662:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361202560:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575259.811679:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575259.811690:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575259/real 1788575259]  req@ffff8dc006712680 x1875453361202560/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575284 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575259.811702:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361202560/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575284 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575259.811711:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575259.811714:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575259.811718:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361202560:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575259.811724:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361202688:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575259.811744:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575259.811757:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575259/real 1788575259]  req@ffff8dc006710380 x1875453361202688/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575284 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575259.811769:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453361202688/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575284 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575259.811779:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575259.811782:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575259.811786:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361202688:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575259.811793:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361202816:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575259.811815:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575259.811826:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575259/real 1788575259]  req@ffff8dc006712300 x1875453361202816/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575284 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575259.811839:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361202816/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575284 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575259.811892:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575259.811896:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575259.811900:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361202816:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575259.811922:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361202944:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575259.811946:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575259.811960:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575259/real 1788575259]  req@ffff8dc006713b80 x1875453361202944/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575284 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575259.811974:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361202944/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575284 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575259.811983:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575259.811987:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575259.811991:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361202944:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575260.195010:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575260.195010:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575260.195010:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575260.195044:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575260.195045:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575260.195047:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575260.835010:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575261.218984:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575261.218985:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575261.218985:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575261.219015:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575261.219023:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575261.219026:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575261.858957:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575262.242929:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575262.242939:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575262.242941:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575262.242955:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575262.242968:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575262.243001:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575262.882974:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575263.267020:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575263.267021:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575263.267021:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575263.267182:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575263.267199:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575263.267268:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575263.907065:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575264.291041:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575264.291042:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575264.291042:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575264.291047:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575264.291099:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575264.291149:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1788575264.931014:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788575264.931015:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575264.931028:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788575264.931034:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575264.931046:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3610
00000100:00080000:0.0:1788575264.931067:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575264.931076:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575264.931134:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361203072/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575264.931176:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575264.931180:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575264.931182:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575264.931188:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3610
00000100:00080000:0.0:1788575264.931191:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575264.931196:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575264.931210:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575264.931223:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361203200/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575264.931234:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575264.931238:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575264.931240:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575264.931244:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3610
00000100:00080000:0.0:1788575264.931247:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575264.931251:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575264.931256:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575264.931266:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361203328/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575264.931275:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575264.931280:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575264.931282:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575264.931285:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3610
00000100:00080000:0.0:1788575264.931289:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575264.931293:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575264.931299:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575264.931310:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361203456/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575264.931320:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575264.931324:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575264.931326:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575264.931330:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3610
00000100:00080000:0.0:1788575264.931334:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575264.931337:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575264.931342:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575264.931350:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361203584/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575264.931359:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575264.931363:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575264.931365:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575264.931369:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3610
00000100:00080000:0.0:1788575264.931372:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575264.931375:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575264.931381:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575264.931396:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361203712/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575264.931406:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575264.931409:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575264.931411:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575264.931415:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3610
00000100:00080000:0.0:1788575264.931418:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575264.931423:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575264.931428:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575264.931439:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361203840/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575264.931537:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361203072:192.168.202.140@tcp:250:kworker.0
00000800:00000100:2.0:1788575264.931630:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575264.931697:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575264/real 1788575264]  req@ffff8dc006711880 x1875453361203072/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575289 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575264.931718:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361203072/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575289 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575264.931731:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575264.931735:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575264.931740:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361203072:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788575264.931748:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361203200:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575264.931776:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575264.931791:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575264/real 1788575264]  req@ffff8dc006713100 x1875453361203200/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575289 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575264.931806:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361203200/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575289 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575264.931818:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575264.931822:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575264.931826:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361203200:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575264.931832:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361203328:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575264.931857:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575264.931893:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575264/real 1788575264]  req@ffff8dc006710e00 x1875453361203328/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575289 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575264.931916:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361203328/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575289 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575264.931926:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575264.931929:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575264.931933:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361203328:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575264.931940:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361203456:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575264.931963:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575264.931976:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575264/real 1788575264]  req@ffff8dc006712a00 x1875453361203456/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575289 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575264.932007:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361203456/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575289 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575264.932018:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575264.932022:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575264.932026:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361203456:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575264.932033:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361203584:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575264.932057:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575264.932069:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575264/real 1788575264]  req@ffff8dc006711500 x1875453361203584/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575289 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575264.932083:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361203584/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575289 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575264.932101:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575264.932105:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575264.932109:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361203584:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575264.932117:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361203712:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575264.932138:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575264.932150:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575264/real 1788575264]  req@ffff8dc006713b80 x1875453361203712/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575289 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575264.932163:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361203712/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575289 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575264.932172:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575264.932176:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575264.932179:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361203712:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575264.932186:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361203840:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575264.932209:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575264.932223:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575264/real 1788575264]  req@ffff8dc006712300 x1875453361203840/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575289 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575264.932235:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361203840/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575289 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575264.932243:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575264.932247:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575264.932252:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361203840:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575265.315038:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575265.315041:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575265.315041:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575265.315042:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575265.315090:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575265.315167:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575265.954993:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575266.338993:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575266.338993:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575266.338993:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575266.338993:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575266.339024:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575266.339070:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575266.979006:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575267.362984:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575267.362984:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575267.363007:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575267.363048:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575267.363103:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575267.363137:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575268.002981:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575268.386998:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575268.386998:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575268.386998:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575268.387014:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575268.387044:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575268.387108:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575269.026993:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575269.410959:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575269.410984:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575269.411013:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575269.411016:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575269.411127:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575269.411128:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575270.050984:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788575270.050986:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575270.050995:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788575270.051000:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575270.051010:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3615
00000100:00080000:3.0:1788575270.051020:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575270.051030:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575270.051067:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644dc00 x1875453361203968/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575270.051097:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575270.051101:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575270.051103:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575270.051108:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3615
00000100:00080000:3.0:1788575270.051113:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575270.051119:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575270.051130:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575270.051137:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361203968:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788575270.051150:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c000 x1875453361204096/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575270.051164:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575270.051168:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575270.051171:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575270.051176:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3615
00000100:00080000:3.0:1788575270.051181:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575270.051187:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575270.051193:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575270.051208:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f800 x1875453361204224/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575270.051220:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1788575270.051221:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788575270.051228:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575270.051231:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575270.051237:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3615
00000100:00100000:0.0:1788575270.051266:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575270/real 1788575270]  req@ffff8dc00644dc00 x1875453361203968/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575295 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575270.051286:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644dc00 x1875453361203968/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575295 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575270.051298:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575270.051302:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575270.051307:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361203968:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788575270.051316:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575270.051325:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575270.051332:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575270.051335:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361204096:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575270.051363:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575270.051378:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575270/real 1788575270]  req@ffff8dc00644c000 x1875453361204096/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575295 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575270.051392:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c000 x1875453361204096/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575295 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575270.051400:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575270.051403:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575270.051406:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361204096:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575270.051410:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361204224:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575270.051429:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575270.051438:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575270/real 1788575270]  req@ffff8dc00644f800 x1875453361204224/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575295 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575270.051446:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f800 x1875453361204224/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575295 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575270.051452:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575270.051459:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575270.051463:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361204224:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575270.051521:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ce00 x1875453361204352/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575270.051545:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575270.051550:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575270.051553:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788575270.051558:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361204352:192.168.202.140@tcp:8:kworker.0
00000100:00080000:3.0:1788575270.051563:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3615
00000100:00080000:3.0:1788575270.051570:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575270.051577:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:0.0:1788575270.051583:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:3.0:1788575270.051586:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575270.051595:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575270/real 1788575270]  req@ffff8dc00644ce00 x1875453361204352/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575295 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575270.051606:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f800 x1875453361204480/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575270.051609:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ce00 x1875453361204352/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575295 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575270.051643:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575270.051645:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575270.051651:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575270.051655:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788575270.051657:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788575270.051665:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361204352:192.168.202.140@tcp:8:kworker.0
00000100:00080000:3.0:1788575270.051667:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3615
00000100:00080000:3.0:1788575270.051676:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575270.051681:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575270.051687:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575270.051690:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361204480:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575270.051704:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c000 x1875453361204608/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575270.051718:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1788575270.051720:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788575270.051725:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575270.051729:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575270.051735:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3615
00000100:00100000:0.0:1788575270.051740:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575270/real 1788575270]  req@ffff8dc00644f800 x1875453361204480/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575295 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575270.051741:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575270.051750:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575270.051760:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575270.051767:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f800 x1875453361204480/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575295 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575270.051777:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644dc00 x1875453361204736/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575270.051783:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575270.051793:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575270.051800:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361204480:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575270.051818:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361204608:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575270.051855:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575270.051889:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575270/real 1788575270]  req@ffff8dc00644c000 x1875453361204608/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575295 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575270.051907:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c000 x1875453361204608/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575295 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575270.051916:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575270.051920:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575270.051930:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361204608:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575270.051937:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361204736:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575270.051958:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575270.051970:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575270/real 1788575270]  req@ffff8dc00644dc00 x1875453361204736/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575295 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575270.051982:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644dc00 x1875453361204736/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575295 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575270.051990:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575270.051993:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575270.051997:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361204736:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575270.434956:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575270.434956:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575270.434959:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575270.434986:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575270.434987:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575270.434993:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575271.075005:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575271.458992:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575271.458992:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575271.459022:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575271.459033:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575271.459117:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575271.459143:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575272.099008:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575272.482957:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575272.482957:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575272.482959:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575272.482961:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575272.482991:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575272.483030:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575273.122967:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575273.506967:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575273.506967:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575273.506968:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575273.506968:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575273.506998:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575273.507025:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575274.146969:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575274.530920:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575274.530922:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575274.530931:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575274.530947:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575274.530964:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575274.530982:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1788575275.170946:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788575275.170950:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788575275.170956:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788575275.170960:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575275.170967:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3620
00000100:00080000:2.0:1788575275.170974:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575275.170979:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575275.171006:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453361204864/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575275.171023:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575275.171025:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575275.171027:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575275.171029:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3620
00000100:00080000:2.0:1788575275.171031:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575275.171033:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575275.171040:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575275.171047:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361204992/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575275.171053:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575275.171055:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575275.171056:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575275.171062:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3620
00000100:00100000:0.0:1788575275.171063:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361204864:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788575275.171064:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575275.171067:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575275.171073:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575275.171079:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361205120/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575275.171084:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575275.171086:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575275.171087:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575275.171089:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3620
00000100:00080000:2.0:1788575275.171092:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575275.171094:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575275.171097:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575275.171103:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453361205248/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575275.171108:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575275.171110:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575275.171111:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575275.171113:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3620
00000100:00080000:2.0:1788575275.171115:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575275.171117:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575275.171120:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575275.171129:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453361205376/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1788575275.171133:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788575275.171142:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575275.171146:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575275.171148:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575275.171153:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3620
00000100:00080000:2.0:1788575275.171157:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575275.171161:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575275.171166:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575275.171172:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575275/real 1788575275]  req@ffff8dc020497480 x1875453361204864/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575300 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575275.171180:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361205504/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575275.171189:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453361204864/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575300 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575275.171205:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575275.171208:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575275.171213:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361204864:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788575275.171220:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788575275.171221:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361204992:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788575275.171226:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575275.171229:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575275.171233:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3620
00000100:00080000:2.0:1788575275.171236:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575275.171239:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:0.0:1788575275.171243:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:2.0:1788575275.171243:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575275.171253:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575275/real 1788575275]  req@ffff8dc020495880 x1875453361204992/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575300 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575275.171257:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361205632/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575275.171283:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361204992/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575300 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575275.171295:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575275.171298:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575275.171302:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361204992:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575275.171321:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361205120:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575275.171336:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575275.171343:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575275/real 1788575275]  req@ffff8dc020495180 x1875453361205120/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575300 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575275.171351:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361205120/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575300 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575275.171356:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575275.171358:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575275.171359:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361205120:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575275.171362:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361205248:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575275.171371:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575275.171376:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575275/real 1788575275]  req@ffff8dc020494a80 x1875453361205248/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575300 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575275.171383:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453361205248/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575300 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575275.171387:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575275.171389:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575275.171390:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361205248:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575275.171393:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361205376:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575275.171403:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575275.171408:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575275/real 1788575275]  req@ffff8dc020494e00 x1875453361205376/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575300 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575275.171414:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453361205376/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575300 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575275.171422:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575275.171424:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575275.171426:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361205376:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575275.171429:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361205504:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575275.171437:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575275.171442:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575275/real 1788575275]  req@ffff8dc020495500 x1875453361205504/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575300 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575275.171448:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361205504/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575300 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575275.171452:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575275.171454:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575275.171455:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361205504:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575275.171458:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361205632:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575275.171466:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575275.171471:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575275/real 1788575275]  req@ffff8dc020494000 x1875453361205632/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575300 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575275.171476:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361205632/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575300 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575275.171481:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575275.171482:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575275.171484:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361205632:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575275.554958:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575275.554959:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575275.554964:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575275.554966:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575275.554992:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575275.555017:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575276.194990:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575276.578936:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575276.578936:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575276.578937:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575276.578937:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575276.578977:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575276.578998:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575277.218987:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575277.603000:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575277.603000:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575277.603000:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575277.603007:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575277.603054:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575277.603089:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575278.242957:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575278.626969:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575278.626969:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575278.626980:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575278.626981:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575278.627023:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575278.627047:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575279.266990:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575279.650961:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575279.650995:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575279.650999:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575279.651003:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575279.651028:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575279.651028:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575280.290952:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575280.290975:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575280.290982:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575280.290986:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575280.290994:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3625
00000100:00080000:1.0:1788575280.291004:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575280.291010:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575280.291044:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361205760/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575280.291070:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575280.291074:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575280.291076:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575280.291080:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3625
00000100:00080000:1.0:1788575280.291083:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575280.291088:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575280.291097:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575280.291107:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361205760:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788575280.291113:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361205888/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575280.291124:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575280.291128:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575280.291130:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575280.291134:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3625
00000100:00080000:1.0:1788575280.291137:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575280.291141:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575280.291146:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575280.291156:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361206016/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575280.291165:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1788575280.291171:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788575280.291171:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575280.291176:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575280.291180:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3625
00000100:00080000:1.0:1788575280.291183:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575280.291187:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575280.291192:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575280.291203:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361206144/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575280.291220:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575280/real 1788575280]  req@ffff8dc005dc3b80 x1875453361205760/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575305 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575280.291242:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361205760/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575305 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575280.291242:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575280.291252:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575280.291256:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575280.291258:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575280.291263:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788575280.291263:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3625
00000100:00100000:0.0:1788575280.291269:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361205760:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788575280.291270:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575280.291277:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575280.291281:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575280.291287:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361205888:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788575280.291295:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361206272/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1788575280.291306:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788575280.291307:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575280.291312:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575280.291314:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788575280.291317:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575280/real 1788575280]  req@ffff8dc005dc0700 x1875453361205888/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575305 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575280.291322:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3625
00000100:00080000:1.0:1788575280.291330:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788575280.291333:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361205888/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575305 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575280.291338:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575280.291347:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1788575280.291352:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575280.291356:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575280.291363:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361205888:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788575280.291363:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361206400/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575280.291369:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361206016:192.168.202.140@tcp:8:kworker.0
00000100:00080000:1.0:1788575280.291381:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575280.291385:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000800:00000100:0.0:1788575280.291388:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788575280.291389:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575280.291395:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3625
00000100:00100000:0.0:1788575280.291398:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575280/real 1788575280]  req@ffff8dc005dc2d80 x1875453361206016/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575305 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575280.291401:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575280.291409:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575280.291413:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361206016/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575305 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1788575280.291416:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1788575280.291424:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575280.291426:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575280.291429:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361206016:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575280.291433:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361206528/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575280.291437:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361206144:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575280.291455:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575280.291462:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575280/real 1788575280]  req@ffff8dc005dc3800 x1875453361206144/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575305 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575280.291469:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361206144/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575305 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575280.291475:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575280.291476:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575280.291479:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361206144:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575280.291487:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361206272:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575280.291496:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575280.291527:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575280/real 1788575280]  req@ffff8dc005dc1500 x1875453361206272/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575305 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575280.291535:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361206272/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575305 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575280.291540:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575280.291541:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575280.291543:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361206272:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575280.291547:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361206400:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575280.291559:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575280.291564:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575280/real 1788575280]  req@ffff8dc005dc1180 x1875453361206400/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575305 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575280.291570:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361206400/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575305 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575280.291580:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575280.291582:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575280.291584:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361206400:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575280.291587:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361206528:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575280.291596:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575280.291602:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575280/real 1788575280]  req@ffff8dc005dc0a80 x1875453361206528/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575305 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575280.291609:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361206528/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575305 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575280.291613:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575280.291615:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575280.291616:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361206528:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575280.674955:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575280.674955:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575280.674955:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575280.674985:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575280.674987:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575280.674999:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575281.314959:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575281.698962:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575281.698964:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575281.698974:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575281.698976:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575281.698986:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575281.699000:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575282.338952:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575282.722961:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575282.722961:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575282.722961:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575282.722961:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575282.722988:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575282.723026:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575283.362963:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575283.746950:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575283.746956:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575283.746958:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575283.746981:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575283.746986:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575283.747022:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575284.386954:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575284.770927:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575284.770934:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575284.770935:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575284.770956:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575284.770968:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575284.771003:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1788575285.411011:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788575285.411012:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575285.411022:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788575285.411028:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575285.411040:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3631
00000100:00080000:0.0:1788575285.411053:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575285.411061:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575285.411105:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453361206656/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575285.411133:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575285.411140:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575285.411141:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575285.411144:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3631
00000100:00080000:0.0:1788575285.411148:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575285.411151:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575285.411161:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575285.411174:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361206784/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575285.411177:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361206656:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788575285.411193:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575285.411196:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575285.411198:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575285.411203:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3631
00000100:00080000:0.0:1788575285.411207:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575285.411211:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575285.411217:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575285.411230:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361206912/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575285.411236:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575285.411238:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575285.411240:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575285.411243:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3631
00000100:00080000:0.0:1788575285.411252:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575285.411255:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575285.411258:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575285.411265:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361207040/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575285.411279:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575285.411282:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575285.411284:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575285.411288:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3631
00000100:00080000:0.0:1788575285.411293:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575285.411298:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575285.411303:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575285.411315:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361206784:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575285.411318:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361207168/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575285.411329:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575285.411332:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575285.411333:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575285.411348:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3631
00000100:00080000:0.0:1788575285.411353:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575285.411358:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575285.411364:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575285.411368:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361206912:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575285.411381:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361207296/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575285.411392:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575285.411396:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575285.411398:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788575285.411403:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361207040:192.168.202.140@tcp:8:kworker.0
00000100:00080000:0.0:1788575285.411407:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3631
00000100:00080000:0.0:1788575285.411413:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575285.411418:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575285.411424:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575285.411438:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361207424/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575285.411443:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361207168:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575285.411471:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361207296:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575285.411486:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361207424:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575285.794982:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575285.794982:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575285.794987:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575285.795018:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575285.795022:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575285.795056:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575286.435007:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575286.818943:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575286.818946:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575286.818951:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575286.818973:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575286.818979:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575286.818986:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575287.459042:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575287.843001:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575287.843001:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575287.843001:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575287.843054:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575287.843057:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575287.843076:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575288.483114:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000400:00000100:2.0:1788575288.483149:0:2337:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.140:988
00000400:00000100:2.0:1788575288.483190:0:2337:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.140@tcp at host 192.168.202.140 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:2.0:1788575288.483207:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:2.0:1788575288.483282:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:2.0:1788575288.483294:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:2.0:1788575288.483303:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:2.0:1788575288.483312:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:2.0:1788575288.483321:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:2.0:1788575288.483329:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:0.0:1788575288.483406:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575285/real 1788575288]  req@ffff8dc006713b80 x1875453361207424/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575310 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575288.483434:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361207424/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575310 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575288.483447:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575288.483452:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575288.483457:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361207424:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575288.483467:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575285/real 1788575288]  req@ffff8dc006713800 x1875453361207168/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575310 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575288.483480:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361207168/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575310 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575288.483490:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575288.483494:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575288.483498:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361207168:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575288.483506:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575285/real 1788575288]  req@ffff8dc006712300 x1875453361207296/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575310 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575288.483519:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361207296/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575310 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575288.483527:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575288.483531:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575288.483534:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361207296:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575288.483542:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575285/real 1788575288]  req@ffff8dc006712680 x1875453361206784/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575310 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575288.483555:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361206784/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575310 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575288.483565:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575288.483569:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575288.483573:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361206784:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575288.483586:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575285/real 1788575288]  req@ffff8dc006713480 x1875453361206912/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575310 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575288.483599:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361206912/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575310 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575288.483608:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575288.483612:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575288.483615:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361206912:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575288.483623:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575285/real 1788575288]  req@ffff8dc006711c00 x1875453361207040/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575310 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575288.483636:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361207040/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575310 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575288.483644:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575288.483648:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575288.483651:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361207040:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575288.483659:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575285/real 1788575288]  req@ffff8dc006710380 x1875453361206656/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575310 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575288.483672:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453361206656/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575310 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575288.483681:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575288.483684:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575288.483687:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361206656:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788575288.866958:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575288.866958:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575288.866958:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575288.866989:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575288.867010:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788575288.867014:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575289.507026:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575289.890978:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575289.890978:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575289.890982:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575289.891009:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575289.891015:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575289.891030:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1788575290.531003:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575290.531011:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788575290.531015:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575290.531024:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3636
00000100:00080000:3.0:1788575290.531033:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575290.531040:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575290.531060:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575290.531075:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ca80 x1875453361207552/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575290.531103:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575290.531106:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575290.531107:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575290.531110:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3636
00000100:00080000:3.0:1788575290.531112:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575290.531114:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575290.531122:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575290.531130:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ea00 x1875453361207680/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575290.531135:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575290.531138:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575290.531139:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575290.531141:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3636
00000100:00080000:3.0:1788575290.531143:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575290.531146:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575290.531151:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575290.531162:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d500 x1875453361207808/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575290.531172:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575290.531216:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575290.531218:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575290.531222:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3636
00000100:00080000:3.0:1788575290.531226:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575290.531230:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575290.531236:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575290.531250:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c380 x1875453361207936/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575290.531261:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575290.531264:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575290.531266:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575290.531271:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3636
00000100:00080000:3.0:1788575290.531275:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788575290.531278:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361207552:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788575290.531283:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575290.531292:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575290.531303:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f480 x1875453361208064/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575290.531310:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575290.531313:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575290.531315:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575290.531318:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3636
00000100:00080000:3.0:1788575290.531320:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575290.531323:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575290.531327:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575290.531334:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d180 x1875453361208192/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575290.531344:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575290.531347:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575290.531348:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575290.531350:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3636
00000100:00080000:3.0:1788575290.531353:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575290.531355:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575290.531360:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788575290.531366:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575290.531373:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e680 x1875453361208320/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575290.531422:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575290/real 1788575290]  req@ffff8dc00644ca80 x1875453361207552/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575315 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575290.531451:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ca80 x1875453361207552/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575315 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575290.531463:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575290.531468:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575290.531472:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361207552:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788575290.531480:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361207680:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575290.531505:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575290.531521:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575290/real 1788575290]  req@ffff8dc00644ea00 x1875453361207680/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575315 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575290.531533:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ea00 x1875453361207680/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575315 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575290.531545:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575290.531549:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575290.531552:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361207680:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575290.531559:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361207808:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575290.531584:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575290.531597:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575290/real 1788575290]  req@ffff8dc00644d500 x1875453361207808/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575315 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575290.531610:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d500 x1875453361207808/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575315 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575290.531625:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575290.531629:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575290.531651:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361207808:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575290.531659:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361207936:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575290.531680:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575290.531692:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575290/real 1788575290]  req@ffff8dc00644c380 x1875453361207936/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575315 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575290.531704:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453361207936/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575315 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575290.531712:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575290.531716:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575290.531719:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361207936:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575290.531761:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361208064:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575290.531783:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575290.531794:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575290/real 1788575290]  req@ffff8dc00644f480 x1875453361208064/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575315 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575290.531804:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453361208064/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575315 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575290.531813:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575290.531817:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575290.531821:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361208064:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575290.531827:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361208192:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575290.531846:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575290.531858:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575290/real 1788575290]  req@ffff8dc00644d180 x1875453361208192/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575315 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575290.531904:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453361208192/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575315 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575290.531913:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575290.531916:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575290.531920:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361208192:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575290.531927:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361208320:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575290.531948:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575290.531961:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575290/real 1788575290]  req@ffff8dc00644e680 x1875453361208320/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575315 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575290.531974:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453361208320/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575315 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575290.531982:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575290.531985:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575290.531989:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361208320:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575290.914975:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575290.914975:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575290.914976:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575290.914977:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575290.915022:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788575290.915078:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575291.555057:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575291.938976:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575291.938976:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575291.938984:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575291.938988:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575291.939007:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788575291.939055:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575292.579001:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575292.962978:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575292.962978:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575292.962978:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575292.962978:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575292.963013:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788575292.963052:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575293.603014:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575293.986981:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575293.986981:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575293.986993:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575293.986993:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575293.987037:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575293.987143:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575294.627007:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575295.011064:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575295.011064:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575295.011066:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575295.011066:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575295.011117:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788575295.011219:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1788575295.651026:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575295.651035:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:1.0:1788575295.651037:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788575295.651040:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575295.651059:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3641
00000100:00080000:2.0:1788575295.651069:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575295.651077:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575295.651113:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453361208448/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575295.651134:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575295.651137:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575295.651138:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575295.651141:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3641
00000100:00080000:2.0:1788575295.651143:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575295.651146:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575295.651153:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575295.651162:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453361208576/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575295.651169:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575295.651172:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575295.651173:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575295.651177:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3641
00000100:00080000:2.0:1788575295.651179:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575295.651181:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575295.651185:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575295.651193:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361208704/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575295.651195:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361208448:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788575295.651208:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575295.651211:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575295.651212:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575295.651215:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3641
00000100:00080000:2.0:1788575295.651217:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575295.651219:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575295.651222:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575295.651229:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453361208832/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575295.651234:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575295.651236:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575295.651237:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575295.651239:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3641
00000100:00080000:2.0:1788575295.651242:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575295.651244:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575295.651247:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575295.651254:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453361208960/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575295.651261:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575295.651263:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575295.651265:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575295.651267:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3641
00000100:00080000:2.0:1788575295.651269:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575295.651271:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575295.651274:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788575295.651279:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575295.651286:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361209088/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575295.651294:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575295.651297:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575295.651298:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575295.651301:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3641
00000100:00080000:2.0:1788575295.651303:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575295.651305:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575295.651308:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575295.651315:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361209216/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575295.651330:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575295/real 1788575295]  req@ffff8dc020496a00 x1875453361208448/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575320 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575295.651352:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453361208448/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575320 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575295.651363:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575295.651368:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575295.651372:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361208448:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788575295.651381:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361208576:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575295.651405:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575295.651419:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575295/real 1788575295]  req@ffff8dc020496d80 x1875453361208576/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575320 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575295.651433:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453361208576/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575320 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575295.651444:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575295.651447:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575295.651452:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361208576:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575295.651478:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361208704:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575295.651499:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575295.651511:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575295/real 1788575295]  req@ffff8dc020494700 x1875453361208704/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575320 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575295.651523:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361208704/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575320 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575295.651532:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575295.651535:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575295.651539:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361208704:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575295.651545:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361208832:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575295.651564:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575295.651575:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575295/real 1788575295]  req@ffff8dc020494380 x1875453361208832/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575320 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575295.651587:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453361208832/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575320 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575295.651596:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575295.651599:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575295.651603:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361208832:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575295.651609:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361208960:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575295.651627:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575295.651639:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575295/real 1788575295]  req@ffff8dc020497100 x1875453361208960/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575320 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575295.651651:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453361208960/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575320 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575295.651660:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575295.651663:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575295.651667:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361208960:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575295.651672:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361209088:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575295.651692:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575295.651716:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575295/real 1788575295]  req@ffff8dc020494000 x1875453361209088/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575320 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575295.651729:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361209088/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575320 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575295.651737:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575295.651740:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575295.651743:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361209088:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575295.651749:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361209216:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575295.651769:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575295.651781:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575295/real 1788575295]  req@ffff8dc020495500 x1875453361209216/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575320 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575295.651794:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361209216/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575320 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575295.651800:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575295.651803:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575295.651805:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361209216:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575296.034929:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575296.034971:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575296.034975:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575296.034978:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575296.035025:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788575296.035061:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575296.674948:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575297.058989:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575297.058989:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575297.058989:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575297.058990:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575297.059022:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788575297.059086:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575297.698984:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575298.082965:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575298.082966:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575298.082969:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575298.082973:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575298.083002:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788575298.083031:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575298.722979:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575299.107082:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575299.107083:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575299.107084:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575299.107093:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575299.107137:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788575299.107222:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575299.747039:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575300.130972:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575300.130974:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575300.130976:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575300.130977:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575300.131015:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788575300.131069:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1788575300.770962:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788575300.770966:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788575300.770981:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788575300.770986:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575300.770998:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3646
00000100:00080000:2.0:1788575300.771010:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575300.771018:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575300.771064:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453361209344/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575300.771093:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575300.771098:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575300.771100:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575300.771104:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3646
00000100:00080000:2.0:1788575300.771108:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575300.771112:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575300.771123:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575300.771139:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453361209472/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575300.771147:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361209344:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788575300.771157:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575300.771169:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575300.771171:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575300.771177:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3646
00000100:00080000:2.0:1788575300.771182:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575300.771187:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575300.771193:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575300.771207:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361209600/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575300.771217:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575300.771220:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575300.771222:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575300.771225:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3646
00000100:00080000:2.0:1788575300.771229:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575300.771233:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575300.771238:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788575300.771245:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575300.771254:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361209728/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575300.771269:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575300.771272:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575300.771274:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575300.771279:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3646
00000100:00080000:2.0:1788575300.771283:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575300.771288:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575300.771295:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575300.771307:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575300/real 1788575300]  req@ffff8dc020494e00 x1875453361209344/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575325 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575300.771313:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453361209856/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575300.771359:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453361209344/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575325 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575300.771359:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575300.771374:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575300.771377:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575300.771391:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3646
00000100:00080000:2.0:1788575300.771398:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575300.771399:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575300.771406:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:0.0:1788575300.771413:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000008:00100000:2.0:1788575300.771417:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575300.771423:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361209344:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788575300.771437:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361209984/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575300.771447:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575300.771451:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575300.771454:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788575300.771460:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361209472:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788575300.771463:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3646
00000100:00080000:2.0:1788575300.771472:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575300.771478:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575300.771484:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575300.771497:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361210112/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1788575300.771503:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575300.771531:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575300/real 1788575300]  req@ffff8dc020494a80 x1875453361209472/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575325 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575300.771548:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453361209472/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575325 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575300.771560:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575300.771564:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575300.771568:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361209472:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575300.771576:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361209600:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575300.771599:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575300.771612:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575300/real 1788575300]  req@ffff8dc020495180 x1875453361209600/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575325 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575300.771624:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361209600/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575325 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575300.771633:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575300.771637:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575300.771640:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361209600:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575300.771646:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361209728:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575300.771666:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575300.771677:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575300/real 1788575300]  req@ffff8dc020495880 x1875453361209728/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575325 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575300.771690:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361209728/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575325 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575300.771699:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575300.771703:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575300.771706:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361209728:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575300.771713:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361209856:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575300.771733:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575300.771745:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575300/real 1788575300]  req@ffff8dc020497480 x1875453361209856/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575325 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575300.771756:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453361209856/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575325 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575300.771765:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575300.771768:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575300.771771:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361209856:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575300.771778:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361209984:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575300.771800:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575300.771811:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575300/real 1788575300]  req@ffff8dc020495500 x1875453361209984/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575325 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575300.771823:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361209984/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575325 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575300.771832:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575300.771835:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575300.771839:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361209984:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575300.771907:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361210112:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575300.771929:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575300.771941:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575300/real 1788575300]  req@ffff8dc020494000 x1875453361210112/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575325 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575300.771953:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361210112/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575325 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575300.771983:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575300.771988:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575300.771992:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361210112:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575301.154992:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575301.154992:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575301.155037:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575301.155066:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575301.155118:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575301.155139:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575301.794999:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575302.179007:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575302.179007:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575302.179013:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575302.179062:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788575302.179116:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575302.179125:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575302.819009:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575303.203022:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575303.203022:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575303.203042:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575303.203062:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788575303.203072:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575303.203078:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575303.842970:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575304.226986:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575304.227002:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575304.227002:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575304.227084:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575304.227112:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788575304.227176:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575304.867002:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575305.250970:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575305.250970:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575305.251017:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575305.251030:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788575305.251036:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575305.251040:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00080000:2.0:1788575305.890956:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788575305.890961:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788575305.890965:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788575305.890970:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575305.890980:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3651
00000100:00080000:2.0:1788575305.890990:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575305.890996:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575305.891027:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453361210240/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575305.891052:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575305.891055:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575305.891056:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575305.891059:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3651
00000100:00080000:2.0:1788575305.891061:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575305.891064:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575305.891071:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575305.891080:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453361210368/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575305.891089:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575305.891093:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575305.891095:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575305.891101:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3651
00000100:00100000:0.0:1788575305.891102:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361210240:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788575305.891109:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575305.891116:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575305.891122:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575305.891137:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361210496/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575305.891150:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575305.891153:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575305.891154:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575305.891157:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3651
00000100:00080000:2.0:1788575305.891161:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575305.891163:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575305.891167:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788575305.891172:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575305.891190:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453361210624/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575305.891198:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575305.891200:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575305.891202:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575305.891206:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3651
00000100:00080000:2.0:1788575305.891208:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575305.891211:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575305.891216:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575305.891217:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575305/real 1788575305]  req@ffff8dc020497100 x1875453361210240/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575330 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575305.891227:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453361210752/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575305.891245:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788575305.891247:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453361210240/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575330 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575305.891251:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575305.891256:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575305.891263:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3651
00000100:00080000:2.0:1788575305.891267:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575305.891272:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575305.891272:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:0.0:1788575305.891280:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000008:00100000:2.0:1788575305.891282:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575305.891286:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361210240:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788575305.891293:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361210368:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575305.891311:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361210880/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1788575305.891319:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788575305.891324:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575305.891328:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575305.891330:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788575305.891334:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575305/real 1788575305]  req@ffff8dc020494380 x1875453361210368/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575330 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575305.891336:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3651
00000100:00080000:2.0:1788575305.891343:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575305.891350:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575305.891354:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453361210368/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575330 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1788575305.891357:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1788575305.891369:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575305.891372:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575305.891377:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361210368:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575305.891377:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361211008/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575305.891400:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361210496:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575305.891423:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575305.891435:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575305/real 1788575305]  req@ffff8dc020494700 x1875453361210496/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575330 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575305.891443:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361210496/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575330 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575305.891450:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575305.891452:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575305.891455:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361210496:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575305.891460:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361210624:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575305.891479:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575305.891487:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575305/real 1788575305]  req@ffff8dc020496d80 x1875453361210624/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575330 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575305.891498:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453361210624/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575330 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575305.891505:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575305.891507:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575305.891509:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361210624:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575305.891513:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361210752:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575305.891527:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575305.891537:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575305/real 1788575305]  req@ffff8dc020496a00 x1875453361210752/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575330 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575305.891551:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453361210752/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575330 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575305.891562:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575305.891566:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575305.891571:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361210752:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575305.891580:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361210880:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575305.891606:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575305.891621:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575305/real 1788575305]  req@ffff8dc020494000 x1875453361210880/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575330 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575305.891636:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361210880/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575330 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575305.891642:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575305.891645:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575305.891648:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361210880:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575305.891671:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361211008:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575305.891713:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575305.891723:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575305/real 1788575305]  req@ffff8dc020495500 x1875453361211008/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575330 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575305.891732:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361211008/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575330 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575305.891738:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575305.891741:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575305.891743:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361211008:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575306.274962:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575306.274962:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575306.274962:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575306.274978:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575306.275014:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575306.275039:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575306.915020:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575307.298970:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575307.298982:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575307.298989:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575307.299024:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575307.299029:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788575307.299086:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575307.938972:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575308.322963:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575308.322973:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575308.322977:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575308.322979:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575308.323027:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575308.323078:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575308.963026:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575309.347022:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575309.347022:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575309.347026:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575309.347070:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575309.347077:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575309.347088:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575309.986927:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575310.370929:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575310.370932:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575310.370938:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575310.370938:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575310.370961:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575310.370999:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1788575311.010980:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788575311.010983:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788575311.010989:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788575311.010994:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575311.011004:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3656
00000100:00080000:3.0:1788575311.011014:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575311.011022:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575311.011057:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c700 x1875453361211136/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575311.011086:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575311.011089:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575311.011091:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575311.011096:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3656
00000100:00080000:3.0:1788575311.011099:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575311.011102:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575311.011110:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575311.011120:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e300 x1875453361211264/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575311.011127:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575311.011130:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575311.011131:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575311.011137:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3656
00000100:00100000:0.0:1788575311.011138:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361211136:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788575311.011139:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575311.011147:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575311.011151:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575311.011161:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644fb80 x1875453361211392/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575311.011167:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575311.011170:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575311.011172:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575311.011174:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3656
00000100:00080000:3.0:1788575311.011177:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575311.011179:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575311.011182:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575311.011190:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d880 x1875453361211520/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575311.011195:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575311.011197:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575311.011199:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1788575311.011204:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788575311.011208:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3656
00000100:00080000:3.0:1788575311.011214:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575311.011218:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575311.011224:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575311.011236:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f100 x1875453361211648/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575311.011246:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575311.011250:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575311.011252:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575311.011257:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3656
00000100:00080000:3.0:1788575311.011261:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788575311.011263:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575311/real 1788575311]  req@ffff8dc00644c700 x1875453361211136/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575336 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575311.011268:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575311.011279:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575311.011284:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453361211136/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575336 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575311.011293:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1788575311.011295:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ed80 x1875453361211776/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575311.011298:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575311.011305:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361211136:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788575311.011317:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361211264:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788575311.011322:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575311.011327:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575311.011329:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575311.011336:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3656
00000800:00000100:0.0:1788575311.011340:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788575311.011341:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575311.011350:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575311.011354:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575311/real 1788575311]  req@ffff8dc00644e300 x1875453361211264/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575336 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1788575311.011357:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575311.011370:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453361211264/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575336 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575311.011378:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644df80 x1875453361211904/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575311.011380:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575311.011387:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575311.011394:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361211264:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575311.011420:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361211392:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575311.011434:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575311.011440:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575311/real 1788575311]  req@ffff8dc00644fb80 x1875453361211392/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575336 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575311.011452:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644fb80 x1875453361211392/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575336 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575311.011458:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575311.011460:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575311.011462:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361211392:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575311.011468:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361211520:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575311.011487:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575311.011498:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575311/real 1788575311]  req@ffff8dc00644d880 x1875453361211520/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575336 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575311.011511:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d880 x1875453361211520/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575336 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575311.011518:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575311.011520:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575311.011552:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361211520:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575311.011559:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361211648:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575311.011578:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575311.011587:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575311/real 1788575311]  req@ffff8dc00644f100 x1875453361211648/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575336 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575311.011594:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f100 x1875453361211648/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575336 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575311.011604:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575311.011606:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575311.011608:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361211648:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575311.011612:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361211776:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575311.011626:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575311.011636:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575311/real 1788575311]  req@ffff8dc00644ed80 x1875453361211776/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575336 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575311.011648:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ed80 x1875453361211776/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575336 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575311.011657:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575311.011661:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575311.011665:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361211776:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575311.011671:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361211904:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575311.011687:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575311.011695:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575311/real 1788575311]  req@ffff8dc00644df80 x1875453361211904/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575336 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575311.011703:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644df80 x1875453361211904/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575336 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575311.011708:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575311.011710:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575311.011713:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361211904:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575311.394946:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575311.394947:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575311.394953:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575311.394975:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788575311.394990:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575311.394992:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575312.034963:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575312.418981:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575312.418982:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575312.418982:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575312.419010:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575312.419022:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575312.419027:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575313.058996:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575313.442957:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575313.442957:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575313.442957:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575313.443085:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575313.443098:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788575313.443185:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575314.082973:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575314.467005:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575314.467005:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575314.467005:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575314.467005:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575314.467044:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575314.467104:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575315.107143:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575315.490948:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575315.490948:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575315.490959:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575315.490982:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575315.491000:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788575315.491069:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1788575316.130975:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575316.130984:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:0.0:1788575316.130986:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788575316.130987:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575316.130998:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3661
00000100:00080000:3.0:1788575316.131008:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575316.131014:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575316.131048:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644df80 x1875453361212032/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575316.131077:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575316.131081:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575316.131083:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575316.131088:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3661
00000100:00080000:3.0:1788575316.131091:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575316.131095:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575316.131105:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575316.131120:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ed80 x1875453361212160/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575316.131127:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361212032:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788575316.131137:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575316.131142:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575316.131144:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575316.131148:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3661
00000100:00080000:3.0:1788575316.131152:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575316.131157:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575316.131163:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575316.131176:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f100 x1875453361212288/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575316.131185:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575316.131189:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575316.131191:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575316.131195:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3661
00000800:00000100:0.0:1788575316.131202:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788575316.131203:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575316.131210:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575316.131216:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575316.131227:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d880 x1875453361212416/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575316.131242:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788575316.131247:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575316/real 1788575316]  req@ffff8dc00644df80 x1875453361212032/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575341 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575316.131248:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575316.131252:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575316.131263:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3661
00000100:00080000:3.0:1788575316.131268:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788575316.131272:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644df80 x1875453361212032/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575341 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575316.131277:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:0.0:1788575316.131286:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:3.0:1788575316.131290:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1788575316.131294:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575316.131301:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361212032:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788575316.131307:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644fb80 x1875453361212544/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575316.131318:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575316.131321:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575316.131323:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788575316.131328:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361212160:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788575316.131332:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3661
00000100:00080000:3.0:1788575316.131338:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575316.131342:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575316.131347:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788575316.131372:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575316.131374:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e300 x1875453361212672/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575316.131387:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788575316.131391:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575316/real 1788575316]  req@ffff8dc00644ed80 x1875453361212160/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575341 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575316.131393:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575316.131397:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575316.131411:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3661
00000100:00100000:0.0:1788575316.131414:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ed80 x1875453361212160/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575341 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575316.131418:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575316.131428:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575316.131434:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1788575316.131436:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575316.131441:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575316.131444:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361212160:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575316.131451:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361212288:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575316.131455:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c700 x1875453361212800/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1788575316.131471:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575316.131482:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575316/real 1788575316]  req@ffff8dc00644f100 x1875453361212288/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575341 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575316.131491:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f100 x1875453361212288/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575341 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575316.131497:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575316.131500:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575316.131502:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361212288:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575316.131505:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361212416:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575316.131516:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575316.131522:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575316/real 1788575316]  req@ffff8dc00644d880 x1875453361212416/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575341 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575316.131529:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d880 x1875453361212416/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575341 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575316.131543:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575316.131546:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575316.131548:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361212416:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575316.131552:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361212544:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575316.131563:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575316.131570:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575316/real 1788575316]  req@ffff8dc00644fb80 x1875453361212544/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575341 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575316.131577:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644fb80 x1875453361212544/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575341 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575316.131583:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575316.131585:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575316.131587:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361212544:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575316.131599:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361212672:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575316.131610:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575316.131616:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575316/real 1788575316]  req@ffff8dc00644e300 x1875453361212672/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575341 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575316.131623:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453361212672/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575341 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575316.131628:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575316.131630:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575316.131632:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361212672:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575316.131636:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361212800:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575316.131645:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575316.131651:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575316/real 1788575316]  req@ffff8dc00644c700 x1875453361212800/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575341 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575316.131658:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453361212800/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575341 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575316.131663:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575316.131665:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575316.131667:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361212800:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575316.514986:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575316.514986:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575316.514986:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575316.514987:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575316.515019:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575316.515052:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575317.155023:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575317.538972:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575317.538973:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575317.538976:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575317.539004:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575317.539019:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575317.539034:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575318.178955:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575318.562977:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575318.562977:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575318.562978:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575318.563098:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575318.563116:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788575318.563151:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575319.202967:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575319.587053:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575319.587053:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575319.587054:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575319.587330:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575319.587341:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575319.587422:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575320.226958:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575320.610963:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575320.610964:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575320.610966:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575320.611001:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575320.611002:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575320.611011:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575321.250968:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788575321.250977:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575321.250982:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788575321.250986:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575321.250993:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3666
00000100:00080000:2.0:1788575321.251001:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575321.251007:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575321.251040:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453361212928/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575321.251060:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575321.251063:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575321.251064:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575321.251067:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3666
00000100:00080000:2.0:1788575321.251069:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575321.251071:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575321.251079:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575321.251088:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361213056/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575321.251096:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575321.251098:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575321.251101:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788575321.251103:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361212928:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788575321.251105:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3666
00000100:00080000:2.0:1788575321.251111:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575321.251114:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575321.251118:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575321.251126:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361213184/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575321.251132:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575321.251134:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575321.251136:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575321.251145:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3666
00000100:00080000:2.0:1788575321.251149:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575321.251153:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575321.251158:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788575321.251172:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575321.251174:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453361213312/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575321.251187:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575321.251191:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575321.251193:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575321.251208:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3666
00000100:00080000:2.0:1788575321.251212:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575321.251215:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575321.251221:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575321.251228:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575321/real 1788575321]  req@ffff8dc020497480 x1875453361212928/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575346 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575321.251233:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453361213440/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575321.251251:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788575321.251254:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453361212928/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575346 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575321.251258:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575321.251263:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575321.251269:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575321.251272:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3666
00000100:00080000:0.0:1788575321.251277:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788575321.251280:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788575321.251281:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361212928:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788575321.251290:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575321.251295:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575321.251306:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453361213568/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575321.251308:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361213056:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788575321.251322:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575321.251325:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575321.251327:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575321.251331:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3666
00000100:00080000:2.0:1788575321.251335:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1788575321.251337:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788575321.251341:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575321.251345:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575321.251353:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575321/real 1788575321]  req@ffff8dc020495880 x1875453361213056/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575346 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575321.251357:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361213696/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575321.251378:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361213056/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575346 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575321.251387:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575321.251390:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575321.251392:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361213056:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575321.251398:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361213184:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575321.251411:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575321.251417:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575321/real 1788575321]  req@ffff8dc020495180 x1875453361213184/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575346 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575321.251425:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361213184/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575346 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575321.251435:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575321.251437:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575321.251439:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361213184:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575321.251443:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361213312:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575321.251454:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575321.251460:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575321/real 1788575321]  req@ffff8dc020494a80 x1875453361213312/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575346 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575321.251467:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453361213312/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575346 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575321.251473:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575321.251475:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575321.251477:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361213312:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575321.251481:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361213440:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575321.251491:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575321.251497:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575321/real 1788575321]  req@ffff8dc020494e00 x1875453361213440/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575346 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575321.251504:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453361213440/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575346 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575321.251510:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575321.251512:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575321.251514:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361213440:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575321.251525:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361213568:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575321.251535:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575321.251541:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575321/real 1788575321]  req@ffff8dc020497480 x1875453361213568/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575346 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575321.251549:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453361213568/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575346 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575321.251554:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575321.251556:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575321.251557:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361213568:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575321.251561:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361213696:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575321.251569:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575321.251575:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575321/real 1788575321]  req@ffff8dc020495500 x1875453361213696/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575346 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575321.251582:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361213696/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575346 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575321.251587:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575321.251589:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575321.251590:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361213696:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575321.634950:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575321.634952:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575321.634958:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575321.634984:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575321.635002:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575321.635009:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575322.274951:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575322.658966:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575322.658966:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575322.658970:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575322.658996:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575322.659002:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575322.659007:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575323.298971:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575323.682971:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575323.682980:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575323.683003:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575323.683017:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788575323.683028:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575323.683039:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575324.323013:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575324.706975:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575324.706975:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575324.706976:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575324.706976:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575324.707005:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575324.707051:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575325.346991:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575325.730966:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575325.730966:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575325.730966:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575325.730966:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575325.730992:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788575325.731081:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1788575326.371064:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788575326.371068:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788575326.371082:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788575326.371087:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575326.371098:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3672
00000100:00080000:3.0:1788575326.371110:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575326.371123:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575326.371179:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e680 x1875453361213824/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575326.371211:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575326.371215:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575326.371216:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575326.371223:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3672
00000100:00080000:3.0:1788575326.371226:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575326.371230:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575326.371241:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575326.371253:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d180 x1875453361213952/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575326.371261:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575326.371263:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575326.371265:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575326.371268:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3672
00000100:00080000:3.0:1788575326.371270:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788575326.371274:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361213824:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788575326.371275:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575326.371282:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575326.371292:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f480 x1875453361214080/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575326.371303:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575326.371307:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575326.371309:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575326.371314:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3672
00000100:00080000:3.0:1788575326.371318:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575326.371322:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575326.371328:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575326.371342:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c380 x1875453361214208/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1788575326.371351:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788575326.371356:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575326.371361:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575326.371363:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575326.371369:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3672
00000100:00080000:3.0:1788575326.371373:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575326.371379:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575326.371385:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575326.371398:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d500 x1875453361214336/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575326.371409:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788575326.371413:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575326/real 1788575326]  req@ffff8dc00644e680 x1875453361213824/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575351 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575326.371414:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575326.371419:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575326.371428:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3672
00000100:00080000:3.0:1788575326.371437:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575326.371443:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575326.371449:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453361213824/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575351 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1788575326.371450:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1788575326.371466:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1788575326.371469:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ea00 x1875453361214464/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575326.371473:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575326.371481:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361213824:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788575326.371490:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788575326.371494:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361213952:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788575326.371497:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575326.371501:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575326.371507:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3672
00000100:00080000:3.0:1788575326.371511:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575326.371515:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575326.371520:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575326.371534:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ca80 x1875453361214592/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1788575326.371536:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575326.371559:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575326/real 1788575326]  req@ffff8dc00644d180 x1875453361213952/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575351 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575326.371571:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453361213952/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575351 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575326.371582:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575326.371585:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575326.371590:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361213952:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575326.371621:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361214080:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575326.371647:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575326.371661:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575326/real 1788575326]  req@ffff8dc00644f480 x1875453361214080/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575351 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575326.371672:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453361214080/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575351 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575326.371678:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575326.371680:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575326.371683:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361214080:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575326.371687:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361214208:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575326.371703:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575326.371710:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575326/real 1788575326]  req@ffff8dc00644c380 x1875453361214208/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575351 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575326.371717:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453361214208/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575351 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575326.371723:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575326.371725:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575326.371727:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361214208:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575326.371731:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361214336:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575326.371742:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575326.371749:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575326/real 1788575326]  req@ffff8dc00644d500 x1875453361214336/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575351 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575326.371757:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d500 x1875453361214336/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575351 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575326.371763:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575326.371765:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575326.371767:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361214336:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575326.371771:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361214464:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575326.371782:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575326.371788:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575326/real 1788575326]  req@ffff8dc00644ea00 x1875453361214464/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575351 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575326.371799:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ea00 x1875453361214464/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575351 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575326.371808:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575326.371811:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575326.371815:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361214464:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575326.371821:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361214592:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575326.371842:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575326.371853:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575326/real 1788575326]  req@ffff8dc00644ca80 x1875453361214592/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575351 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575326.371862:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ca80 x1875453361214592/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575351 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575326.371889:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575326.371891:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575326.371894:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361214592:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575326.755040:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575326.755041:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575326.755041:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575326.755178:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575326.755184:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575326.755256:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575327.394980:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575327.778914:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575327.778937:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575327.778962:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575327.778987:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575327.779031:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788575327.779107:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575328.419038:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575328.802978:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575328.802989:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575328.803002:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575328.803012:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575328.803021:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575328.803039:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575329.443047:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575329.827009:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575329.827009:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575329.827013:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575329.827013:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575329.827060:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575329.827140:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575330.466990:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575330.850988:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575330.851022:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575330.851030:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575330.851035:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575330.851152:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575330.851173:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575331.491027:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788575331.491041:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575331.491049:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788575331.491055:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575331.491068:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3677
00000100:00080000:2.0:1788575331.491082:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575331.491092:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575331.491141:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361214720/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575331.491179:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575331.491194:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575331.491197:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575331.491203:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3677
00000100:00080000:2.0:1788575331.491208:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575331.491213:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575331.491226:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575331.491243:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361214720:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788575331.491244:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453361214848/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575331.491263:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575331.491267:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575331.491269:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575331.491274:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3677
00000100:00080000:2.0:1788575331.491278:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575331.491283:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575331.491290:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575331.491304:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453361214976/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575331.491315:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575331.491319:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575331.491322:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1788575331.491323:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788575331.491331:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3677
00000100:00080000:2.0:1788575331.491337:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575331.491342:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575331.491348:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575331.491363:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361215104/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575331.491374:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788575331.491378:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575331/real 1788575331]  req@ffff8dc020494000 x1875453361214720/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575356 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575331.491379:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575331.491383:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575331.491393:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3677
00000100:00080000:2.0:1788575331.491399:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575331.491405:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575331.491411:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575331.491417:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361214720/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575356 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575331.491427:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453361215232/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575331.491436:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575331.491440:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575331.491447:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788575331.491447:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575331.491451:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788575331.491457:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361214720:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788575331.491458:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3677
00000100:00080000:2.0:1788575331.491465:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575331.491469:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575331.491474:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575331.491485:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453361215360/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575331.491497:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361214848:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788575331.491498:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575331.491507:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575331.491509:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575331.491515:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3677
00000100:00080000:2.0:1788575331.491520:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575331.491525:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:0.0:1788575331.491531:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:2.0:1788575331.491532:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575331.491548:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361215488/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575331.491559:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575331/real 1788575331]  req@ffff8dc020496a00 x1875453361214848/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575356 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575331.491577:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453361214848/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575356 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575331.491586:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575331.491589:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575331.491592:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361214848:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575331.491596:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361214976:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575331.491614:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575331.491622:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575331/real 1788575331]  req@ffff8dc020496d80 x1875453361214976/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575356 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575331.491631:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453361214976/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575356 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575331.491637:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575331.491639:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575331.491642:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361214976:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575331.491645:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361215104:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575331.491656:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575331.491661:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575331/real 1788575331]  req@ffff8dc020494700 x1875453361215104/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575356 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575331.491669:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361215104/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575356 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575331.491676:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575331.491678:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575331.491680:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361215104:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575331.491684:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361215232:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575331.491698:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575331.491710:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575331/real 1788575331]  req@ffff8dc020494380 x1875453361215232/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575356 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575331.491722:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453361215232/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575356 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575331.491733:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575331.491736:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575331.491740:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361215232:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575331.491755:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361215360:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575331.491771:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575331.491779:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575331/real 1788575331]  req@ffff8dc020497100 x1875453361215360/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575356 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575331.491787:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453361215360/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575356 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575331.491792:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575331.491793:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575331.491796:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361215360:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575331.491800:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361215488:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575331.491811:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575331.491817:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575331/real 1788575331]  req@ffff8dc020494000 x1875453361215488/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575356 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575331.491834:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361215488/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575356 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575331.491840:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575331.491842:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575331.491844:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361215488:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575331.875041:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575331.875062:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575331.875062:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575331.875114:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788575331.875115:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575331.875124:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575332.515057:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575332.898969:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575332.898970:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575332.898996:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575332.898997:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575332.899029:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575332.899053:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575333.539049:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575333.923038:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575333.923039:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575333.923039:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575333.923045:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575333.923082:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575333.923128:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575334.562982:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575334.946949:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575334.946964:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575334.947008:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575334.947101:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575334.947110:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575334.947153:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575335.586967:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575335.971024:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575335.971025:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575335.971057:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575335.971072:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575335.971095:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575335.971110:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575336.611020:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788575336.611028:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575336.611033:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788575336.611040:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575336.611054:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3682
00000100:00080000:0.0:1788575336.611067:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575336.611077:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575336.611122:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453361215616/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575336.611150:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575336.611153:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575336.611154:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575336.611158:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3682
00000100:00080000:0.0:1788575336.611160:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575336.611163:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575336.611174:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575336.611188:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361215744/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575336.611202:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361215616:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788575336.611207:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575336.611216:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575336.611219:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575336.611225:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3682
00000100:00080000:0.0:1788575336.611231:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575336.611237:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575336.611243:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575336.611255:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361215872/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575336.611263:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575336.611266:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575336.611269:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:2.0:1788575336.611274:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788575336.611278:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3682
00000100:00080000:0.0:1788575336.611284:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575336.611288:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575336.611294:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575336.611304:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361216000/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575336.611312:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575336.611315:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575336.611317:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575336.611321:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3682
00000100:00080000:0.0:1788575336.611323:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575336.611331:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575336.611331:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575336/real 1788575336]  req@ffff8dc006710380 x1875453361215616/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575361 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1788575336.611339:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575336.611355:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361216128/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575336.611364:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575336.611369:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:2.0:1788575336.611369:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453361215616/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575361 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575336.611373:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575336.611384:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3682
00000100:00080000:2.0:1788575336.611392:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575336.611393:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575336.611400:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788575336.611405:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575336.611412:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361215616:192.168.202.140@tcp:250:kworker.0
00000008:00100000:0.0:1788575336.611414:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575336.611434:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361216256/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575336.611445:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361215744:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788575336.611462:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575336.611468:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575336.611471:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:2.0:1788575336.611477:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788575336.611478:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3682
00000100:00080000:0.0:1788575336.611495:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575336.611501:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575336.611508:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575336.611517:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575336/real 1788575336]  req@ffff8dc006711c00 x1875453361215744/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575361 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575336.611528:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361216384/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575336.611537:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361215744/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575361 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575336.611564:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575336.611569:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575336.611575:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361215744:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575336.611584:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361215872:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575336.611613:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575336.611627:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575336/real 1788575336]  req@ffff8dc006713480 x1875453361215872/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575361 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575336.611638:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361215872/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575361 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575336.611644:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575336.611646:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575336.611649:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361215872:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575336.611654:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361216000:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575336.611669:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575336.611676:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575336/real 1788575336]  req@ffff8dc006712680 x1875453361216000/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575361 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575336.611684:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361216000/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575361 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575336.611690:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575336.611693:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575336.611695:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361216000:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575336.611698:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361216128:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575336.611709:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575336.611715:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575336/real 1788575336]  req@ffff8dc006712300 x1875453361216128/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575361 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575336.611722:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361216128/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575361 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575336.611728:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575336.611730:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575336.611732:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361216128:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575336.611745:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361216256:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575336.611756:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575336.611765:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575336/real 1788575336]  req@ffff8dc006713800 x1875453361216256/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575361 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575336.611789:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361216256/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575361 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575336.611798:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575336.611802:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575336.611805:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361216256:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575336.611812:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361216384:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575336.611856:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575336.611887:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575336/real 1788575336]  req@ffff8dc006713b80 x1875453361216384/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575361 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575336.611901:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361216384/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575361 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575336.611909:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575336.611918:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575336.611922:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361216384:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575336.994986:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575336.994993:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575336.995003:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575336.995036:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575336.995041:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575336.995051:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575337.634972:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575338.019056:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575338.019056:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575338.019062:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575338.019101:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575338.019106:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575338.019146:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575338.658984:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575339.042999:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575339.042999:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575339.043050:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788575339.043052:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575339.043055:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575339.043073:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575339.683034:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575340.066980:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575340.066981:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575340.066985:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575340.067109:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575340.067143:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788575340.067161:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575340.706950:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575341.091003:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575341.091004:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575341.091028:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575341.091064:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575341.091067:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575341.091068:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00080000:0.0:1788575341.730984:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788575341.730990:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575341.730999:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788575341.731004:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575341.731014:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3687
00000100:00080000:0.0:1788575341.731026:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575341.731034:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575341.731073:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361216512/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575341.731110:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575341.731114:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575341.731116:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575341.731121:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3687
00000100:00080000:0.0:1788575341.731124:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575341.731129:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575341.731139:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575341.731159:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361216640/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575341.731172:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575341.731176:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575341.731180:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788575341.731181:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361216512:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788575341.731189:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3687
00000100:00080000:0.0:1788575341.731194:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575341.731198:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575341.731204:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575341.731220:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361216768/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575341.731231:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575341.731234:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575341.731235:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575341.731239:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3687
00000100:00080000:0.0:1788575341.731242:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575341.731248:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:3.0:1788575341.731249:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:0.0:1788575341.731253:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575341.731267:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361216896/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575341.731275:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575341.731278:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575341.731279:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575341.731285:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3687
00000100:00080000:0.0:1788575341.731289:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575341.731295:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575341.731300:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575341.731311:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575341/real 1788575341]  req@ffff8dc006711500 x1875453361216512/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575366 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575341.731317:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361217024/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575341.731332:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788575341.731336:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361216512/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575366 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575341.731338:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575341.731342:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575341.731353:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3687
00000100:00080000:3.0:1788575341.731357:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575341.731360:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575341.731365:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788575341.731368:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575341.731389:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575341.731399:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361217152/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575341.731408:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575341.731410:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575341.731412:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575341.731415:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3687
00000100:00080000:0.0:1788575341.731420:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575341.731423:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575341.731429:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575341.731432:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361216512:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788575341.731445:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361217280/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575341.731460:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361216640:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575341.731605:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575341.731652:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575341/real 1788575341]  req@ffff8dc006712a00 x1875453361216640/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575366 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575341.731663:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361216640/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575366 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575341.731671:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575341.731674:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575341.731677:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361216640:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575341.731684:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361216768:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575341.731704:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575341.731713:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575341/real 1788575341]  req@ffff8dc006710e00 x1875453361216768/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575366 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575341.731721:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361216768/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575366 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575341.731727:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575341.731730:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575341.731732:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361216768:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575341.731735:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361216896:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575341.731765:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575341.731774:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575341/real 1788575341]  req@ffff8dc006713100 x1875453361216896/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575366 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575341.731781:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361216896/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575366 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575341.731788:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575341.731790:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575341.731792:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361216896:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575341.731795:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361217024:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575341.731807:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575341.731813:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575341/real 1788575341]  req@ffff8dc006711880 x1875453361217024/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575366 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575341.731825:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361217024/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575366 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575341.731830:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575341.731832:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575341.731834:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361217024:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575341.731837:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361217152:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575341.731848:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575341.731853:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575341/real 1788575341]  req@ffff8dc006713b80 x1875453361217152/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575366 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575341.731860:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361217152/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575366 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575341.731891:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575341.731895:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575341.731899:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361217152:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575341.731929:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361217280:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575341.731951:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575341.731964:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575341/real 1788575341]  req@ffff8dc006713800 x1875453361217280/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575366 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575341.731976:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361217280/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575366 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575341.731992:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575341.731995:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575341.731999:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361217280:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575342.114962:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575342.114974:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575342.114993:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575342.115093:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575342.115103:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575342.115150:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575342.754961:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575343.138957:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575343.138961:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575343.138963:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575343.139057:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575343.139067:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575343.139116:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575343.778976:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575344.162970:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575344.162970:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575344.162971:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575344.163012:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575344.163021:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575344.163096:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575344.802967:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575345.186961:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575345.186971:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575345.186998:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575345.187084:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575345.187096:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575345.187155:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575345.826953:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575346.211021:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575346.211021:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575346.211029:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575346.211033:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575346.211066:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575346.211114:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1788575346.850948:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788575346.850956:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575346.850965:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788575346.850971:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575346.850981:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3692
00000100:00080000:0.0:1788575346.850991:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575346.850998:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575346.851034:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361217408/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575346.851060:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575346.851064:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575346.851066:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575346.851070:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3692
00000100:00080000:0.0:1788575346.851074:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575346.851079:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575346.851089:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575346.851105:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361217408:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788575346.851106:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361217536/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575346.851122:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575346.851126:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575346.851128:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575346.851132:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3692
00000100:00080000:0.0:1788575346.851136:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575346.851140:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575346.851146:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575346.851158:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361217664/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788575346.851164:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788575346.851175:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575346.851180:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575346.851182:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575346.851187:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3692
00000100:00080000:0.0:1788575346.851191:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575346.851195:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575346.851201:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575346/real 1788575346]  req@ffff8dc006712300 x1875453361217408/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575371 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1788575346.851202:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575346.851221:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361217792/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575346.851222:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361217408/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575371 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575346.851253:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575346.851256:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575346.851257:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575346.851265:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361217408:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788575346.851266:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575346.851269:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575346.851275:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3692
00000100:00080000:0.0:1788575346.851280:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575346.851284:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575346.851289:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575346.851299:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361217536:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575346.851302:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453361217920/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575346.851316:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575346.851320:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575346.851322:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575346.851327:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3692
00000100:00080000:0.0:1788575346.851332:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1788575346.851332:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788575346.851342:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575346.851347:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575346.851352:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575346/real 1788575346]  req@ffff8dc006712680 x1875453361217536/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575371 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575346.851361:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361218048/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575346.851370:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361217536/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575371 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575346.851377:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575346.851387:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575346.851391:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575346.851396:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575346.851397:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3692
00000100:00080000:0.0:1788575346.851404:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575346.851407:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788575346.851413:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575346.851416:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361217536:192.168.202.140@tcp:38:kworker.0
00000008:00100000:0.0:1788575346.851419:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575346.851428:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361217664:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575346.851434:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361218176/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788575346.851451:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575346.851463:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575346/real 1788575346]  req@ffff8dc006713480 x1875453361217664/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575371 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575346.851472:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361217664/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575371 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575346.851478:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575346.851480:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575346.851482:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361217664:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575346.851486:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361217792:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575346.851497:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575346.851503:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575346/real 1788575346]  req@ffff8dc006711c00 x1875453361217792/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575371 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575346.851510:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361217792/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575371 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575346.851516:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575346.851518:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575346.851520:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361217792:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575346.851531:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361217920:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575346.851541:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575346.851547:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575346/real 1788575346]  req@ffff8dc006710380 x1875453361217920/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575371 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575346.851554:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453361217920/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575371 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575346.851560:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575346.851562:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575346.851563:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361217920:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575346.851567:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361218048:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575346.851577:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575346.851583:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575346/real 1788575346]  req@ffff8dc006712300 x1875453361218048/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575371 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575346.851590:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361218048/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575371 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575346.851594:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575346.851596:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575346.851598:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361218048:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575346.851602:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361218176:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575346.851612:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575346.851617:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575346/real 1788575346]  req@ffff8dc006713800 x1875453361218176/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575371 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575346.851624:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361218176/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575371 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575346.851629:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575346.851631:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575346.851633:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361218176:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575347.234929:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575347.234939:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575347.234986:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575347.235045:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575347.235058:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575347.235103:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575347.874949:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575348.258947:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575348.258980:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575348.259006:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575348.259023:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575348.259026:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575348.259117:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575348.898973:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575349.282956:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575349.282975:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575349.282981:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575349.282987:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575349.283027:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575349.283053:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575349.922992:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575350.306959:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575350.306977:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575350.306981:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575350.307009:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575350.307032:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575350.307039:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575350.947000:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575351.331003:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575351.331004:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575351.331017:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575351.331048:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575351.331056:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575351.331060:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575351.970973:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788575351.970977:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575351.970984:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788575351.970988:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575351.970996:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3697
00000100:00080000:2.0:1788575351.971006:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575351.971012:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575351.971044:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361218304/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575351.971070:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575351.971073:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575351.971074:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575351.971077:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3697
00000100:00080000:2.0:1788575351.971079:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575351.971081:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575351.971089:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575351.971099:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453361218432/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575351.971103:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361218304:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788575351.971114:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575351.971117:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575351.971118:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575351.971122:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3697
00000100:00080000:2.0:1788575351.971124:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575351.971126:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575351.971130:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575351.971138:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453361218560/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575351.971144:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575351.971147:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575351.971148:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575351.971150:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3697
00000100:00080000:2.0:1788575351.971167:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575351.971170:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575351.971173:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575351.971182:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453361218688/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575351.971188:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575351.971192:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575351.971195:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575351.971200:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3697
00000100:00080000:2.0:1788575351.971205:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575351.971210:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575351.971215:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361218432:192.168.202.140@tcp:38:kworker.0
00000008:00100000:2.0:1788575351.971219:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575351.971238:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361218816/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575351.971251:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788575351.971255:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361218560:192.168.202.140@tcp:8:kworker.0
00000100:00080000:2.0:1788575351.971257:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575351.971261:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575351.971270:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3697
00000100:00080000:2.0:1788575351.971276:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575351.971280:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575351.971286:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575351.971300:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361218944/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575351.971307:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361218688:192.168.202.140@tcp:8:kworker.0
00000100:00080000:2.0:1788575351.971311:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575351.971315:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575351.971316:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575351.971321:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3697
00000100:00080000:2.0:1788575351.971326:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575351.971329:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575351.971334:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575351.971341:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361218816:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575351.971346:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361219072/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575351.971375:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361218944:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575351.971401:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361219072:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575352.354962:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575352.354962:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575352.354970:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575352.354989:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575352.354996:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575352.355001:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575352.995032:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575353.378971:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575353.378975:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575353.378976:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575353.378997:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575353.379000:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575353.379005:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575354.019022:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575354.402942:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575354.402947:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575354.402957:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575354.402967:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575354.402990:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575354.403032:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575355.043119:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000400:00000100:3.0:1788575355.043278:0:2336:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.140:988
00000400:00000100:3.0:1788575355.043330:0:2336:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.140@tcp at host 192.168.202.140 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:3.0:1788575355.043349:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788575355.043396:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788575355.043404:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788575355.043411:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788575355.043423:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788575355.043434:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788575355.043446:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:2.0:1788575355.043460:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575351/real 1788575355]  req@ffff8dc020495180 x1875453361218816/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575376 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575355.043496:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361218816/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575376 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575355.043516:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575355.043524:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575355.043532:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361218816:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575355.043576:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575351/real 1788575355]  req@ffff8dc020495880 x1875453361218944/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575376 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575355.043591:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361218944/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575376 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575355.043599:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575355.043604:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575355.043608:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361218944:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575355.043615:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575351/real 1788575355]  req@ffff8dc020497480 x1875453361218432/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575376 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575355.043627:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453361218432/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575376 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575355.043641:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575355.043645:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575355.043650:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361218432:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575355.043658:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575351/real 1788575355]  req@ffff8dc020494e00 x1875453361218560/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575376 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575355.043671:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453361218560/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575376 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575355.043679:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575355.043683:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575355.043686:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361218560:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575355.043694:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575351/real 1788575355]  req@ffff8dc020494a80 x1875453361218688/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575376 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575355.043706:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453361218688/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575376 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575355.043715:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575355.043718:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575355.043721:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361218688:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575355.043729:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575351/real 1788575355]  req@ffff8dc020495500 x1875453361218304/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575376 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575355.043742:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361218304/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575376 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575355.043750:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575355.043753:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575355.043757:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361218304:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788575355.043796:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575351/real 1788575355]  req@ffff8dc020494000 x1875453361219072/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575376 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575355.043809:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361219072/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575376 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575355.043817:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575355.043821:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575355.043824:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361219072:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575355.426992:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575355.426993:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575355.426993:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575355.427000:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575355.427053:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575355.427117:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575356.067028:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575356.450990:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575356.450991:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575356.451020:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575356.451054:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575356.451055:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788575356.451069:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575357.090971:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788575357.090993:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575357.091001:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788575357.091005:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575357.091015:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3702
00000100:00080000:3.0:1788575357.091026:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575357.091035:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575357.091073:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644dc00 x1875453361219200/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575357.091112:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575357.091121:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575357.091124:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575357.091131:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3702
00000100:00080000:3.0:1788575357.091135:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575357.091140:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575357.091152:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575357.091168:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c000 x1875453361219328/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575357.091172:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361219200:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788575357.091183:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575357.091192:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575357.091194:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575357.091199:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3702
00000100:00080000:3.0:1788575357.091203:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575357.091209:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575357.091215:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575357.091231:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f800 x1875453361219456/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575357.091242:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575357.091246:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575357.091248:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575357.091254:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3702
00000800:00000100:0.0:1788575357.091255:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788575357.091259:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575357.091265:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575357.091272:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575357.091286:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ce00 x1875453361219584/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575357.091296:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788575357.091302:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575357/real 1788575357]  req@ffff8dc00644dc00 x1875453361219200/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575382 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575357.091302:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575357.091306:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575357.091315:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3702
00000100:00080000:3.0:1788575357.091321:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575357.091328:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575357.091334:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575357.091336:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644dc00 x1875453361219200/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575382 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575357.091351:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1788575357.091351:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ca80 x1875453361219712/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575357.091362:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788575357.091372:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788575357.091373:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361219200:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788575357.091383:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575357.091385:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575357.091391:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3702
00000100:00080000:3.0:1788575357.091395:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575357.091399:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575357.091404:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575357.091414:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361219328:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575357.091416:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ea00 x1875453361219840/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575357.091436:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575357.091440:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575357.091443:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575357.091449:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3702
00000800:00000100:0.0:1788575357.091450:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788575357.091456:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575357.091462:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575357.091468:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575357.091473:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575357/real 1788575357]  req@ffff8dc00644c000 x1875453361219328/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575382 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575357.091484:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d500 x1875453361219968/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575357.091494:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c000 x1875453361219328/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575382 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575357.091528:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575357.091534:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575357.091538:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361219328:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575357.091547:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361219456:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575357.091575:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575357.091589:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575357/real 1788575357]  req@ffff8dc00644f800 x1875453361219456/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575382 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575357.091607:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f800 x1875453361219456/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575382 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575357.091616:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575357.091619:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575357.091622:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361219456:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575357.091628:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361219584:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575357.091650:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575357.091663:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575357/real 1788575357]  req@ffff8dc00644ce00 x1875453361219584/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575382 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575357.091674:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ce00 x1875453361219584/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575382 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575357.091682:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575357.091684:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575357.091687:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361219584:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575357.091693:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361219712:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575357.091714:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575357.091725:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575357/real 1788575357]  req@ffff8dc00644ca80 x1875453361219712/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575382 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575357.091736:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ca80 x1875453361219712/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575382 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575357.091745:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575357.091749:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575357.091752:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361219712:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575357.091770:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361219840:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575357.091791:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575357.091804:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575357/real 1788575357]  req@ffff8dc00644ea00 x1875453361219840/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575382 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575357.091825:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ea00 x1875453361219840/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575382 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575357.091833:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575357.091836:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575357.091840:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361219840:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575357.091846:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361219968:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575357.091906:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575357.091926:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575357/real 1788575357]  req@ffff8dc00644d500 x1875453361219968/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575382 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575357.091938:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d500 x1875453361219968/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575382 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575357.091947:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575357.091950:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575357.091954:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361219968:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575357.474983:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575357.474983:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575357.474988:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575357.475016:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575357.475024:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575357.475027:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575358.114987:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575358.498950:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575358.498950:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575358.498979:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575358.498993:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575358.499018:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575358.499019:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575359.138935:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575359.522963:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575359.522965:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575359.522967:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575359.522995:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575359.522999:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575359.522999:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575360.162936:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575360.546945:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575360.546945:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575360.546947:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575360.546972:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575360.546976:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575360.546976:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575361.186986:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575361.570970:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575361.570970:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575361.570978:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575361.570999:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575361.571000:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575361.571010:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575362.210952:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575362.210971:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575362.210976:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788575362.210980:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575362.210988:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3707
00000100:00080000:0.0:1788575362.210996:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575362.211002:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575362.211031:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361220096/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575362.211058:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575362.211061:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575362.211064:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575362.211069:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3707
00000100:00080000:0.0:1788575362.211074:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575362.211079:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575362.211087:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361220096:192.168.202.140@tcp:250:kworker.0
00000008:00100000:0.0:1788575362.211090:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575362.211116:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361220224/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575362.211129:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575362.211133:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575362.211135:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575362.211139:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3707
00000100:00080000:0.0:1788575362.211143:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1788575362.211145:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788575362.211149:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575362.211155:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575362.211167:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361220352/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575362.211179:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575362.211182:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575362.211184:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788575362.211187:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575362/real 1788575362]  req@ffff8dc006713b80 x1875453361220096/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575387 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575362.211190:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3707
00000100:00080000:0.0:1788575362.211196:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575362.211202:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575362.211208:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575362.211214:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361220096/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575387 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575362.211219:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361220480/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575362.211230:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575362.211232:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575362.211236:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788575362.211237:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575362.211242:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788575362.211245:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361220096:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788575362.211248:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3707
00000100:00080000:0.0:1788575362.211253:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575362.211256:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575362.211260:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575362.211266:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361220608/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575362.211270:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361220224:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788575362.211283:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575362.211286:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575362.211288:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575362.211292:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3707
00000800:00000100:2.0:1788575362.211296:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788575362.211297:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575362.211303:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575362.211307:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575362.211312:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575362/real 1788575362]  req@ffff8dc006711880 x1875453361220224/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575387 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575362.211318:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361220736/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575362.211329:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361220224/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575387 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575362.211330:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575362.211339:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575362.211343:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575362.211350:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3707
00000100:00080000:2.0:1788575362.211351:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575362.211353:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575362.211358:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788575362.211361:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575362.211365:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361220224:192.168.202.140@tcp:38:kworker.0
00000008:00100000:0.0:1788575362.211367:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575362.211373:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361220352:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575362.211379:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361220864/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788575362.211394:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575362.211403:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575362/real 1788575362]  req@ffff8dc006713100 x1875453361220352/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575387 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575362.211417:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361220352/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575387 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575362.211423:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575362.211425:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575362.211427:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361220352:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575362.211445:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361220480:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575362.211463:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575362.211471:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575362/real 1788575362]  req@ffff8dc006710e00 x1875453361220480/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575387 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575362.211478:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361220480/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575387 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575362.211484:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575362.211487:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575362.211489:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361220480:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575362.211507:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361220608:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575362.211520:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575362.211527:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575362/real 1788575362]  req@ffff8dc006712a00 x1875453361220608/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575387 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575362.211534:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361220608/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575387 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575362.211545:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575362.211547:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575362.211549:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361220608:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575362.211552:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361220736:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575362.211562:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575362.211567:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575362/real 1788575362]  req@ffff8dc006711500 x1875453361220736/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575387 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575362.211575:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361220736/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575387 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575362.211580:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575362.211581:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575362.211583:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361220736:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575362.211586:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361220864:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575362.211596:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575362.211601:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575362/real 1788575362]  req@ffff8dc006713b80 x1875453361220864/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575387 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575362.211614:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361220864/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575387 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575362.211619:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575362.211622:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575362.211624:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361220864:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575362.594955:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575362.594955:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575362.594963:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575362.594964:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575362.594999:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575362.595033:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575363.234976:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575363.618958:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575363.618958:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575363.618969:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575363.618973:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575363.618997:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575363.619031:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575364.259048:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575364.642993:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575364.642994:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575364.643017:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575364.643019:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575364.643044:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575364.643107:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575365.282937:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575365.666961:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575365.666961:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575365.666966:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575365.666968:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575365.666998:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575365.667035:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575366.306956:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575366.690945:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575366.690945:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575366.690945:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575366.690991:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575366.691007:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575366.691040:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575367.330976:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788575367.330979:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575367.330987:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788575367.330990:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575367.331000:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3712
00000100:00080000:3.0:1788575367.331009:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575367.331016:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575367.331048:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c380 x1875453361220992/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575367.331069:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575367.331073:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575367.331075:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575367.331080:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3712
00000100:00080000:3.0:1788575367.331085:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575367.331090:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575367.331096:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361220992:192.168.202.140@tcp:250:kworker.0
00000008:00100000:3.0:1788575367.331101:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575367.331121:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f480 x1875453361221120/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575367.331130:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575367.331133:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575367.331134:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575367.331138:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3712
00000100:00080000:3.0:1788575367.331149:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575367.331152:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575367.331156:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788575367.331165:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575367.331169:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d180 x1875453361221248/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575367.331181:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575367.331184:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575367.331185:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575367.331189:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3712
00000100:00080000:3.0:1788575367.331191:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575367.331193:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575367.331196:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575367.331204:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e680 x1875453361221376/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575367.331211:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788575367.331212:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575367/real 1788575367]  req@ffff8dc00644c380 x1875453361220992/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575392 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575367.331216:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575367.331220:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575367.331229:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3712
00000100:00080000:3.0:1788575367.331233:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575367.331236:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575367.331239:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575367.331242:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453361220992/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575392 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575367.331250:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c700 x1875453361221504/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575367.331253:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575367.331262:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788575367.331266:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788575367.331270:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361220992:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788575367.331271:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575367.331275:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575367.331286:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3712
00000100:00080000:3.0:1788575367.331289:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575367.331292:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575367.331299:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575367.331311:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e300 x1875453361221632/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575367.331316:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361221120:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788575367.331334:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575367.331338:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575367.331341:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575367.331346:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3712
00000100:00080000:3.0:1788575367.331351:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1788575367.331352:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788575367.331371:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575367.331378:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575367.331385:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575367/real 1788575367]  req@ffff8dc00644f480 x1875453361221120/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575392 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575367.331391:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644fb80 x1875453361221760/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575367.331407:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453361221120/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575392 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575367.331416:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575367.331419:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575367.331423:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361221120:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575367.331428:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361221248:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575367.331445:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575367.331452:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575367/real 1788575367]  req@ffff8dc00644d180 x1875453361221248/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575392 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575367.331460:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453361221248/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575392 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575367.331466:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575367.331468:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575367.331470:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361221248:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575367.331474:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361221376:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575367.331483:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575367.331489:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575367/real 1788575367]  req@ffff8dc00644e680 x1875453361221376/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575392 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575367.331496:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453361221376/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575392 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575367.331506:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575367.331509:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575367.331511:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361221376:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575367.331514:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361221504:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575367.331524:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575367.331530:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575367/real 1788575367]  req@ffff8dc00644c700 x1875453361221504/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575392 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575367.331537:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453361221504/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575392 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575367.331543:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575367.331545:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575367.331547:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361221504:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575367.331559:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361221632:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575367.331570:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575367.331576:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575367/real 1788575367]  req@ffff8dc00644e300 x1875453361221632/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575392 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575367.331583:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453361221632/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575392 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575367.331588:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575367.331590:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575367.331592:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361221632:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575367.331596:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361221760:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575367.331605:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575367.331611:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575367/real 1788575367]  req@ffff8dc00644fb80 x1875453361221760/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575392 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575367.331618:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644fb80 x1875453361221760/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575392 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575367.331623:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575367.331624:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575367.331626:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361221760:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575367.714983:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575367.714983:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575367.715003:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575367.715004:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575367.715038:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575367.715095:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575368.354932:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575368.738978:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575368.738980:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575368.738980:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575368.738983:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575368.739009:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575368.739051:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575369.378980:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575369.762994:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575369.763000:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575369.763013:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575369.763017:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575369.763064:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575369.763109:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575370.402986:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575370.787038:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575370.787043:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575370.787063:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575370.787087:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575370.787107:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575370.787115:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575371.426988:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575371.810985:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575371.810990:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788575371.811045:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575371.811143:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575371.811148:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575371.811160:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00080000:3.0:1788575372.451016:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788575372.451020:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788575372.451032:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788575372.451037:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575372.451052:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3718
00000100:00080000:3.0:1788575372.451065:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575372.451073:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575372.451116:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d880 x1875453361221888/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575372.451146:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575372.451150:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575372.451152:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575372.451157:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3718
00000100:00080000:3.0:1788575372.451162:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575372.451168:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575372.451181:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575372.451202:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361221888:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788575372.451202:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f100 x1875453361222016/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575372.451219:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575372.451222:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575372.451223:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575372.451227:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3718
00000100:00080000:3.0:1788575372.451231:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575372.451234:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575372.451239:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575372.451251:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ed80 x1875453361222144/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575372.451259:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575372.451263:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575372.451264:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575372.451267:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3718
00000100:00080000:3.0:1788575372.451272:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575372.451274:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575372.451292:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575372.451302:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644df80 x1875453361222272/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575372.451309:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575372.451312:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575372.451313:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575372.451317:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3718
00000800:00000100:2.0:1788575372.451324:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788575372.451324:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575372.451332:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575372.451336:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575372.451348:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644fb80 x1875453361222400/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575372.451358:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575372.451362:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575372.451365:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575372.451370:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3718
00000100:00080000:3.0:1788575372.451375:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575372.451381:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575372.451384:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575372/real 1788575372]  req@ffff8dc00644d880 x1875453361221888/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575397 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1788575372.451391:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575372.451411:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d880 x1875453361221888/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575397 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575372.451420:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e300 x1875453361222528/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575372.451430:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575372.451432:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575372.451433:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575372.451436:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575372.451438:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3718
00000100:00080000:3.0:1788575372.451445:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575372.451448:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788575372.451452:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575372.451457:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575372.451458:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361221888:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788575372.451467:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c700 x1875453361222656/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575372.451502:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361222016:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575372.451529:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575372.451540:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575372/real 1788575372]  req@ffff8dc00644f100 x1875453361222016/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575397 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575372.451550:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f100 x1875453361222016/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575397 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575372.451558:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575372.451561:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575372.451563:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361222016:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575372.451568:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361222144:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575372.451581:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575372.451588:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575372/real 1788575372]  req@ffff8dc00644ed80 x1875453361222144/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575397 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575372.451596:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ed80 x1875453361222144/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575397 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575372.451607:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575372.451609:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575372.451612:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361222144:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575372.451615:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361222272:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575372.451626:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575372.451632:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575372/real 1788575372]  req@ffff8dc00644df80 x1875453361222272/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575397 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575372.451643:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644df80 x1875453361222272/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575397 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575372.451652:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575372.451656:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575372.451659:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361222272:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575372.451666:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361222400:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575372.451688:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575372.451698:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575372/real 1788575372]  req@ffff8dc00644fb80 x1875453361222400/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575397 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575372.451706:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644fb80 x1875453361222400/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575397 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575372.451713:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575372.451715:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575372.451718:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361222400:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575372.451723:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361222528:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575372.451739:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575372.451751:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575372/real 1788575372]  req@ffff8dc00644e300 x1875453361222528/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575397 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575372.451764:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453361222528/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575397 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575372.451773:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575372.451776:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575372.451780:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361222528:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575372.451787:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361222656:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575372.451810:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575372.451824:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575372/real 1788575372]  req@ffff8dc00644c700 x1875453361222656/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575397 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575372.451837:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453361222656/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575397 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575372.451846:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575372.451849:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575372.451853:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361222656:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575372.835010:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575372.835010:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575372.835029:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575372.835058:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575372.835079:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575372.835095:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575373.475063:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575373.858948:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575373.858950:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575373.858979:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575373.859004:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575373.859006:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788575373.859009:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575374.498979:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575374.882980:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575374.882980:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575374.882982:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575374.883012:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575374.883014:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575374.883023:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575375.522981:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575375.906964:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575375.906970:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575375.907004:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575375.907004:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575375.907016:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788575375.907139:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575376.546966:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575376.930987:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575376.931017:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575376.931025:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575376.931090:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575376.931102:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575376.931105:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575377.570977:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575377.570983:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575377.570990:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788575377.570994:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575377.571004:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3723
00000100:00080000:0.0:1788575377.571014:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575377.571021:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575377.571059:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361222784/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575377.571089:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575377.571093:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575377.571095:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575377.571099:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3723
00000100:00080000:0.0:1788575377.571103:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575377.571107:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575377.571119:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575377.571134:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361222784:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788575377.571136:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361222912/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575377.571152:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575377.571156:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575377.571158:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575377.571163:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3723
00000100:00080000:0.0:1788575377.571167:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575377.571172:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575377.571177:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575377.571190:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453361223040/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575377.571216:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575377.571219:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575377.571222:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1788575377.571227:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788575377.571231:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3723
00000100:00080000:0.0:1788575377.571237:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575377.571242:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575377.571248:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575377.571263:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361223168/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575377.571270:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575377.571273:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575377.571276:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788575377.571286:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575377/real 1788575377]  req@ffff8dc006713800 x1875453361222784/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575402 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575377.571287:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3723
00000100:00080000:0.0:1788575377.571295:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575377.571302:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575377.571307:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575377.571315:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361223296/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575377.571321:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575377.571324:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575377.571325:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575377.571327:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3723
00000100:00080000:0.0:1788575377.571329:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575377.571331:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575377.571333:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575377.571338:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361223424/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575377.571344:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575377.571346:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575377.571348:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575377.571350:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3723
00000100:00080000:0.0:1788575377.571352:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575377.571354:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575377.571357:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575377.571363:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361223552/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575377.571383:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361222784/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575402 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575377.571397:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575377.571403:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575377.571408:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361222784:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788575377.571431:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361222912:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575377.571572:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575377.571631:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575377/real 1788575377]  req@ffff8dc006712300 x1875453361222912/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575402 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575377.571650:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361222912/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575402 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575377.571663:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575377.571668:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575377.571672:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361222912:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575377.571679:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361223040:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575377.571716:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575377.571728:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575377/real 1788575377]  req@ffff8dc006710380 x1875453361223040/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575402 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575377.571739:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453361223040/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575402 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575377.571748:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575377.571751:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575377.571754:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361223040:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575377.571759:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361223168:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575377.571779:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575377.571791:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575377/real 1788575377]  req@ffff8dc006711c00 x1875453361223168/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575402 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575377.571802:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361223168/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575402 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575377.571811:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575377.571814:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575377.571818:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361223168:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575377.571825:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361223296:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575377.571844:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575377.571854:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575377/real 1788575377]  req@ffff8dc006713480 x1875453361223296/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575402 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575377.571896:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361223296/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575402 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575377.571907:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575377.571912:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575377.571917:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361223296:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575377.571925:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361223424:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575377.571946:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575377.571958:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575377/real 1788575377]  req@ffff8dc006712680 x1875453361223424/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575402 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575377.571978:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361223424/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575402 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575377.571987:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575377.571990:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575377.571994:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361223424:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575377.571999:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361223552:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575377.572016:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575377.572026:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575377/real 1788575377]  req@ffff8dc006713b80 x1875453361223552/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575402 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575377.572038:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361223552/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575402 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575377.572046:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575377.572050:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575377.572053:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361223552:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575377.954983:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575377.954984:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575377.954984:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575377.955116:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575377.955167:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575377.955236:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575378.594914:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575378.978977:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575378.978983:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575378.979006:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575378.979027:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575378.979033:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788575378.979044:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575379.618955:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575380.002951:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575380.002963:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575380.002963:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575380.002965:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575380.002994:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575380.003032:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575380.642922:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575381.026966:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575381.026967:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575381.027001:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575381.027005:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575381.027032:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575381.027045:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575381.666972:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575382.050975:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575382.050975:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575382.050976:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575382.051006:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575382.051008:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575382.051018:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1788575382.690966:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575382.690975:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:0.0:1788575382.690976:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788575382.690979:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575382.690989:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3728
00000100:00080000:2.0:1788575382.690999:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575382.691006:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575382.691040:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361223680/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575382.691074:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575382.691076:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575382.691078:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575382.691080:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3728
00000100:00080000:2.0:1788575382.691083:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575382.691085:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575382.691093:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575382.691101:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361223808/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575382.691109:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575382.691112:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575382.691113:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575382.691116:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3728
00000100:00080000:2.0:1788575382.691117:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575382.691136:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575382.691143:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575382.691145:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361223680:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788575382.691158:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453361223936/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575382.691167:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575382.691170:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575382.691171:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575382.691174:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3728
00000100:00080000:2.0:1788575382.691177:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575382.691181:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575382.691185:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575382.691195:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453361224064/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788575382.691206:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788575382.691219:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575382.691224:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575382.691226:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575382.691231:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3728
00000100:00080000:2.0:1788575382.691237:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575382.691242:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575382.691247:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575382.691251:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575382/real 1788575382]  req@ffff8dc020494000 x1875453361223680/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575407 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575382.691263:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453361224192/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575382.691278:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575382.691280:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575382.691282:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788575382.691286:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361223680/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575407 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575382.691289:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3728
00000100:00080000:2.0:1788575382.691294:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575382.691301:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:3.0:1788575382.691303:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:2.0:1788575382.691305:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788575382.691309:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575382.691315:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361224320/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575382.691316:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361223680:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788575382.691328:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361223808:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788575382.691341:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575382.691343:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575382.691345:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575382.691349:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3728
00000100:00080000:2.0:1788575382.691352:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575382.691355:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:3.0:1788575382.691359:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:2.0:1788575382.691361:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575382.691371:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361224448/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575382.691374:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575382/real 1788575382]  req@ffff8dc020495500 x1875453361223808/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575407 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575382.691398:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361223808/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575407 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575382.691405:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575382.691408:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575382.691411:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361223808:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575382.691429:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361223936:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575382.691443:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575382.691450:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575382/real 1788575382]  req@ffff8dc020494a80 x1875453361223936/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575407 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575382.691458:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453361223936/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575407 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575382.691468:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575382.691470:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575382.691472:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361223936:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575382.691476:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361224064:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575382.691485:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575382.691491:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575382/real 1788575382]  req@ffff8dc020494e00 x1875453361224064/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575407 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575382.691498:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453361224064/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575407 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575382.691504:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575382.691506:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575382.691508:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361224064:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575382.691511:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361224192:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575382.691521:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575382.691527:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575382/real 1788575382]  req@ffff8dc020497480 x1875453361224192/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575407 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575382.691535:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453361224192/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575407 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575382.691540:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575382.691542:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575382.691544:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361224192:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575382.691548:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361224320:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575382.691558:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575382.691564:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575382/real 1788575382]  req@ffff8dc020495880 x1875453361224320/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575407 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575382.691571:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361224320/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575407 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575382.691576:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575382.691577:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575382.691579:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361224320:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575382.691583:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361224448:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575382.691592:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575382.691597:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575382/real 1788575382]  req@ffff8dc020495180 x1875453361224448/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575407 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575382.691603:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361224448/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575407 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575382.691608:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575382.691610:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575382.691613:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361224448:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575383.074969:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575383.074969:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575383.074972:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575383.074997:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788575383.075005:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575383.075021:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575383.714934:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575384.099002:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575384.099039:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575384.099039:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575384.099056:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575384.099072:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575384.099120:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575384.739014:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575385.122979:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575385.122979:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575385.122984:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575385.122989:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575385.123021:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575385.123138:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575385.762932:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575386.146937:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575386.146943:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575386.146966:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575386.146980:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575386.146985:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575386.146995:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575386.786973:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575387.170970:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575387.170971:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575387.170976:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575387.170977:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575387.171008:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788575387.171096:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575387.810919:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788575387.810939:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575387.810946:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788575387.810951:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575387.810961:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3733
00000100:00080000:2.0:1788575387.810971:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575387.810979:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575387.811015:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453361224576/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575387.811065:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575387.811070:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575387.811072:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575387.811077:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3733
00000100:00080000:2.0:1788575387.811082:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575387.811088:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575387.811098:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575387.811104:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361224576:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788575387.811116:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453361224704/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575387.811129:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575387.811132:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575387.811134:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575387.811139:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3733
00000100:00080000:2.0:1788575387.811143:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575387.811147:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575387.811152:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575387.811164:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361224832/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575387.811174:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575387.811178:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575387.811180:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575387.811185:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3733
00000800:00000100:3.0:1788575387.811190:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788575387.811192:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575387.811200:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575387.811206:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575387.811219:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453361224960/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575387.811229:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575387.811233:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575387.811235:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575387.811240:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3733
00000100:00080000:2.0:1788575387.811244:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575387.811251:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575387.811252:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575387/real 1788575387]  req@ffff8dc020497100 x1875453361224576/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575412 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1788575387.811259:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575387.811273:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453361224576/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575412 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575387.811277:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453361225088/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575387.811298:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575387.811298:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575387.811306:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575387.811309:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575387.811309:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788575387.811318:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3733
00000100:00100000:3.0:1788575387.811319:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361224576:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788575387.811321:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575387.811327:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575387.811330:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575387.811338:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361225216/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575387.811346:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788575387.811346:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361224704:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788575387.811355:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575387.811357:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575387.811360:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3733
00000100:00080000:2.0:1788575387.811363:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575387.811366:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575387.811370:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788575387.811377:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575387.811381:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361225344/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575387.811392:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575387/real 1788575387]  req@ffff8dc020494380 x1875453361224704/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575412 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575387.811402:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453361224704/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575412 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575387.811410:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575387.811413:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575387.811416:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361224704:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575387.811421:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361224832:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575387.811434:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575387.811441:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575387/real 1788575387]  req@ffff8dc020494700 x1875453361224832/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575412 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575387.811448:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361224832/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575412 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575387.811454:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575387.811456:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575387.811458:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361224832:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575387.811461:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361224960:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575387.811471:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575387.811478:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575387/real 1788575387]  req@ffff8dc020496d80 x1875453361224960/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575412 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575387.811485:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453361224960/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575412 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575387.811490:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575387.811492:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575387.811494:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361224960:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575387.811497:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361225088:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575387.811507:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575387.811513:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575387/real 1788575387]  req@ffff8dc020496a00 x1875453361225088/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575412 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575387.811525:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453361225088/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575412 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575387.811530:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575387.811532:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575387.811534:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361225088:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575387.811545:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361225216:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575387.811555:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575387.811561:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575387/real 1788575387]  req@ffff8dc020495180 x1875453361225216/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575412 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575387.811568:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361225216/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575412 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575387.811573:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575387.811575:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575387.811577:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361225216:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575387.811581:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361225344:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575387.811590:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575387.811596:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575387/real 1788575387]  req@ffff8dc020495880 x1875453361225344/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575412 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575387.811602:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361225344/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575412 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575387.811611:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575387.811614:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575387.811616:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361225344:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575388.194979:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575388.194979:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575388.194983:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575388.194984:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575388.195014:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575388.195065:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575388.834965:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575389.218968:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575389.218968:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575389.218968:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575389.218997:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575389.219001:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788575389.219016:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575389.858954:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575390.242970:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575390.242971:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575390.242972:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575390.243103:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575390.243128:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575390.243137:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575390.882974:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575391.266965:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575391.266965:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575391.266969:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575391.267018:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575391.267022:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575391.267033:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575391.907017:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575392.290951:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575392.290959:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575392.291001:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575392.291018:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575392.291022:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575392.291023:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1788575392.931024:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788575392.931038:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788575392.931045:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788575392.931053:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575392.931064:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3738
00000100:00080000:2.0:1788575392.931074:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575392.931082:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575392.931115:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453361225472/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575392.931138:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575392.931141:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575392.931143:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575392.931145:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3738
00000100:00080000:2.0:1788575392.931148:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575392.931150:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575392.931164:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575392.931173:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453361225600/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575392.931182:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788575392.931184:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361225472:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788575392.931187:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575392.931192:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575392.931196:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3738
00000100:00080000:2.0:1788575392.931198:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575392.931201:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575392.931204:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575392.931213:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453361225728/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575392.931220:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575392.931222:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575392.931224:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575392.931227:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3738
00000100:00080000:2.0:1788575392.931238:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575392.931242:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575392.931246:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788575392.931252:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575392.931264:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361225856/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575392.931276:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575392.931279:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575392.931281:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575392.931286:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3738
00000100:00080000:2.0:1788575392.931290:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575392.931295:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575392.931301:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575392.931302:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575392/real 1788575392]  req@ffff8dc020497480 x1875453361225472/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575417 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575392.931320:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361225984/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575392.931331:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453361225472/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575417 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575392.931333:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575392.931343:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575392.931347:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575392.931348:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575392.931358:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3738
00000100:00080000:3.0:1788575392.931358:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575392.931366:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361225472:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788575392.931367:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575392.931376:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575392.931382:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575392.931391:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361225600:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575392.931400:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453361226112/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575392.931414:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1788575392.931416:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788575392.931420:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575392.931423:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575392.931428:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3738
00000100:00080000:2.0:1788575392.931431:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788575392.931433:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575392/real 1788575392]  req@ffff8dc020494e00 x1875453361225600/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575417 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575392.931437:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575392.931447:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575392.931461:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453361225600/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575417 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575392.931465:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361226240/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575392.931474:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575392.931483:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575392.931487:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361225600:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575392.931492:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361225728:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575392.931507:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575392.931515:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575392/real 1788575392]  req@ffff8dc020494a80 x1875453361225728/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575417 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575392.931522:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453361225728/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575417 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575392.931528:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575392.931530:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575392.931533:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361225728:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575392.931536:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361225856:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575392.931546:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575392.931552:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575392/real 1788575392]  req@ffff8dc020495500 x1875453361225856/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575417 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575392.931559:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361225856/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575417 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575392.931570:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575392.931571:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575392.931573:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361225856:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575392.931577:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361225984:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575392.931587:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575392.931593:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575392/real 1788575392]  req@ffff8dc020494000 x1875453361225984/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575417 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575392.931599:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361225984/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575417 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575392.931605:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575392.931607:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575392.931609:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361225984:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575392.931619:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361226112:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575392.931629:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575392.931636:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575392/real 1788575392]  req@ffff8dc020497480 x1875453361226112/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575417 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575392.931643:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453361226112/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575417 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575392.931648:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575392.931649:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575392.931660:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361226112:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575392.931665:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361226240:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575392.931676:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575392.931683:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575392/real 1788575392]  req@ffff8dc020495880 x1875453361226240/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575417 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575392.931690:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361226240/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575417 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575392.931695:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575392.931697:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575392.931698:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361226240:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575393.314956:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575393.314993:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575393.315014:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575393.315033:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575393.315035:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575393.315053:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575393.955045:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575394.338980:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575394.338980:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575394.339036:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575394.339036:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575394.339042:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575394.339043:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575394.979035:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575395.362990:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575395.362990:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575395.362990:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575395.363029:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575395.363032:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575395.363290:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575396.002988:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575396.387023:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575396.387049:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575396.387055:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575396.387084:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575396.387191:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575396.387241:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575397.027092:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575397.411041:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575397.411049:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575397.411071:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575397.411091:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575397.411112:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575397.411112:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575398.051036:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575398.051050:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575398.051057:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788575398.051059:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575398.051071:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3743
00000100:00080000:1.0:1788575398.051086:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575398.051097:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575398.051169:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361226368/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575398.051203:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575398.051207:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575398.051210:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575398.051215:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3743
00000100:00080000:1.0:1788575398.051219:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575398.051224:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575398.051237:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575398.051253:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361226496/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575398.051265:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575398.051269:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575398.051271:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575398.051276:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3743
00000100:00080000:1.0:1788575398.051280:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788575398.051290:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361226368:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788575398.051291:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575398.051305:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575398.051325:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361226624/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575398.051338:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575398.051343:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575398.051345:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575398.051349:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3743
00000100:00080000:1.0:1788575398.051354:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575398.051359:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575398.051364:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575398.051380:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361226752/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788575398.051384:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788575398.051398:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575398.051402:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575398.051405:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575398.051412:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3743
00000100:00080000:1.0:1788575398.051416:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575398.051423:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575398.051431:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575398.051440:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575398/real 1788575398]  req@ffff8dc005dc1c00 x1875453361226368/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575423 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575398.051450:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361226880/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575398.051478:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788575398.051485:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361226368/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575423 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575398.051486:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575398.051491:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575398.051509:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3743
00000100:00080000:3.0:1788575398.051515:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575398.051517:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575398.051527:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788575398.051532:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575398.051539:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361226368:192.168.202.140@tcp:250:kworker.0
00000008:00100000:1.0:1788575398.051542:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575398.051558:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361226496:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788575398.051563:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361227008/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575398.051578:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575398.051582:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575398.051584:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575398.051590:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3743
00000100:00080000:1.0:1788575398.051595:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575398.051600:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:3.0:1788575398.051607:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:1.0:1788575398.051608:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575398.051627:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361227136/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575398.051633:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575398/real 1788575398]  req@ffff8dc005dc0a80 x1875453361226496/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575423 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575398.051668:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361226496/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575423 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575398.051685:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575398.051689:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575398.051693:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361226496:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575398.051720:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361226624:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575398.051744:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575398.051758:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575398/real 1788575398]  req@ffff8dc005dc1180 x1875453361226624/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575423 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575398.051770:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361226624/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575423 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575398.051779:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575398.051782:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575398.051785:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361226624:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575398.051792:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361226752:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575398.051812:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575398.051825:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575398/real 1788575398]  req@ffff8dc005dc1500 x1875453361226752/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575423 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575398.051837:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361226752/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575423 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575398.051847:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575398.051850:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575398.051853:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361226752:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575398.051860:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361226880:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575398.051935:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575398.051950:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575398/real 1788575398]  req@ffff8dc005dc3800 x1875453361226880/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575423 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575398.051962:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361226880/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575423 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575398.051971:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575398.051975:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575398.051978:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361226880:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575398.051985:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361227008:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575398.052006:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575398.052018:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575398/real 1788575398]  req@ffff8dc005dc2d80 x1875453361227008/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575423 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575398.052037:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361227008/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575423 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575398.052055:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575398.052058:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575398.052061:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361227008:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575398.052068:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361227136:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575398.052089:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575398.052101:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575398/real 1788575398]  req@ffff8dc005dc0700 x1875453361227136/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575423 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575398.052114:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361227136/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575423 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575398.052121:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575398.052125:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575398.052128:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361227136:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575398.435006:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575398.435007:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575398.435024:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575398.435080:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575398.435088:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575398.435117:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575399.074984:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575399.458974:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575399.458987:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575399.459010:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575399.459014:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575399.459015:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575399.459019:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575400.099001:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575400.482990:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575400.482999:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575400.483020:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575400.483094:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575400.483103:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575400.483123:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575401.122967:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575401.506947:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575401.506947:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575401.506954:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575401.506967:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575401.506989:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575401.507022:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575402.146978:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575402.530976:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575402.530976:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575402.530976:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575402.531120:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575402.531124:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575402.531150:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1788575403.170982:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788575403.170986:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575403.170990:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575403.170995:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575403.171003:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3748
00000100:00080000:1.0:1788575403.171011:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575403.171017:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575403.171045:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361227264/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575403.171068:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575403.171070:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575403.171072:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575403.171074:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3748
00000100:00080000:1.0:1788575403.171076:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575403.171078:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575403.171085:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575403.171099:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361227392/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575403.171110:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575403.171113:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575403.171116:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788575403.171119:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361227264:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788575403.171122:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3748
00000100:00080000:1.0:1788575403.171128:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575403.171134:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575403.171139:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575403.171148:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361227520/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575403.171154:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575403.171157:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575403.171158:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575403.171161:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3748
00000100:00080000:1.0:1788575403.171163:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575403.171165:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575403.171173:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575403.171180:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361227648/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575403.171186:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1788575403.171191:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788575403.171192:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575403.171197:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575403.171202:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3748
00000100:00080000:1.0:1788575403.171205:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575403.171208:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575403.171212:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575403.171221:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361227776/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575403.171227:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575403.171230:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575403.171232:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788575403.171233:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575403/real 1788575403]  req@ffff8dc005dc3b80 x1875453361227264/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575428 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575403.171237:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3748
00000100:00080000:1.0:1788575403.171241:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575403.171246:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575403.171252:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575403.171264:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361227904/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575403.171264:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361227264/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575428 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575403.171284:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575403.171287:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575403.171289:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575403.171293:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3748
00000100:00080000:1.0:1788575403.171300:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575403.171303:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575403.171306:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:3.0:1788575403.171310:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000008:00100000:1.0:1788575403.171314:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575403.171316:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361227264:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788575403.171330:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361228032/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575403.171341:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361227392:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575403.171363:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575403.171374:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575403/real 1788575403]  req@ffff8dc005dc0700 x1875453361227392/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575428 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575403.171385:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361227392/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575428 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575403.171394:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575403.171397:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575403.171400:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361227392:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575403.171405:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361227520:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575403.171420:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575403.171429:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575403/real 1788575403]  req@ffff8dc005dc2d80 x1875453361227520/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575428 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575403.171444:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361227520/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575428 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575403.171452:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575403.171455:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575403.171458:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361227520:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575403.171463:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361227648:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575403.171477:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575403.171485:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575403/real 1788575403]  req@ffff8dc005dc3800 x1875453361227648/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575428 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575403.171495:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361227648/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575428 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575403.171503:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575403.171506:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575403.171514:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361227648:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575403.171519:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361227776:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575403.171534:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575403.171543:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575403/real 1788575403]  req@ffff8dc005dc1500 x1875453361227776/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575428 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575403.171553:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361227776/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575428 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575403.171567:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575403.171570:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575403.171573:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361227776:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575403.171578:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361227904:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575403.171601:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575403.171610:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575403/real 1788575403]  req@ffff8dc005dc1180 x1875453361227904/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575428 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575403.171620:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361227904/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575428 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575403.171627:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575403.171630:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575403.171632:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361227904:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575403.171648:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361228032:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575403.171664:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575403.171672:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575403/real 1788575403]  req@ffff8dc005dc0a80 x1875453361228032/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575428 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575403.171682:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361228032/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575428 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575403.171689:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575403.171692:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575403.171695:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361228032:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575403.554983:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575403.554990:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575403.555029:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575403.555029:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575403.555037:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575403.555042:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575404.195023:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575404.578959:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575404.578960:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575404.578992:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575404.578996:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575404.579001:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575404.579025:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575405.218949:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575405.602966:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575405.602966:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575405.603012:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575405.603042:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575405.603049:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575405.603057:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575406.242997:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575406.626986:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575406.626987:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575406.626987:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575406.626991:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575406.627022:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575406.627086:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575407.266990:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575407.651019:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575407.651124:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575407.651126:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575407.651134:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575407.651196:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575407.651236:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575408.290953:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575408.290973:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575408.290984:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575408.290990:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575408.291002:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3753
00000100:00080000:1.0:1788575408.291015:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575408.291024:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575408.291069:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361228160/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575408.291102:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575408.291106:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575408.291108:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575408.291113:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3753
00000100:00080000:1.0:1788575408.291117:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575408.291121:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575408.291133:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575408.291152:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361228288/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575408.291162:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361228160:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788575408.291170:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575408.291175:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575408.291177:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575408.291183:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3753
00000100:00080000:1.0:1788575408.291187:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575408.291193:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575408.291199:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575408.291213:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361228416/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575408.291223:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575408.291227:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575408.291229:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575408.291234:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3753
00000100:00080000:1.0:1788575408.291238:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1788575408.291245:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788575408.291246:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575408.291255:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575408.291271:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361228544/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575408.291283:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575408.291288:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:3.0:1788575408.291288:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575408/real 1788575408]  req@ffff8dc005dc1c00 x1875453361228160/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575433 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575408.291296:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575408.291316:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3753
00000100:00080000:1.0:1788575408.291323:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788575408.291324:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361228160/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575433 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575408.291336:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:3.0:1788575408.291341:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:1.0:1788575408.291346:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788575408.291347:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575408.291354:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361228160:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788575408.291368:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361228672/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575408.291376:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575408.291380:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575408.291382:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575408.291388:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3753
00000100:00100000:3.0:1788575408.291391:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361228288:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788575408.291393:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575408.291399:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575408.291405:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575408.291420:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361228800/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575408.291430:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1788575408.291438:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788575408.291439:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575408.291443:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575408.291451:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3753
00000100:00080000:1.0:1788575408.291454:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575408.291457:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575408.291460:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575408.291472:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361228928/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575408.291474:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575408/real 1788575408]  req@ffff8dc005dc0a80 x1875453361228288/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575433 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575408.291512:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361228288/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575433 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575408.291524:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575408.291529:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575408.291532:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361228288:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575408.291539:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361228416:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575408.291564:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575408.291584:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575408/real 1788575408]  req@ffff8dc005dc1180 x1875453361228416/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575433 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575408.291596:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361228416/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575433 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575408.291605:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575408.291608:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575408.291611:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361228416:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575408.291617:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361228544:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575408.291632:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575408.291640:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575408/real 1788575408]  req@ffff8dc005dc1500 x1875453361228544/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575433 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575408.291646:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361228544/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575433 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575408.291652:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575408.291654:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575408.291656:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361228544:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575408.291659:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361228672:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575408.291669:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575408.291675:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575408/real 1788575408]  req@ffff8dc005dc3800 x1875453361228672/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575433 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575408.291681:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361228672/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575433 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575408.291686:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575408.291688:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575408.291690:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361228672:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575408.291701:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361228800:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575408.291717:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575408.291724:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575408/real 1788575408]  req@ffff8dc005dc2d80 x1875453361228800/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575433 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575408.291730:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361228800/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575433 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575408.291735:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575408.291737:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575408.291739:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361228800:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575408.291742:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361228928:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575408.291752:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575408.291761:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575408/real 1788575408]  req@ffff8dc005dc0700 x1875453361228928/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575433 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575408.291778:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361228928/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575433 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575408.291785:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575408.291789:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575408.291792:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361228928:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575408.674975:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575408.674979:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575408.675009:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575408.675019:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575408.675034:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575408.675036:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575409.314968:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575409.698972:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575409.698973:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575409.698978:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575409.698994:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575409.698997:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575409.699003:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575410.339003:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575410.723014:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575410.723015:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575410.723015:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575410.723039:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575410.723058:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575410.723063:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575411.362945:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575411.746958:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575411.746958:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575411.746958:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575411.746990:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575411.746996:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575411.746998:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575412.386967:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575412.770932:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575412.770939:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575412.770943:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575412.770944:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575412.770976:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575412.770990:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1788575413.410951:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575413.410959:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575413.410962:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575413.410970:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3759
00000100:00100000:2.0:1788575413.410976:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575413.410979:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575413.410986:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575413.411017:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361229056/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575413.411040:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575413.411045:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575413.411046:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575413.411049:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3759
00000100:00080000:1.0:1788575413.411051:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575413.411055:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575413.411062:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575413.411072:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361229184/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575413.411079:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575413.411082:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575413.411084:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788575413.411087:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361229056:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788575413.411089:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3759
00000100:00080000:1.0:1788575413.411094:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575413.411097:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575413.411102:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575413.411109:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361229312/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575413.411114:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575413.411117:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575413.411118:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575413.411121:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3759
00000100:00080000:1.0:1788575413.411124:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575413.411126:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575413.411129:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575413.411136:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361229440/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575413.411141:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575413.411143:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575413.411144:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575413.411147:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3759
00000100:00080000:1.0:1788575413.411150:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1788575413.411155:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788575413.411155:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575413.411161:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575413.411168:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361229568/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575413.411174:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575413.411176:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575413.411177:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575413.411179:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3759
00000100:00080000:1.0:1788575413.411182:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575413.411184:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575413.411186:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575413.411199:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575413/real 1788575413]  req@ffff8dc005dc3b80 x1875453361229056/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575438 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575413.411199:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361229696/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575413.411218:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575413.411223:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575413.411224:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575413.411226:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3759
00000100:00080000:1.0:1788575413.411229:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575413.411231:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575413.411233:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575413.411237:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361229056/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575438 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575413.411242:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361229824/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575413.411263:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575413.411269:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575413.411275:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361229056:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788575413.411296:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361229184:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575413.411319:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575413.411331:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575413/real 1788575413]  req@ffff8dc005dc0700 x1875453361229184/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575438 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575413.411347:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361229184/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575438 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575413.411356:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575413.411359:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575413.411363:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361229184:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575413.411369:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361229312:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575413.411388:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575413.411401:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575413/real 1788575413]  req@ffff8dc005dc2d80 x1875453361229312/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575438 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575413.411413:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361229312/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575438 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575413.411431:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575413.411435:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575413.411440:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361229312:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575413.411448:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361229440:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575413.411469:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575413.411479:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575413/real 1788575413]  req@ffff8dc005dc3800 x1875453361229440/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575438 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575413.411490:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361229440/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575438 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575413.411504:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575413.411507:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575413.411511:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361229440:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575413.411516:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361229568:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575413.411532:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575413.411541:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575413/real 1788575413]  req@ffff8dc005dc1500 x1875453361229568/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575438 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575413.411556:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361229568/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575438 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575413.411562:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575413.411564:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575413.411566:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361229568:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575413.411570:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361229696:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575413.411582:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575413.411588:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575413/real 1788575413]  req@ffff8dc005dc1180 x1875453361229696/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575438 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575413.411594:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361229696/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575438 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575413.411598:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575413.411600:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575413.411602:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361229696:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575413.411605:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361229824:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575413.411613:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575413.411618:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575413/real 1788575413]  req@ffff8dc005dc0a80 x1875453361229824/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575438 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575413.411624:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361229824/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575438 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575413.411628:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575413.411630:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575413.411631:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361229824:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575413.794938:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575413.794941:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575413.794948:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575413.794971:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575413.794972:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575413.794973:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575414.434966:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575414.818914:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575414.818931:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575414.818949:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575414.818951:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575414.818961:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575414.818964:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575415.458933:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575415.842941:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575415.842951:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575415.842951:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575415.842968:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575415.842972:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575415.842976:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575416.482951:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575416.866990:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575416.867002:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575416.867010:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575416.867044:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575416.867049:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575416.867059:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575417.506952:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575417.890995:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575417.890999:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575417.891045:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575417.891055:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575417.891082:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575417.891082:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575418.530988:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575418.531001:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575418.531014:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575418.531019:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575418.531032:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3764
00000100:00080000:1.0:1788575418.531043:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575418.531051:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575418.531085:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361229952/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575418.531110:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575418.531112:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575418.531114:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575418.531117:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3764
00000100:00080000:1.0:1788575418.531119:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575418.531121:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575418.531129:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575418.531138:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361230080/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575418.531145:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575418.531148:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575418.531149:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575418.531152:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3764
00000100:00080000:1.0:1788575418.531154:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575418.531157:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575418.531160:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575418.531170:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361230208/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575418.531181:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361229952:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788575418.531183:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575418.531195:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575418.531198:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575418.531202:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3764
00000100:00080000:1.0:1788575418.531203:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575418.531206:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575418.531208:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575418.531216:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361230336/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575418.531221:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575418.531223:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575418.531224:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575418.531227:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3764
00000100:00080000:1.0:1788575418.531229:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575418.531232:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575418.531234:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575418.531241:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361230464/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575418.531248:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575418.531252:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575418.531253:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575418.531256:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3764
00000100:00080000:1.0:1788575418.531267:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575418.531269:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575418.531273:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575418.531284:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361230592/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575418.531290:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575418.531293:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575418.531294:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575418.531297:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3764
00000100:00080000:1.0:1788575418.531300:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575418.531302:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575418.531304:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575418.531314:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361230720/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575418.531339:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361230080:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575418.531392:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361230208:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575418.531423:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361230336:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575418.531450:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361230464:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575418.531476:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361230592:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575418.531510:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361230720:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575418.914979:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575418.914979:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575418.914979:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575418.915020:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575418.915041:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575418.915064:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575419.554943:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575419.938993:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575419.939033:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575419.939042:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575419.939067:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575419.939087:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788575419.939089:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575420.578994:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575420.962976:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575420.962985:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575420.962985:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575420.962985:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575420.963020:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575420.963070:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575421.602975:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000400:00000100:3.0:1788575421.603164:0:2334:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.140:988
00000400:00000100:3.0:1788575421.603205:0:2334:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.140@tcp at host 192.168.202.140 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:3.0:1788575421.603222:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788575421.603266:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788575421.603277:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788575421.603287:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788575421.603298:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788575421.603308:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788575421.603318:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:0.0:1788575421.603327:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575418/real 1788575421]  req@ffff8dc005dc1180 x1875453361230208/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575443 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575421.603357:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361230208/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575443 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575421.603372:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575421.603378:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575421.603383:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361230208:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575421.603392:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575418/real 1788575421]  req@ffff8dc005dc1500 x1875453361230336/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575443 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575421.603405:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361230336/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575443 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575421.603418:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575421.603421:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575421.603424:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361230336:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575421.603431:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575418/real 1788575421]  req@ffff8dc005dc3800 x1875453361230464/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575443 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575421.603447:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361230464/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575443 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575421.603456:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575421.603460:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575421.603463:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361230464:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575421.603469:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575418/real 1788575421]  req@ffff8dc005dc2d80 x1875453361230592/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575443 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575421.603479:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361230592/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575443 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575421.603486:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575421.603490:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575421.603493:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361230592:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575421.603501:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575418/real 1788575421]  req@ffff8dc005dc0700 x1875453361230720/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575443 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575421.603513:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361230720/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575443 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575421.603521:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575421.603524:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575421.603527:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361230720:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575421.603534:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575418/real 1788575421]  req@ffff8dc005dc1c00 x1875453361229952/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575443 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575421.603547:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361229952/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575443 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575421.603554:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575421.603558:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575421.603562:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361229952:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788575421.603569:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575418/real 1788575421]  req@ffff8dc005dc0a80 x1875453361230080/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575443 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575421.603582:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361230080/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575443 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575421.603592:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575421.603595:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575421.603599:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361230080:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575421.986986:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575421.986986:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575421.986991:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575421.987017:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575421.987033:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575421.987063:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575422.626967:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575423.010961:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575423.010980:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575423.011008:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575423.011023:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575423.011033:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575423.011054:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575423.650977:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575423.650983:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575423.650992:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575423.650998:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575423.651010:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3769
00000100:00080000:1.0:1788575423.651021:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575423.651029:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575423.651068:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361230848/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575423.651103:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575423.651106:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575423.651108:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575423.651112:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3769
00000100:00080000:1.0:1788575423.651116:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575423.651124:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575423.651137:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575423.651154:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361230976/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575423.651169:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788575423.651176:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361230848:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788575423.651176:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575423.651179:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575423.651190:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3769
00000100:00080000:1.0:1788575423.651195:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575423.651200:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575423.651208:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575423.651237:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361231104/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575423.651253:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575423.651257:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575423.651259:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1788575423.651267:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788575423.651272:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3769
00000100:00080000:1.0:1788575423.651279:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575423.651284:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575423.651291:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575423.651306:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361231232/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575423.651315:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575423.651325:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575423.651327:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788575423.651337:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575423/real 1788575423]  req@ffff8dc005dc3b80 x1875453361230848/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575448 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575423.651339:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3769
00000100:00080000:1.0:1788575423.651347:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575423.651358:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575423.651368:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575423.651377:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361230848/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575448 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575423.651385:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361231360/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575423.651438:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575423.651443:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575423.651445:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575423.651451:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575423.651459:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788575423.651466:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3769
00000100:00100000:0.0:1788575423.651473:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361230848:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788575423.651476:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575423.651487:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575423.651496:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575423.651513:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361231488/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575423.651518:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361230976:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788575423.651552:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575423.651557:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575423.651559:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575423.651565:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3769
00000800:00000100:0.0:1788575423.651575:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788575423.651577:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575423.651584:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575423.651590:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575423.651599:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575423/real 1788575423]  req@ffff8dc005dc0a80 x1875453361230976/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575448 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575423.651621:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361231616/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575423.651622:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361230976/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575448 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575423.651652:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575423.651657:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575423.651663:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361230976:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575423.651691:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361231104:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575423.651718:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575423.651730:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575423/real 1788575423]  req@ffff8dc005dc1c00 x1875453361231104/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575448 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575423.651741:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361231104/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575448 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575423.651750:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575423.651753:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575423.651757:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361231104:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575423.651765:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361231232:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575423.651782:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575423.651798:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575423/real 1788575423]  req@ffff8dc005dc0700 x1875453361231232/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575448 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575423.651809:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361231232/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575448 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575423.651818:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575423.651821:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575423.651824:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361231232:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575423.651831:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361231360:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575423.651849:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575423.651859:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575423/real 1788575423]  req@ffff8dc005dc2d80 x1875453361231360/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575448 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575423.651910:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361231360/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575448 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575423.651919:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575423.651923:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575423.651926:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361231360:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575423.651946:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361231488:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575423.651968:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575423.651980:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575423/real 1788575423]  req@ffff8dc005dc3800 x1875453361231488/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575448 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575423.651992:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361231488/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575448 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575423.652000:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575423.652002:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575423.652005:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361231488:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575423.652012:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361231616:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575423.652039:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575423.652051:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575423/real 1788575423]  req@ffff8dc005dc1500 x1875453361231616/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575448 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575423.652063:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361231616/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575448 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575423.652074:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575423.652077:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575423.652079:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361231616:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575424.035006:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575424.035012:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575424.035012:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788575424.035049:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575424.035054:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575424.035054:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575424.674947:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575425.058964:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575425.058964:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575425.058992:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575425.059000:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575425.059026:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788575425.059058:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575425.698973:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575426.083005:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575426.083047:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575426.083051:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575426.083051:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575426.083091:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788575426.083138:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575426.722960:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575427.106979:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575427.106980:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575427.106989:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575427.107023:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575427.107037:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575427.107061:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575427.746975:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575428.130978:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575428.130978:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575428.130978:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575428.131012:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575428.131013:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788575428.131019:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575428.770960:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788575428.771014:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575428.771019:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788575428.771023:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575428.771032:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3774
00000100:00080000:3.0:1788575428.771043:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575428.771051:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575428.771090:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e680 x1875453361231744/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575428.771125:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575428.771130:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575428.771132:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575428.771137:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3774
00000100:00080000:3.0:1788575428.771141:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575428.771146:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575428.771155:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575428.771164:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361231744:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788575428.771169:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d180 x1875453361231872/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575428.771180:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575428.771182:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575428.771183:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575428.771186:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3774
00000100:00080000:3.0:1788575428.771189:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575428.771191:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575428.771195:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575428.771203:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f480 x1875453361232000/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575428.771218:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575428.771221:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575428.771223:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575428.771225:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3774
00000100:00080000:3.0:1788575428.771228:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575428.771232:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:0.0:1788575428.771234:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:3.0:1788575428.771237:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575428.771247:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c380 x1875453361232128/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575428.771254:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575428.771256:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575428.771257:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575428.771259:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3774
00000100:00080000:3.0:1788575428.771262:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575428.771266:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575428.771270:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575428.771277:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575428/real 1788575428]  req@ffff8dc00644e680 x1875453361231744/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575453 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575428.771280:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d500 x1875453361232256/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575428.771305:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575428.771308:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575428.771309:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575428.771314:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3774
00000100:00080000:3.0:1788575428.771316:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575428.771318:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575428.771321:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575428.771322:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453361231744/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575453 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575428.771329:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ea00 x1875453361232384/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575428.771336:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575428.771338:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575428.771342:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788575428.771345:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:0.0:1788575428.771348:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361231744:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788575428.771350:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575428.771358:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3774
00000100:00080000:3.0:1788575428.771362:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575428.771366:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575428.771371:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575428.771377:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361231872:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575428.771387:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ca80 x1875453361232512/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1788575428.771407:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575428.771422:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575428/real 1788575428]  req@ffff8dc00644d180 x1875453361231872/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575453 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575428.771431:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453361231872/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575453 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575428.771438:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575428.771440:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575428.771442:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361231872:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575428.771447:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361232000:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575428.771461:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575428.771467:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575428/real 1788575428]  req@ffff8dc00644f480 x1875453361232000/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575453 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575428.771480:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453361232000/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575453 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575428.771485:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575428.771487:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575428.771489:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361232000:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575428.771493:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361232128:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575428.771503:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575428.771508:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575428/real 1788575428]  req@ffff8dc00644c380 x1875453361232128/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575453 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575428.771515:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453361232128/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575453 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575428.771521:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575428.771523:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575428.771525:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361232128:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575428.771528:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361232256:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575428.771538:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575428.771543:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575428/real 1788575428]  req@ffff8dc00644d500 x1875453361232256/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575453 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575428.771550:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d500 x1875453361232256/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575453 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575428.771560:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575428.771562:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575428.771565:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361232256:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575428.771568:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361232384:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575428.771578:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575428.771583:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575428/real 1788575428]  req@ffff8dc00644ea00 x1875453361232384/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575453 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575428.771590:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ea00 x1875453361232384/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575453 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575428.771595:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575428.771597:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575428.771599:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361232384:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575428.771611:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361232512:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575428.771621:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575428.771650:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575428/real 1788575428]  req@ffff8dc00644ca80 x1875453361232512/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575453 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575428.771658:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ca80 x1875453361232512/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575453 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575428.771663:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575428.771665:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575428.771668:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361232512:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575429.155013:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575429.155013:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575429.155013:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575429.155015:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575429.155058:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575429.155117:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575429.795011:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575430.178974:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575430.178989:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788575430.179055:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575430.179119:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575430.179137:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575430.179137:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575430.818968:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575431.202988:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575431.202988:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575431.202988:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575431.203020:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575431.203025:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575431.203038:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575431.842959:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575432.226958:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575432.226958:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575432.226958:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575432.227005:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788575432.227037:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575432.227107:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575432.866974:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575433.251018:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575433.251027:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575433.251027:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575433.251059:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575433.251073:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575433.251081:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00080000:3.0:1788575433.890982:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575433.890991:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788575433.890995:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788575433.891006:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788575433.891007:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3779
00000100:00080000:3.0:1788575433.891022:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575433.891033:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575433.891070:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ce00 x1875453361232640/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575433.891098:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575433.891103:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575433.891105:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575433.891110:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3779
00000100:00080000:3.0:1788575433.891115:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575433.891119:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575433.891130:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575433.891142:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361232640:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788575433.891145:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f800 x1875453361232768/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575433.891157:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575433.891161:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575433.891163:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575433.891170:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3779
00000100:00080000:3.0:1788575433.891174:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575433.891178:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575433.891183:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788575433.891199:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575433.891200:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c000 x1875453361232896/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575433.891212:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575433.891216:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575433.891218:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575433.891222:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3779
00000100:00080000:3.0:1788575433.891226:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575433.891230:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575433.891235:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575433.891238:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575433/real 1788575433]  req@ffff8dc00644ce00 x1875453361232640/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575458 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575433.891250:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644dc00 x1875453361233024/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575433.891255:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ce00 x1875453361232640/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575458 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575433.891275:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575433.891276:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575433.891283:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575433.891285:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575433.891290:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788575433.891294:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3779
00000100:00100000:0.0:1788575433.891298:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361232640:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788575433.891301:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575433.891309:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575433.891314:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575433.891328:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361232768:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575433.891329:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ce00 x1875453361233152/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575433.891347:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575433.891351:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575433.891353:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575433.891358:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3779
00000100:00080000:3.0:1788575433.891362:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1788575433.891367:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788575433.891370:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575433.891377:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575433.891383:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575433/real 1788575433]  req@ffff8dc00644f800 x1875453361232768/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575458 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575433.891391:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ca80 x1875453361233280/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575433.891398:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f800 x1875453361232768/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575458 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575433.891409:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575433.891420:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575433.891424:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575433.891429:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575433.891430:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3779
00000100:00080000:0.0:1788575433.891436:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788575433.891438:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788575433.891441:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361232768:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788575433.891447:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575433.891450:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361232896:192.168.202.140@tcp:8:kworker.0
00000008:00100000:3.0:1788575433.891456:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788575433.891472:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575433.891474:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ea00 x1875453361233408/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575433.891483:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575433/real 1788575433]  req@ffff8dc00644c000 x1875453361232896/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575458 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575433.891495:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c000 x1875453361232896/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575458 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575433.891501:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575433.891504:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575433.891506:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361232896:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575433.891512:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361233024:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575433.891523:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575433.891530:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575433/real 1788575433]  req@ffff8dc00644dc00 x1875453361233024/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575458 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575433.891537:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644dc00 x1875453361233024/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575458 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575433.891543:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575433.891544:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575433.891547:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361233024:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575433.891557:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361233152:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575433.891567:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575433.891573:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575433/real 1788575433]  req@ffff8dc00644ce00 x1875453361233152/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575458 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575433.891598:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ce00 x1875453361233152/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575458 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575433.891604:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575433.891606:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575433.891609:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361233152:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575433.891613:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361233280:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575433.891630:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575433.891641:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575433/real 1788575433]  req@ffff8dc00644ca80 x1875453361233280/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575458 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575433.891653:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ca80 x1875453361233280/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575458 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575433.891662:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575433.891666:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575433.891669:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361233280:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575433.891675:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361233408:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575433.891690:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575433.891698:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575433/real 1788575433]  req@ffff8dc00644ea00 x1875453361233408/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575458 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575433.891706:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ea00 x1875453361233408/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575458 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575433.891711:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575433.891713:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575433.891715:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361233408:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575434.275007:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575434.275016:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575434.275024:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575434.275058:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575434.275078:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575434.275130:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575434.914950:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575435.298948:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575435.298956:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575435.298957:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575435.298979:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575435.298986:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575435.298991:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575435.938991:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575436.322975:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575436.322975:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575436.322987:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575436.323012:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575436.323013:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788575436.323032:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575436.962940:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575437.346973:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575437.346973:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575437.346973:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575437.346997:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575437.347002:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575437.347005:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575437.986968:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575438.370967:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575438.370967:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575438.370972:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575438.371002:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575438.371002:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788575438.371048:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1788575439.010967:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788575439.010971:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788575439.010983:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788575439.010991:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575439.010999:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3784
00000100:00080000:3.0:1788575439.011009:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575439.011019:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575439.011050:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d500 x1875453361233536/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575439.011074:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575439.011077:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575439.011078:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575439.011081:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3784
00000100:00080000:3.0:1788575439.011083:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575439.011085:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575439.011093:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575439.011103:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c380 x1875453361233664/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575439.011111:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575439.011114:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575439.011115:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575439.011118:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3784
00000100:00080000:3.0:1788575439.011120:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575439.011122:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575439.011126:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575439.011133:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361233536:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788575439.011135:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f480 x1875453361233792/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575439.011153:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575439.011155:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575439.011156:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575439.011158:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3784
00000100:00080000:3.0:1788575439.011160:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575439.011163:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575439.011165:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575439.011175:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d180 x1875453361233920/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575439.011182:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575439.011184:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575439.011185:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575439.011188:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3784
00000100:00080000:3.0:1788575439.011190:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575439.011192:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575439.011195:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1788575439.011201:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575439.011205:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e680 x1875453361234048/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575439.011212:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575439.011215:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575439.011216:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575439.011219:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3784
00000100:00080000:3.0:1788575439.011223:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575439.011225:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575439.011228:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575439.011235:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c700 x1875453361234176/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575439.011241:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575439.011243:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575439.011245:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575439.011250:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3784
00000100:00100000:1.0:1788575439.011251:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575439/real 1788575439]  req@ffff8dc00644d500 x1875453361233536/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575464 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575439.011253:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575439.011259:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575439.011264:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575439.011275:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e300 x1875453361234304/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788575439.011284:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d500 x1875453361233536/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575464 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575439.011294:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575439.011297:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575439.011301:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361233536:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788575439.011309:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361233664:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788575439.011328:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575439.011337:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575439/real 1788575439]  req@ffff8dc00644c380 x1875453361233664/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575464 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575439.011346:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453361233664/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575464 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575439.011353:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575439.011355:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575439.011357:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361233664:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788575439.011375:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361233792:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788575439.011387:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575439.011394:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575439/real 1788575439]  req@ffff8dc00644f480 x1875453361233792/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575464 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575439.011402:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453361233792/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575464 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575439.011408:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575439.011410:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575439.011412:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361233792:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575439.011415:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361233920:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788575439.011425:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575439.011430:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575439/real 1788575439]  req@ffff8dc00644d180 x1875453361233920/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575464 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575439.011438:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453361233920/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575464 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575439.011444:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575439.011446:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575439.011448:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361233920:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575439.011451:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361234048:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788575439.011462:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575439.011468:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575439/real 1788575439]  req@ffff8dc00644e680 x1875453361234048/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575464 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575439.011475:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453361234048/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575464 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575439.011481:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575439.011482:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575439.011484:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361234048:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788575439.011487:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361234176:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788575439.011497:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575439.011503:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575439/real 1788575439]  req@ffff8dc00644c700 x1875453361234176/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575464 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575439.011510:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453361234176/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575464 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575439.011515:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575439.011517:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575439.011519:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361234176:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575439.011523:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361234304:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788575439.011560:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575439.011569:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575439/real 1788575439]  req@ffff8dc00644e300 x1875453361234304/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575464 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575439.011582:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453361234304/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575464 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575439.011590:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575439.011593:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575439.011596:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361234304:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575439.394986:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575439.394986:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575439.394986:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575439.395022:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575439.395024:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575439.395024:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575440.034976:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575440.418986:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575440.418986:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575440.418987:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575440.419027:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575440.419027:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575440.419039:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575441.058971:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575441.442974:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575441.442974:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575441.442998:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575441.443003:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575441.443032:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575441.443057:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575442.082978:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575442.466976:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575442.467006:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575442.467065:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575442.467216:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575442.467226:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575442.467319:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575443.107045:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575443.490985:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575443.490985:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575443.490987:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575443.491001:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575443.491036:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575443.491057:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575444.130955:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575444.130973:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575444.130978:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575444.130982:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575444.130989:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3789
00000100:00080000:1.0:1788575444.130996:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575444.131001:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575444.131028:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361234432/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575444.131056:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575444.131059:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575444.131061:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575444.131065:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3789
00000100:00080000:1.0:1788575444.131068:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575444.131073:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575444.131083:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575444.131093:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361234432:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788575444.131100:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361234560/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575444.131112:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575444.131115:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575444.131116:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575444.131126:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3789
00000100:00080000:1.0:1788575444.131143:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575444.131147:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575444.131152:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788575444.131164:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575444.131169:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361234688/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575444.131180:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575444.131184:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575444.131186:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575444.131189:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3789
00000100:00080000:1.0:1788575444.131199:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788575444.131204:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575444/real 1788575444]  req@ffff8dc005dc1180 x1875453361234432/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575469 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575444.131205:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575444.131212:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575444.131228:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361234816/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575444.131232:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361234432/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575469 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575444.131249:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575444.131252:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575444.131254:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575444.131259:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575444.131261:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788575444.131266:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3789
00000100:00100000:0.0:1788575444.131270:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361234432:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788575444.131272:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575444.131280:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575444.131284:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575444.131293:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361234944/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575444.131298:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361234560:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788575444.131302:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575444.131305:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575444.131307:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575444.131310:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3789
00000100:00080000:1.0:1788575444.131312:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575444.131315:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575444.131319:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575444.131325:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361235072/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1788575444.131332:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788575444.131341:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575444.131344:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575444.131345:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575444.131348:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3789
00000100:00080000:1.0:1788575444.131349:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788575444.131352:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575444/real 1788575444]  req@ffff8dc005dc1500 x1875453361234560/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575469 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575444.131353:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575444.131358:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575444.131366:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361235200/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575444.131372:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361234560/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575469 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575444.131381:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575444.131384:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575444.131387:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361234560:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575444.131391:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361234688:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575444.131405:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575444.131412:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575444/real 1788575444]  req@ffff8dc005dc3800 x1875453361234688/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575469 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575444.131426:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361234688/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575469 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575444.131435:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575444.131437:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575444.131439:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361234688:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575444.131442:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361234816:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575444.131452:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575444.131458:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575444/real 1788575444]  req@ffff8dc005dc2d80 x1875453361234816/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575469 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575444.131464:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361234816/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575469 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575444.131469:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575444.131471:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575444.131472:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361234816:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575444.131503:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361234944:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575444.131516:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575444.131528:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575444/real 1788575444]  req@ffff8dc005dc0700 x1875453361234944/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575469 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575444.131537:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361234944/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575469 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575444.131545:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575444.131548:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575444.131551:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361234944:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575444.131557:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361235072:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575444.131575:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575444.131584:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575444/real 1788575444]  req@ffff8dc005dc1c00 x1875453361235072/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575469 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575444.131590:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361235072/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575469 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575444.131595:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575444.131597:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575444.131599:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361235072:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575444.131602:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361235200:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575444.131613:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575444.131618:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575444/real 1788575444]  req@ffff8dc005dc0a80 x1875453361235200/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575469 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575444.131624:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361235200/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575469 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575444.131628:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575444.131630:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575444.131631:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361235200:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575444.514934:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575444.514956:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575444.514999:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575444.515002:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575444.515003:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575444.515069:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575445.155012:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575445.538938:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575445.538938:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575445.538940:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575445.538955:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575445.538974:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575445.539006:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575446.178924:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575446.562925:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575446.562926:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575446.562936:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575446.562939:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575446.562956:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575446.562992:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575447.202962:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575447.586943:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575447.586943:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575447.586944:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575447.586997:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575447.587034:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575447.587074:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575448.226981:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575448.610975:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575448.610975:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575448.610976:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575448.610976:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575448.611005:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575448.611039:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575449.250970:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788575449.251021:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575449.251027:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788575449.251031:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575449.251046:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3794
00000100:00080000:2.0:1788575449.251055:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575449.251061:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575449.251094:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361235328/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575449.251127:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575449.251131:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575449.251133:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575449.251137:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3794
00000100:00080000:2.0:1788575449.251140:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575449.251144:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575449.251152:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575449.251164:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453361235456/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575449.251174:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575449.251177:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575449.251180:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788575449.251181:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361235328:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788575449.251185:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3794
00000100:00080000:2.0:1788575449.251190:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575449.251195:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575449.251199:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575449.251211:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453361235584/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575449.251220:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575449.251224:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575449.251226:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575449.251229:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3794
00000100:00080000:2.0:1788575449.251232:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575449.251236:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575449.251240:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788575449.251245:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575449.251251:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361235712/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575449.251261:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575449.251264:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575449.251266:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575449.251270:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3794
00000100:00080000:2.0:1788575449.251273:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575449.251276:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575449.251281:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575449.251287:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575449/real 1788575449]  req@ffff8dc020495180 x1875453361235328/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575474 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575449.251292:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453361235840/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575449.251313:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575449.251316:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575449.251318:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788575449.251321:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361235328/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575474 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575449.251324:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3794
00000100:00080000:2.0:1788575449.251329:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575449.251335:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:0.0:1788575449.251336:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:2.0:1788575449.251341:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1788575449.251342:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575449.251347:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361235328:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788575449.251355:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453361235968/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575449.251366:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788575449.251369:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361235456:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788575449.251370:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575449.251374:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575449.251379:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3794
00000100:00080000:2.0:1788575449.251383:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575449.251386:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575449.251390:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575449.251400:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361236096/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1788575449.251410:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575449.251425:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575449/real 1788575449]  req@ffff8dc020496a00 x1875453361235456/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575474 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575449.251448:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453361235456/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575474 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575449.251458:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575449.251462:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575449.251465:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361235456:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575449.251471:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361235584:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575449.251498:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575449.251510:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575449/real 1788575449]  req@ffff8dc020496d80 x1875453361235584/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575474 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575449.251531:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453361235584/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575474 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575449.251539:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575449.251542:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575449.251545:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361235584:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575449.251552:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361235712:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575449.251569:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575449.251579:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575449/real 1788575449]  req@ffff8dc020494700 x1875453361235712/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575474 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575449.251589:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361235712/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575474 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575449.251596:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575449.251600:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575449.251603:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361235712:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575449.251610:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361235840:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575449.251636:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575449.251644:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575449/real 1788575449]  req@ffff8dc020494380 x1875453361235840/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575474 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575449.251655:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453361235840/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575474 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575449.251660:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575449.251662:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575449.251664:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361235840:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575449.251676:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361235968:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575449.251697:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575449.251711:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575449/real 1788575449]  req@ffff8dc020497100 x1875453361235968/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575474 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575449.251721:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453361235968/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575474 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575449.251728:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575449.251731:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575449.251734:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361235968:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575449.251740:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361236096:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575449.251758:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575449.251768:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575449/real 1788575449]  req@ffff8dc020495180 x1875453361236096/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575474 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575449.251779:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361236096/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575474 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575449.251791:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575449.251795:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575449.251798:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361236096:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575449.634950:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575449.634951:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575449.634951:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575449.634952:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575449.634981:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575449.635011:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575450.274985:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575450.658975:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575450.658975:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575450.658984:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575450.659015:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575450.659017:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575450.659022:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575451.298932:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575451.682938:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575451.682955:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575451.682958:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575451.682964:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575451.682981:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575451.683008:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575452.322959:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575452.706979:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575452.706979:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575452.706984:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575452.707009:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575452.707009:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575452.707034:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575453.346963:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575453.730931:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575453.730932:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575453.730935:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575453.730958:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575453.730977:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575453.730994:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1788575454.370973:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788575454.370984:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788575454.370984:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788575454.370988:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575454.370997:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3800
00000100:00080000:2.0:1788575454.371008:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575454.371015:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575454.371046:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361236224/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575454.371065:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575454.371068:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575454.371070:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575454.371074:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3800
00000100:00080000:2.0:1788575454.371077:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575454.371081:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575454.371090:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575454.371092:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361236224:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788575454.371101:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453361236352/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575454.371110:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575454.371112:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575454.371114:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575454.371117:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3800
00000100:00080000:2.0:1788575454.371120:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575454.371123:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575454.371127:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575454.371135:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361236480/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1788575454.371146:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788575454.371152:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575454.371155:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575454.371157:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575454.371159:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3800
00000100:00080000:2.0:1788575454.371162:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575454.371165:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575454.371169:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575454.371178:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361236608/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575454.371180:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575454/real 1788575454]  req@ffff8dc020495880 x1875453361236224/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575479 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575454.371187:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575454.371189:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575454.371191:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575454.371194:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3800
00000100:00100000:0.0:1788575454.371195:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361236224/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575479 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575454.371197:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575454.371200:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:0.0:1788575454.371204:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:2.0:1788575454.371204:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1788575454.371208:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575454.371212:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361236224:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788575454.371213:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453361236736/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575454.371220:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575454.371223:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575454.371224:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575454.371227:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3800
00000100:00100000:0.0:1788575454.371230:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361236352:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788575454.371230:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575454.371233:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575454.371238:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575454.371246:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453361236864/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1788575454.371249:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788575454.371255:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575454.371257:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575454.371259:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788575454.371260:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575454/real 1788575454]  req@ffff8dc020497480 x1875453361236352/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575479 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575454.371262:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3800
00000100:00080000:2.0:1788575454.371265:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575454.371268:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575454.371271:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453361236352/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575479 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1788575454.371273:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1788575454.371280:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1788575454.371280:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361236992/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575454.371283:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575454.371287:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361236352:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575454.371292:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361236480:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575454.371310:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575454.371321:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575454/real 1788575454]  req@ffff8dc020494000 x1875453361236480/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575479 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575454.371331:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361236480/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575479 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575454.371339:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575454.371343:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575454.371346:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361236480:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575454.371352:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361236608:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575454.371370:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575454.371380:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575454/real 1788575454]  req@ffff8dc020495500 x1875453361236608/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575479 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575454.371406:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361236608/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575479 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575454.371416:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575454.371418:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575454.371420:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361236608:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575454.371424:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361236736:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575454.371438:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575454.371445:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575454/real 1788575454]  req@ffff8dc020494a80 x1875453361236736/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575479 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575454.371458:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453361236736/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575479 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575454.371469:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575454.371472:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575454.371475:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361236736:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575454.371491:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361236864:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575454.371510:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575454.371517:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575454/real 1788575454]  req@ffff8dc020494e00 x1875453361236864/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575479 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575454.371524:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453361236864/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575479 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575454.371529:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575454.371531:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575454.371533:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361236864:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575454.371544:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361236992:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575454.371554:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575454.371560:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575454/real 1788575454]  req@ffff8dc020495880 x1875453361236992/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575479 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575454.371566:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361236992/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575479 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575454.371571:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575454.371572:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575454.371574:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361236992:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575454.754972:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575454.754973:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575454.754973:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575454.754973:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575454.755005:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788575454.755056:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575455.394981:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575455.778953:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575455.778953:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575455.778974:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575455.779049:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575455.779056:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575455.779104:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575456.418939:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575456.802957:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575456.802957:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575456.802965:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575456.802986:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788575456.802986:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575456.802989:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575457.442954:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575457.826942:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575457.826942:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575457.826948:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575457.826972:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575457.826973:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575457.826985:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575458.466984:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575458.850964:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575458.850964:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575458.850996:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575458.851014:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575458.851031:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788575458.851047:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1788575459.490992:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788575459.490996:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788575459.491007:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788575459.491012:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575459.491024:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3805
00000100:00080000:3.0:1788575459.491043:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575459.491052:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575459.491100:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644fb80 x1875453361237120/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575459.491134:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575459.491138:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575459.491140:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575459.491145:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3805
00000100:00080000:3.0:1788575459.491150:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575459.491154:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575459.491171:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575459.491183:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361237120:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788575459.491188:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644df80 x1875453361237248/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575459.491200:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575459.491204:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575459.491206:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575459.491210:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3805
00000100:00080000:3.0:1788575459.491214:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575459.491218:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575459.491223:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575459.491237:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ed80 x1875453361237376/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575459.491247:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575459.491250:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575459.491252:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575459.491256:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3805
00000100:00080000:3.0:1788575459.491260:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575459.491264:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575459.491270:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788575459.491277:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575459.491283:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f100 x1875453361237504/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575459.491294:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575459.491298:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575459.491300:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575459.491305:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3805
00000100:00080000:3.0:1788575459.491309:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575459.491313:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575459.491318:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575459.491330:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d880 x1875453361237632/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575459.491333:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575459/real 1788575459]  req@ffff8dc00644fb80 x1875453361237120/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575484 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575459.491352:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575459.491357:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575459.491359:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788575459.491365:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644fb80 x1875453361237120/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575484 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575459.491366:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3805
00000100:00080000:3.0:1788575459.491372:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575459.491379:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575459.491386:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1788575459.491387:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575459.491395:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575459.491411:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361237120:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788575459.491416:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e300 x1875453361237760/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575459.491427:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575459.491431:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575459.491433:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788575459.491437:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361237248:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788575459.491439:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3805
00000100:00080000:3.0:1788575459.491446:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575459.491451:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575459.491457:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788575459.491463:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575459.491472:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c700 x1875453361237888/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575459.491476:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575459/real 1788575459]  req@ffff8dc00644df80 x1875453361237248/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575484 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575459.491498:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644df80 x1875453361237248/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575484 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575459.491507:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575459.491509:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575459.491512:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361237248:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575459.491517:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361237376:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575459.491530:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575459.491536:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575459/real 1788575459]  req@ffff8dc00644ed80 x1875453361237376/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575484 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575459.491543:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ed80 x1875453361237376/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575484 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575459.491553:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575459.491555:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575459.491557:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361237376:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575459.491560:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361237504:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575459.491569:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575459.491574:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575459/real 1788575459]  req@ffff8dc00644f100 x1875453361237504/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575484 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575459.491580:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f100 x1875453361237504/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575484 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575459.491594:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575459.491596:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575459.491598:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361237504:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575459.491602:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361237632:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575459.491613:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575459.491619:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575459/real 1788575459]  req@ffff8dc00644d880 x1875453361237632/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575484 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575459.491626:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d880 x1875453361237632/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575484 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575459.491632:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575459.491633:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575459.491636:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361237632:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575459.491639:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361237760:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575459.491649:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575459.491654:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575459/real 1788575459]  req@ffff8dc00644e300 x1875453361237760/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575484 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575459.491660:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453361237760/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575484 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575459.491665:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575459.491666:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575459.491668:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361237760:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575459.491679:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361237888:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575459.491688:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575459.491693:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575459/real 1788575459]  req@ffff8dc00644c700 x1875453361237888/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575484 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575459.491698:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453361237888/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575484 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575459.491703:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575459.491705:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575459.491706:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361237888:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575459.875037:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575459.875039:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575459.875041:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575459.875078:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575459.875085:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575459.875088:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575460.515012:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575460.898990:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575460.898996:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575460.898996:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575460.899034:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575460.899034:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575460.899059:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575461.538978:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575461.923010:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575461.923010:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575461.923010:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575461.923055:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575461.923073:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575461.923074:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575462.562966:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575462.946962:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575462.946962:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575462.946963:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575462.946990:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575462.946992:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575462.946997:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575463.586980:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575463.971018:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575463.971018:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575463.971023:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575463.971024:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575463.971064:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575463.971115:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575464.611005:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788575464.611015:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575464.611027:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788575464.611031:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575464.611041:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3810
00000100:00080000:2.0:1788575464.611052:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575464.611059:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575464.611094:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361238016/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575464.611122:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575464.611125:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575464.611126:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575464.611129:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3810
00000100:00080000:2.0:1788575464.611132:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575464.611137:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575464.611146:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575464.611160:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453361238144/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575464.611167:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361238016:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788575464.611168:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575464.611182:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575464.611186:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575464.611189:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3810
00000100:00080000:2.0:1788575464.611192:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575464.611196:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575464.611201:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575464.611216:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453361238272/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575464.611225:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575464.611228:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575464.611230:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575464.611233:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3810
00000100:00080000:2.0:1788575464.611237:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575464.611241:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575464.611246:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575464.611255:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361238400/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575464.611262:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575464.611265:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575464.611267:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1788575464.611274:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788575464.611278:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3810
00000100:00080000:2.0:1788575464.611284:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575464.611290:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575464.611295:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575464.611322:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453361238528/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575464.611334:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575464/real 1788575464]  req@ffff8dc020495180 x1875453361238016/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575489 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575464.611368:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575464.611372:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575464.611375:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575464.611381:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3810
00000100:00100000:0.0:1788575464.611383:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361238016/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575489 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575464.611390:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575464.611404:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:0.0:1788575464.611411:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:2.0:1788575464.611412:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1788575464.611420:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575464.611424:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361238016:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788575464.611430:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453361238656/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575464.611436:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575464.611438:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575464.611440:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575464.611443:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3810
00000100:00080000:2.0:1788575464.611445:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575464.611447:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575464.611451:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575464.611457:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361238144:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575464.611461:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361238784/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1788575464.611495:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575464.611512:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575464/real 1788575464]  req@ffff8dc020497100 x1875453361238144/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575489 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575464.611525:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453361238144/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575489 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575464.611533:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575464.611536:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575464.611538:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361238144:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575464.611543:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361238272:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575464.611584:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575464.611591:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575464/real 1788575464]  req@ffff8dc020494380 x1875453361238272/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575489 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575464.611599:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453361238272/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575489 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575464.611605:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575464.611608:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575464.611610:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361238272:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575464.611613:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361238400:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575464.611623:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575464.611629:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575464/real 1788575464]  req@ffff8dc020494700 x1875453361238400/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575489 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575464.611639:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361238400/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575489 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575464.611653:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575464.611656:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575464.611659:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361238400:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575464.611664:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361238528:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575464.611682:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575464.611692:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575464/real 1788575464]  req@ffff8dc020496d80 x1875453361238528/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575489 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575464.611701:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453361238528/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575489 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575464.611709:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575464.611712:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575464.611714:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361238528:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575464.611720:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361238656:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575464.611738:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575464.611747:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575464/real 1788575464]  req@ffff8dc020496a00 x1875453361238656/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575489 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575464.611757:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453361238656/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575489 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575464.611765:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575464.611768:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575464.611772:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361238656:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575464.611791:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361238784:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575464.611809:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575464.611819:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575464/real 1788575464]  req@ffff8dc020495180 x1875453361238784/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575489 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575464.611828:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361238784/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575489 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575464.611835:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575464.611837:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575464.611840:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361238784:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575464.994996:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575464.995033:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575464.995038:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575464.995040:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575464.995074:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575464.995080:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575465.634988:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575466.019007:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575466.019014:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575466.019014:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575466.019015:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575466.019052:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575466.019113:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575466.659028:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575467.043016:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575467.043016:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575467.043016:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575467.043057:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575467.043059:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575467.043127:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575467.683002:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575468.067019:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575468.067020:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575468.067035:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575468.067040:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575468.067060:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575468.067110:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575468.706990:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575469.090983:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575469.091013:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575469.091019:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575469.091020:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575469.091076:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575469.091110:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1788575469.730941:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788575469.730945:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788575469.730949:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788575469.730954:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575469.730963:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3815
00000100:00080000:2.0:1788575469.730971:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575469.730978:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575469.731010:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361238912/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575469.731032:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575469.731035:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575469.731036:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575469.731039:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3815
00000100:00080000:2.0:1788575469.731041:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575469.731044:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575469.731052:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575469.731063:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361238912:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788575469.731063:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453361239040/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575469.731076:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575469.731078:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575469.731079:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575469.731082:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3815
00000100:00080000:2.0:1788575469.731084:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575469.731086:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575469.731089:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575469.731099:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453361239168/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575469.731105:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575469.731108:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575469.731109:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575469.731111:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3815
00000100:00080000:2.0:1788575469.731113:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575469.731116:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575469.731123:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788575469.731128:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575469.731135:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361239296/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575469.731142:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575469.731144:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575469.731146:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575469.731149:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3815
00000100:00080000:2.0:1788575469.731152:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575469.731154:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575469.731157:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575469.731167:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575469/real 1788575469]  req@ffff8dc020495880 x1875453361238912/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575494 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575469.731168:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361239424/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575469.731199:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575469.731206:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575469.731209:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575469.731217:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3815
00000100:00080000:2.0:1788575469.731219:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575469.731222:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575469.731225:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575469.731231:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361238912/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575494 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575469.731235:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453361239552/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575469.731253:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575469.731253:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575469.731260:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575469.731262:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788575469.731263:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788575469.731269:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361238912:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788575469.731270:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3815
00000100:00080000:2.0:1788575469.731276:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575469.731280:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575469.731283:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575469.731290:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361239680/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575469.731296:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361239040:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575469.731320:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575469.731330:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575469/real 1788575469]  req@ffff8dc020494e00 x1875453361239040/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575494 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575469.731338:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453361239040/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575494 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575469.731345:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575469.731347:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575469.731350:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361239040:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575469.731354:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361239168:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575469.731365:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575469.731372:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575469/real 1788575469]  req@ffff8dc020494a80 x1875453361239168/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575494 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575469.731379:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453361239168/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575494 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575469.731389:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575469.731391:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575469.731393:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361239168:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575469.731396:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361239296:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575469.731408:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575469.731418:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575469/real 1788575469]  req@ffff8dc020495500 x1875453361239296/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575494 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575469.731429:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361239296/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575494 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575469.731439:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575469.731442:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575469.731446:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361239296:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575469.731452:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361239424:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575469.731471:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575469.731479:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575469/real 1788575469]  req@ffff8dc020494000 x1875453361239424/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575494 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575469.731487:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361239424/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575494 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575469.731493:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575469.731495:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575469.731498:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361239424:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575469.731502:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361239552:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575469.731513:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575469.731519:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575469/real 1788575469]  req@ffff8dc020497480 x1875453361239552/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575494 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575469.731526:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453361239552/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575494 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575469.731531:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575469.731532:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575469.731534:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361239552:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575469.731547:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361239680:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575469.731556:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575469.731562:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575469/real 1788575469]  req@ffff8dc020495180 x1875453361239680/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575494 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575469.731569:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361239680/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575494 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575469.731574:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575469.731576:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575469.731578:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361239680:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575470.114968:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575470.114979:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575470.115008:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575470.115016:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575470.115020:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575470.115023:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575470.754975:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575471.138964:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575471.138991:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575471.139003:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575471.139029:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575471.139044:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575471.139047:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575471.779037:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575472.162996:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575472.163031:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575472.163037:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575472.163055:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575472.163070:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575472.163087:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575472.803007:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575473.186969:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575473.186969:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575473.186992:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575473.186995:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575473.187039:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788575473.187061:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575473.826937:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575474.211031:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575474.211031:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575474.211031:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575474.211042:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575474.211077:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575474.211124:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575474.850998:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575474.851026:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575474.851038:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575474.851044:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575474.851056:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3820
00000100:00080000:1.0:1788575474.851068:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575474.851076:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575474.851121:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361239808/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575474.851156:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575474.851160:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575474.851162:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575474.851167:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3820
00000100:00080000:1.0:1788575474.851171:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575474.851176:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575474.851189:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575474.851204:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361239936/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575474.851213:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575474.851216:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575474.851218:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575474.851222:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3820
00000100:00080000:1.0:1788575474.851225:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575474.851232:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575474.851234:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361239808:192.168.202.140@tcp:250:kworker.0
00000008:00100000:1.0:1788575474.851239:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575474.851253:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361240064/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575474.851268:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575474.851271:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575474.851273:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575474.851276:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3820
00000100:00080000:1.0:1788575474.851280:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575474.851282:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575474.851286:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575474.851300:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361240192/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575474.851311:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575474.851315:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575474.851317:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1788575474.851322:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788575474.851324:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3820
00000100:00080000:1.0:1788575474.851331:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575474.851346:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575474.851351:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575474.851363:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361240320/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575474.851370:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575474.851373:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575474.851375:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575474.851379:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3820
00000100:00080000:1.0:1788575474.851384:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788575474.851385:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575474/real 1788575474]  req@ffff8dc005dc3b80 x1875453361239808/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575499 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575474.851391:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575474.851397:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575474.851410:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361240448/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575474.851418:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361239808/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575499 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575474.851419:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575474.851426:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575474.851429:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575474.851436:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3820
00000100:00080000:1.0:1788575474.851442:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575474.851445:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:0.0:1788575474.851448:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:1.0:1788575474.851449:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1788575474.851458:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575474.851464:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361240576/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575474.851468:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361239808:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788575474.851485:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361239936:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575474.851514:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575474.851528:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575474/real 1788575474]  req@ffff8dc005dc0a80 x1875453361239936/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575499 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575474.851543:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361239936/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575499 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575474.851562:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575474.851566:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575474.851570:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361239936:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575474.851599:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361240064:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575474.851617:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575474.851625:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575474/real 1788575474]  req@ffff8dc005dc1c00 x1875453361240064/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575499 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575474.851633:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361240064/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575499 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575474.851639:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575474.851642:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575474.851644:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361240064:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575474.851647:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361240192:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575474.851657:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575474.851663:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575474/real 1788575474]  req@ffff8dc005dc0700 x1875453361240192/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575499 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575474.851671:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361240192/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575499 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575474.851676:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575474.851678:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575474.851681:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361240192:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575474.851685:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361240320:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575474.851696:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575474.851702:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575474/real 1788575474]  req@ffff8dc005dc2d80 x1875453361240320/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575499 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575474.851709:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361240320/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575499 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575474.851715:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575474.851717:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575474.851718:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361240320:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575474.851722:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361240448:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575474.851732:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575474.851738:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575474/real 1788575474]  req@ffff8dc005dc3800 x1875453361240448/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575499 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575474.851745:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361240448/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575499 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575474.851750:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575474.851752:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575474.851754:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361240448:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575474.851757:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361240576:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575474.851768:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575474.851784:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575474/real 1788575474]  req@ffff8dc005dc1500 x1875453361240576/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575499 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575474.851792:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361240576/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575499 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575474.851797:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575474.851799:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575474.851802:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361240576:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575475.234973:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575475.235015:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575475.235018:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575475.235039:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788575475.235062:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575475.235075:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575475.874991:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575476.259015:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575476.259018:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575476.259032:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575476.259054:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575476.259056:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575476.259067:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575476.899073:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575477.282967:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575477.282967:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575477.282974:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788575477.282999:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575477.283002:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575477.283018:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575477.922985:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575478.307017:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575478.307017:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575478.307025:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575478.307025:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575478.307051:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575478.307089:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575478.946979:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575479.331030:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575479.331052:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575479.331063:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575479.331087:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575479.331092:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788575479.331151:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575479.971039:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575479.971039:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575479.971053:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575479.971059:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575479.971073:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3825
00000100:00080000:1.0:1788575479.971087:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575479.971099:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575479.971167:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361240704/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575479.971206:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575479.971210:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575479.971213:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575479.971218:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3825
00000100:00080000:1.0:1788575479.971223:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575479.971229:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575479.971237:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361240704:192.168.202.140@tcp:250:kworker.0
00000008:00100000:1.0:1788575479.971242:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575479.971265:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361240832/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575479.971277:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575479.971281:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575479.971283:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575479.971288:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3825
00000100:00080000:1.0:1788575479.971301:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575479.971306:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:0.0:1788575479.971311:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:1.0:1788575479.971313:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575479.971330:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361240960/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575479.971347:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575479.971351:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575479.971353:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788575479.971358:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575479/real 1788575479]  req@ffff8dc005dc1180 x1875453361240704/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575504 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575479.971361:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3825
00000100:00080000:1.0:1788575479.971370:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575479.971377:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575479.971382:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361240704/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575504 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1788575479.971384:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1788575479.971399:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575479.971403:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575479.971407:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361241088/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575479.971409:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361240704:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788575479.971424:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575479.971429:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575479.971431:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575479.971438:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3825
00000100:00100000:0.0:1788575479.971439:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361240832:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788575479.971446:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575479.971453:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575479.971459:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788575479.971467:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575479.971476:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361241216/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575479.971487:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575479/real 1788575479]  req@ffff8dc005dc1500 x1875453361240832/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575504 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575479.971491:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575479.971499:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575479.971502:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575479.971511:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3825
00000100:00100000:0.0:1788575479.971515:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361240832/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575504 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575479.971518:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575479.971528:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:0.0:1788575479.971530:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:1.0:1788575479.971535:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1788575479.971543:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575479.971547:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361240832:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788575479.971552:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361241344/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575479.971557:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361240960:192.168.202.140@tcp:8:kworker.0
00000100:00080000:1.0:1788575479.971572:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575479.971577:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575479.971579:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1788575479.971586:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788575479.971587:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3825
00000100:00080000:1.0:1788575479.971595:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575479.971601:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575479.971603:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575479/real 1788575479]  req@ffff8dc005dc3800 x1875453361240960/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575504 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1788575479.971609:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575479.971616:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361240960/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575504 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575479.971624:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1788575479.971629:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361241472/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575479.971630:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575479.971636:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361240960:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575479.971648:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361241088:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575479.971666:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575479.971676:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575479/real 1788575479]  req@ffff8dc005dc2d80 x1875453361241088/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575504 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575479.971683:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361241088/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575504 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575479.971690:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575479.971692:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575479.971694:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361241088:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575479.971706:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361241216:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575479.971724:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575479.971731:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575479/real 1788575479]  req@ffff8dc005dc0700 x1875453361241216/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575504 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575479.971739:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361241216/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575504 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575479.971745:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575479.971748:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575479.971750:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361241216:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575479.971753:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361241344:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575479.971764:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575479.971769:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575479/real 1788575479]  req@ffff8dc005dc1c00 x1875453361241344/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575504 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575479.971777:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361241344/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575504 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575479.971783:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575479.971784:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575479.971786:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361241344:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575479.971789:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361241472:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575479.971800:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575479.971805:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575479/real 1788575479]  req@ffff8dc005dc0a80 x1875453361241472/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575504 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575479.971813:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361241472/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575504 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575479.971818:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575479.971820:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575479.971822:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361241472:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575480.355029:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575480.355055:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575480.355055:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575480.355058:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575480.355073:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575480.355090:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575480.994946:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575481.379000:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575481.379008:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575481.379008:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575481.379009:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575481.379052:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788575481.379147:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575482.018973:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575482.402990:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575482.402990:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575482.402990:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575482.403028:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575482.403046:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575482.403116:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575483.042976:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575483.426988:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575483.426998:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575483.427021:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575483.427154:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575483.427177:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788575483.427213:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575484.067019:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575484.451000:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575484.451000:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575484.451006:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575484.451038:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575484.451050:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575484.451058:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575485.090937:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575485.090970:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575485.090979:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575485.090984:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575485.090995:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3830
00000100:00080000:1.0:1788575485.091006:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575485.091016:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575485.091063:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361241600/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575485.091097:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575485.091102:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575485.091105:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575485.091111:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3830
00000100:00080000:1.0:1788575485.091117:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575485.091122:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575485.091140:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361241600:192.168.202.140@tcp:250:kworker.0
00000008:00100000:1.0:1788575485.091145:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575485.091168:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361241728/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575485.091181:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575485.091185:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575485.091189:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575485.091194:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3830
00000100:00080000:1.0:1788575485.091199:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575485.091203:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575485.091210:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575485.091224:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361241856/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575485.091241:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575485.091245:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575485.091247:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575485.091251:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3830
00000100:00080000:1.0:1788575485.091255:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575485.091259:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575485.091264:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575485.091275:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361241984/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575485.091282:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575485.091286:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575485.091288:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575485.091292:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3830
00000100:00080000:1.0:1788575485.091295:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575485.091299:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575485.091308:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575485.091322:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361242112/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575485.091329:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361241728:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788575485.091334:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575485.091339:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575485.091341:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575485.091347:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3830
00000100:00080000:1.0:1788575485.091352:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575485.091357:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575485.091359:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361241856:192.168.202.140@tcp:8:kworker.0
00000008:00100000:1.0:1788575485.091364:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575485.091382:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361242240/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575485.091389:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361241984:192.168.202.140@tcp:8:kworker.0
00000100:00080000:1.0:1788575485.091395:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575485.091399:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575485.091401:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575485.091406:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3830
00000100:00080000:1.0:1788575485.091409:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575485.091413:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575485.091418:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575485.091430:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361242368/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575485.091544:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361242112:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575485.091572:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361242240:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575485.091593:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361242368:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575485.474946:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575485.474951:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575485.474956:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575485.474960:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575485.474980:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788575485.475061:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575486.115197:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575486.499014:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575486.499014:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575486.499028:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575486.499057:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575486.499079:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788575486.499087:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575487.139022:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575487.523001:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575487.523001:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575487.523017:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575487.523022:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575487.523054:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788575487.523095:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575488.163097:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000400:00000100:1.0:1788575488.163196:0:2335:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.140:988
00000400:00000100:1.0:1788575488.163255:0:2335:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.140@tcp at host 192.168.202.140 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:1.0:1788575488.163271:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788575488.163308:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788575488.163317:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788575488.163326:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788575488.163335:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788575488.163344:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:3.0:1788575488.163352:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575485/real 1788575488]  req@ffff8dc005dc2d80 x1875453361242112/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575510 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:1.0:1788575488.163353:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:3.0:1788575488.163378:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361242112/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575510 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575488.163391:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575488.163396:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575488.163400:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361242112:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575488.163407:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575485/real 1788575488]  req@ffff8dc005dc3800 x1875453361242240/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575510 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575488.163421:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361242240/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575510 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575488.163429:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575488.163433:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575488.163436:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361242240:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575488.163440:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575485/real 1788575488]  req@ffff8dc005dc1500 x1875453361242368/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575510 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575488.163448:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361242368/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575510 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575488.163455:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575488.163458:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575488.163461:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361242368:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575488.163468:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575485/real 1788575488]  req@ffff8dc005dc0a80 x1875453361241728/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575510 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575488.163480:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361241728/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575510 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575488.163489:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575488.163493:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575488.163496:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361241728:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575488.163502:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575485/real 1788575488]  req@ffff8dc005dc1c00 x1875453361241856/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575510 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575488.163514:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361241856/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575510 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575488.163521:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575488.163524:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575488.163527:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361241856:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575488.163533:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575485/real 1788575488]  req@ffff8dc005dc0700 x1875453361241984/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575510 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575488.163549:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361241984/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575510 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575488.163558:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575488.163561:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575488.163564:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361241984:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575488.163571:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575485/real 1788575488]  req@ffff8dc005dc3b80 x1875453361241600/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575510 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575488.163582:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361241600/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575510 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575488.163589:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575488.163593:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575488.163596:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361241600:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788575488.546963:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575488.546977:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575488.546997:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575488.547013:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575488.547077:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575488.547121:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575489.187042:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575489.570993:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575489.571009:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575489.571025:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788575489.571035:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575489.571088:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575489.571108:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575490.210996:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575490.211025:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575490.211030:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788575490.211034:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575490.211043:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3835
00000100:00080000:0.0:1788575490.211052:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575490.211059:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575490.211084:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361242496/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575490.211104:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575490.211106:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575490.211108:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575490.211110:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3835
00000100:00080000:0.0:1788575490.211112:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575490.211115:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575490.211123:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575490.211136:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361242624/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575490.211145:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575490.211148:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575490.211150:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575490.211153:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3835
00000100:00080000:0.0:1788575490.211157:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575490.211165:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575490.211170:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361242496:192.168.202.140@tcp:250:kworker.0
00000008:00100000:0.0:1788575490.211171:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575490.211186:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361242752/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575490.211196:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575490.211199:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575490.211201:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575490.211205:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3835
00000100:00080000:0.0:1788575490.211209:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575490.211212:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575490.211217:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575490.211228:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361242880/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575490.211235:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1788575490.211241:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788575490.211242:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575490.211246:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575490.211253:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3835
00000100:00080000:0.0:1788575490.211257:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575490.211262:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575490.211267:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575490.211295:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361243008/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575490.211304:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575490/real 1788575490]  req@ffff8dc006711500 x1875453361242496/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575515 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575490.211305:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575490.211313:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575490.211318:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575490.211326:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3835
00000100:00080000:0.0:1788575490.211329:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575490.211334:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575490.211338:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361242496/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575515 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1788575490.211341:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788575490.211354:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575490.211359:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575490.211360:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361243136/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575490.211363:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361242496:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788575490.211374:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361242624:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788575490.211378:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575490.211383:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575490.211384:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575490.211390:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3835
00000100:00080000:0.0:1788575490.211394:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575490.211398:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575490.211403:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788575490.211405:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575490.211418:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361243264/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575490.211424:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575490/real 1788575490]  req@ffff8dc006712a00 x1875453361242624/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575515 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575490.211447:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361242624/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575515 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575490.211458:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575490.211462:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575490.211467:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361242624:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575490.211496:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361242752:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575490.211519:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575490.211530:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575490/real 1788575490]  req@ffff8dc006710e00 x1875453361242752/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575515 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575490.211549:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361242752/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575515 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575490.211557:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575490.211560:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575490.211563:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361242752:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575490.211569:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361242880:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575490.211588:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575490.211599:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575490/real 1788575490]  req@ffff8dc006713100 x1875453361242880/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575515 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575490.211610:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361242880/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575515 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575490.211619:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575490.211622:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575490.211625:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361242880:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575490.211631:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361243008:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575490.212104:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575490.212126:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575490/real 1788575490]  req@ffff8dc006711880 x1875453361243008/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575515 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575490.212138:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361243008/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575515 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575490.212146:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575490.212149:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575490.212152:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361243008:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575490.212160:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361243136:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575490.212189:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575490.212200:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575490/real 1788575490]  req@ffff8dc006713b80 x1875453361243136/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575515 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575490.212212:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361243136/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575515 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575490.212219:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575490.212222:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575490.212225:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361243136:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575490.212232:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361243264:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575490.212249:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575490.212259:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575490/real 1788575490]  req@ffff8dc006712680 x1875453361243264/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575515 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575490.212268:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361243264/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575515 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575490.212291:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575490.212293:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575490.212296:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361243264:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575490.594961:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575490.594961:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575490.594961:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575490.594972:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575490.594998:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575490.595050:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575491.234976:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575491.618972:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575491.618972:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575491.618972:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575491.619013:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575491.619022:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575491.619023:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575492.259003:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575492.642967:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575492.642967:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575492.642972:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575492.642996:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575492.643011:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575492.643016:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575493.282936:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575493.666977:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575493.666977:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575493.666977:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575493.667005:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575493.667008:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575493.667014:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575494.306996:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575494.690970:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575494.690970:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575494.690998:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575494.691037:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575494.691039:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575494.691087:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00080000:0.0:1788575495.330954:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788575495.330954:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575495.330964:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788575495.330968:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575495.330976:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3840
00000100:00080000:0.0:1788575495.330986:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575495.330993:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575495.331026:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361243392/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575495.331053:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575495.331056:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575495.331058:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575495.331062:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3840
00000100:00080000:0.0:1788575495.331065:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575495.331069:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575495.331084:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575495.331095:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361243392:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788575495.331099:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361243520/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575495.331111:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575495.331114:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575495.331117:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575495.331120:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3840
00000100:00080000:0.0:1788575495.331124:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575495.331127:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575495.331133:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575495.331142:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453361243648/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575495.331157:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575495.331160:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575495.331162:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1788575495.331166:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788575495.331170:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3840
00000100:00080000:0.0:1788575495.331175:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575495.331178:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575495.331184:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575495.331195:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361243776/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575495.331204:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575495.331207:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575495.331209:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575495.331212:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3840
00000100:00080000:0.0:1788575495.331216:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788575495.331218:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575495/real 1788575495]  req@ffff8dc006713480 x1875453361243392/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575520 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575495.331222:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575495.331230:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575495.331242:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361243392/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575520 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575495.331244:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361243904/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575495.331258:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575495.331262:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575495.331266:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575495.331268:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788575495.331269:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788575495.331274:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361243392:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788575495.331277:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3840
00000100:00080000:0.0:1788575495.331282:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575495.331286:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575495.331289:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575495.331297:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361243520:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575495.331303:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361244032/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575495.331314:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575495.331318:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000800:00000100:3.0:1788575495.331320:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788575495.331321:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575495.331327:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3840
00000100:00080000:0.0:1788575495.331332:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788575495.331334:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575495/real 1788575495]  req@ffff8dc006711c00 x1875453361243520/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575520 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575495.331338:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575495.331349:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361243520/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575520 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1788575495.331352:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788575495.331368:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1788575495.331369:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361244160/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575495.331373:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575495.331381:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361243520:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575495.331392:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361243648:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575495.331415:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575495.331437:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575495/real 1788575495]  req@ffff8dc006710380 x1875453361243648/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575520 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575495.331450:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453361243648/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575520 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575495.331458:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575495.331462:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575495.331465:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361243648:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575495.331472:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361243776:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575495.331492:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575495.331503:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575495/real 1788575495]  req@ffff8dc006712300 x1875453361243776/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575520 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575495.331514:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361243776/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575520 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575495.331527:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575495.331530:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575495.331533:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361243776:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575495.331539:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361243904:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575495.331553:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575495.331560:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575495/real 1788575495]  req@ffff8dc006713800 x1875453361243904/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575520 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575495.331567:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361243904/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575520 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575495.331573:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575495.331574:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575495.331576:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361243904:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575495.331589:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361244032:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575495.331606:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575495.331616:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575495/real 1788575495]  req@ffff8dc006713480 x1875453361244032/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575520 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575495.331627:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361244032/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575520 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575495.331635:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575495.331638:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575495.331640:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361244032:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575495.331644:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361244160:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575495.331657:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575495.331664:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575495/real 1788575495]  req@ffff8dc006712680 x1875453361244160/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575520 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575495.331670:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361244160/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575520 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575495.331675:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575495.331677:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575495.331679:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361244160:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575495.714963:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575495.714975:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575495.714976:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575495.714989:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575495.714999:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575495.715061:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575496.354962:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575496.738951:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575496.738951:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575496.738995:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575496.739054:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575496.739067:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575496.739070:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575497.378924:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575497.762981:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575497.762981:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575497.762981:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575497.763001:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575497.763012:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575497.763134:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575498.402950:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575498.786974:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575498.786974:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575498.786974:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575498.786974:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575498.787006:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575498.787033:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575499.426965:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575499.810976:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575499.810976:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575499.810977:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575499.810977:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575499.811007:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575499.811036:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575500.450939:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575500.450964:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575500.450969:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575500.450972:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575500.450979:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3846
00000100:00080000:1.0:1788575500.450986:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575500.450992:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575500.451019:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361244288/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575500.451035:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575500.451038:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575500.451039:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575500.451042:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3846
00000100:00080000:1.0:1788575500.451044:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575500.451046:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575500.451052:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575500.451062:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361244416/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575500.451072:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575500.451075:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575500.451077:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788575500.451083:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361244288:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788575500.451084:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3846
00000100:00080000:1.0:1788575500.451091:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575500.451096:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575500.451101:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575500.451113:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361244544/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575500.451120:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575500.451123:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575500.451124:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575500.451126:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3846
00000100:00080000:1.0:1788575500.451129:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575500.451131:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575500.451135:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575500.451142:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361244672/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788575500.451147:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788575500.451159:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575500.451162:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575500.451165:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575500.451170:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3846
00000100:00080000:1.0:1788575500.451173:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575500.451177:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575500.451183:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575500.451190:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575500/real 1788575500]  req@ffff8dc005dc1180 x1875453361244288/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575525 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575500.451198:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361244800/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575500.451207:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575500.451211:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575500.451213:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575500.451221:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3846
00000100:00080000:1.0:1788575500.451229:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575500.451234:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575500.451239:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575500.451239:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361244288/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575525 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575500.451254:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1788575500.451257:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361244928/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575500.451261:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575500.451268:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361244288:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788575500.451274:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575500.451279:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:3.0:1788575500.451280:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361244416:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788575500.451283:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575500.451290:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3846
00000100:00080000:1.0:1788575500.451293:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575500.451295:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575500.451300:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788575500.451307:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575500.451316:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361245056/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575500.451322:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575500/real 1788575500]  req@ffff8dc005dc3b80 x1875453361244416/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575525 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575500.451337:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361244416/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575525 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575500.451347:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575500.451350:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575500.451353:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361244416:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575500.451373:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361244544:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575500.451390:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575500.451399:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575500/real 1788575500]  req@ffff8dc005dc0700 x1875453361244544/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575525 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575500.451410:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361244544/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575525 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575500.451424:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575500.451427:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575500.451430:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361244544:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575500.451435:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361244672:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575500.451448:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575500.451457:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575500/real 1788575500]  req@ffff8dc005dc1c00 x1875453361244672/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575525 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575500.451467:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361244672/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575525 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575500.451476:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575500.451478:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575500.451481:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361244672:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575500.451487:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361244800:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575500.451501:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575500.451509:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575500/real 1788575500]  req@ffff8dc005dc0a80 x1875453361244800/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575525 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575500.451520:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361244800/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575525 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575500.451528:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575500.451531:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575500.451534:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361244800:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575500.451539:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361244928:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575500.451553:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575500.451561:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575500/real 1788575500]  req@ffff8dc005dc1500 x1875453361244928/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575525 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575500.451583:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361244928/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575525 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575500.451592:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575500.451594:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575500.451597:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361244928:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575500.451603:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361245056:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575500.451619:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575500.451628:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575500/real 1788575500]  req@ffff8dc005dc3800 x1875453361245056/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575525 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575500.451639:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361245056/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575525 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575500.451646:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575500.451649:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575500.451651:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361245056:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575500.834935:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575500.834935:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575500.834944:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575500.834961:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575500.834980:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575500.835014:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575501.474982:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575501.858964:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575501.858969:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575501.858970:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575501.858973:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575501.858998:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575501.859030:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575502.498935:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575502.882950:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575502.882950:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575502.883002:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575502.883729:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575502.883743:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575502.883753:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575503.522995:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575503.907015:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575503.907015:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575503.907015:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575503.907016:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575503.907064:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575503.907137:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575504.546974:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575504.930969:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575504.930970:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575504.930970:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575504.930972:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575504.931003:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575504.931036:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1788575505.570975:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788575505.570978:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575505.570984:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575505.570988:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575505.570995:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3851
00000100:00080000:1.0:1788575505.571004:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575505.571009:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575505.571055:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361245184/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575505.571078:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575505.571080:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575505.571082:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575505.571084:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3851
00000100:00080000:1.0:1788575505.571087:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575505.571090:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575505.571097:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575505.571107:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361245312/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575505.571113:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575505.571115:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575505.571116:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575505.571120:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3851
00000100:00080000:1.0:1788575505.571123:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575505.571127:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575505.571132:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575505.571143:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361245440/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575505.571149:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361245184:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788575505.571158:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575505.571163:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575505.571164:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575505.571168:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3851
00000100:00080000:1.0:1788575505.571171:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575505.571174:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575505.571185:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575505.571195:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361245568/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575505.571201:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575505.571204:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575505.571206:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575505.571208:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3851
00000100:00080000:1.0:1788575505.571210:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575505.571214:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575505.571219:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788575505.571219:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575505.571232:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361245696/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575505.571242:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575505.571245:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575505.571247:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575505.571252:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3851
00000100:00080000:1.0:1788575505.571256:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575505.571260:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575505.571264:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575505/real 1788575505]  req@ffff8dc005dc2d80 x1875453361245184/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575530 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1788575505.571265:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575505.571288:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361245184/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575530 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575505.571294:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361245824/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575505.571300:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575505.571309:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575505.571310:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788575505.571316:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:3.0:1788575505.571319:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361245184:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788575505.571320:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575505.571329:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3851
00000100:00100000:3.0:1788575505.571333:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361245312:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788575505.571334:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575505.571341:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575505.571348:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575505.571361:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361245952/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788575505.571367:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575505.571387:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575505/real 1788575505]  req@ffff8dc005dc3800 x1875453361245312/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575530 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575505.571401:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361245312/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575530 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575505.571410:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575505.571413:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575505.571417:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361245312:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575505.571439:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361245440:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575505.571472:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575505.571485:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575505/real 1788575505]  req@ffff8dc005dc1500 x1875453361245440/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575530 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575505.571496:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361245440/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575530 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575505.571504:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575505.571507:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575505.571510:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361245440:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575505.571516:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361245568:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575505.571536:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575505.571547:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575505/real 1788575505]  req@ffff8dc005dc0a80 x1875453361245568/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575530 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575505.571559:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361245568/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575530 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575505.571567:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575505.571571:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575505.571574:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361245568:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575505.571579:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361245696:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575505.571597:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575505.571608:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575505/real 1788575505]  req@ffff8dc005dc1c00 x1875453361245696/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575530 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575505.571619:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361245696/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575530 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575505.571627:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575505.571630:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575505.571633:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361245696:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575505.571639:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361245824:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575505.571657:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575505.571667:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575505/real 1788575505]  req@ffff8dc005dc0700 x1875453361245824/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575530 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575505.571677:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361245824/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575530 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575505.571684:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575505.571687:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575505.571690:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361245824:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575505.571709:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361245952:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575505.571758:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575505.571768:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575505/real 1788575505]  req@ffff8dc005dc3b80 x1875453361245952/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575530 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575505.571779:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361245952/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575530 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575505.571787:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575505.571789:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575505.571793:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361245952:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575505.954964:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575505.954966:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575505.954967:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575505.954968:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575505.954997:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575505.955031:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575506.595001:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575506.978976:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575506.978981:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575506.979005:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575506.979105:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575506.979116:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575506.979123:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575507.618975:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575508.003009:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575508.003014:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575508.003025:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575508.003054:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575508.003057:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575508.003116:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575508.642990:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575509.027005:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575509.027013:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575509.027014:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575509.027046:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575509.027046:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575509.027047:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575509.666992:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575510.050955:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575510.050976:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575510.050981:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575510.051016:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575510.051043:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575510.051080:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1788575510.691010:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575510.691019:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575510.691023:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788575510.691033:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575510.691034:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3856
00000100:00080000:1.0:1788575510.691047:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575510.691054:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575510.691102:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361246080/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575510.691135:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575510.691138:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575510.691139:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575510.691142:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3856
00000100:00080000:1.0:1788575510.691145:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575510.691149:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575510.691162:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575510.691179:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361246208/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575510.691183:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361246080:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788575510.691198:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575510.691202:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575510.691204:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575510.691208:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3856
00000100:00080000:1.0:1788575510.691212:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575510.691216:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575510.691222:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575510.691235:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361246336/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575510.691245:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575510.691249:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575510.691251:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1788575510.691255:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788575510.691258:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3856
00000100:00080000:1.0:1788575510.691262:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575510.691265:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575510.691270:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575510.691279:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361246464/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575510.691285:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575510.691287:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575510.691289:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575510.691292:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3856
00000100:00080000:1.0:1788575510.691295:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575510.691298:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575510.691302:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575510/real 1788575510]  req@ffff8dc005dc1180 x1875453361246080/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575535 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1788575510.691303:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575510.691315:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361246592/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575510.691321:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788575510.691323:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361246080/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575535 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575510.691324:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575510.691327:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575510.691335:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3856
00000100:00080000:1.0:1788575510.691338:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575510.691340:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:3.0:1788575510.691340:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:1.0:1788575510.691347:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788575510.691348:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575510.691354:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361246080:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788575510.691358:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361246720/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575510.691368:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575510.691372:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575510.691373:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788575510.691379:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361246208:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788575510.691380:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3856
00000100:00080000:1.0:1788575510.691387:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575510.691391:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575510.691397:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788575510.691400:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575510.691412:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361246848/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575510.691413:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575510/real 1788575510]  req@ffff8dc005dc3b80 x1875453361246208/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575535 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575510.691445:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361246208/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575535 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575510.691453:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575510.691455:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575510.691457:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361246208:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575510.691461:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361246336:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575510.691473:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575510.691479:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575510/real 1788575510]  req@ffff8dc005dc0700 x1875453361246336/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575535 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575510.691486:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361246336/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575535 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575510.691491:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575510.691493:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575510.691494:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361246336:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575510.691497:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361246464:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575510.691507:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575510.691513:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575510/real 1788575510]  req@ffff8dc005dc1c00 x1875453361246464/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575535 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575510.691519:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361246464/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575535 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575510.691529:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575510.691530:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575510.691532:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361246464:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575510.691535:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361246592:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575510.691544:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575510.691549:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575510/real 1788575510]  req@ffff8dc005dc0a80 x1875453361246592/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575535 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575510.691559:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361246592/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575535 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575510.691568:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575510.691570:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575510.691573:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361246592:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575510.691579:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361246720:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575510.691596:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575510.691606:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575510/real 1788575510]  req@ffff8dc005dc1500 x1875453361246720/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575535 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575510.691618:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361246720/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575535 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575510.691625:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575510.691628:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575510.691632:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361246720:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575510.691651:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361246848:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575510.691666:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575510.691675:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575510/real 1788575510]  req@ffff8dc005dc3800 x1875453361246848/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575535 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575510.691686:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361246848/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575535 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575510.691693:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575510.691696:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575510.691708:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361246848:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575511.074996:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575511.074996:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575511.074996:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575511.075026:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575511.075028:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575511.075042:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575511.714997:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575512.098970:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575512.098972:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575512.098976:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575512.098998:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575512.099005:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575512.099006:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575512.738953:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575513.123008:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575513.123008:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575513.123011:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575513.123019:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575513.123045:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575513.123054:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575513.762998:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575514.147027:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575514.147028:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575514.147029:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575514.147042:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575514.147098:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575514.147162:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575514.787030:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575515.170966:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575515.170982:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575515.171005:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575515.171032:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575515.171059:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575515.171070:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575515.810967:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575515.810970:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575515.810982:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575515.810988:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575515.811002:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3861
00000100:00080000:1.0:1788575515.811040:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575515.811050:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575515.811097:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361246976/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575515.811130:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575515.811134:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575515.811136:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575515.811141:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3861
00000100:00080000:1.0:1788575515.811145:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575515.811151:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575515.811169:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575515.811176:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361246976:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788575515.811190:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361247104/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575515.811205:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575515.811208:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575515.811209:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575515.811213:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3861
00000100:00080000:1.0:1788575515.811219:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575515.811228:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575515.811236:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788575515.811240:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575515.811259:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361247232/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575515.811272:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575515.811276:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575515.811280:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788575515.811285:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575515/real 1788575515]  req@ffff8dc005dc2d80 x1875453361246976/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575540 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575515.811291:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3861
00000100:00080000:1.0:1788575515.811303:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575515.811309:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575515.811311:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361246976/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575540 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575515.811326:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:1.0:1788575515.811329:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788575515.811331:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575515.811338:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361246976:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788575515.811352:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361247360/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575515.811366:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788575515.811369:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361247104:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788575515.811372:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575515.811376:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575515.811384:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3861
00000100:00080000:1.0:1788575515.811390:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575515.811396:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575515.811403:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788575515.811404:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575515.811428:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575515/real 1788575515]  req@ffff8dc005dc3800 x1875453361247104/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575540 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575515.811429:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361247488/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575515.811473:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575515.811478:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575515.811481:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788575515.811483:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361247104/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575540 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575515.811491:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3861
00000100:00080000:1.0:1788575515.811503:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575515.811512:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:3.0:1788575515.811512:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575515.811526:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000008:00100000:1.0:1788575515.811527:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575515.811536:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361247104:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575515.811552:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361247232:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575515.811553:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361247616/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575515.811572:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575515.811576:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575515.811578:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575515.811592:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3861
00000800:00000100:3.0:1788575515.811597:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788575515.811599:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575515.811606:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575515.811612:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575515.811616:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575515/real 1788575515]  req@ffff8dc005dc1500 x1875453361247232/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575540 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575515.811630:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361247744/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575515.811642:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361247232/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575540 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575515.811662:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575515.811667:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575515.811671:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361247232:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575515.811693:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361247360:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575515.811713:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575515.811723:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575515/real 1788575515]  req@ffff8dc005dc0a80 x1875453361247360/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575540 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575515.811730:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361247360/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575540 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575515.811736:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575515.811738:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575515.811740:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361247360:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575515.811744:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361247488:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575515.811755:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575515.811763:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575515/real 1788575515]  req@ffff8dc005dc1c00 x1875453361247488/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575540 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575515.811774:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361247488/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575540 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575515.811782:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575515.811785:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575515.811788:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361247488:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575515.811793:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361247616:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575515.811811:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575515.811820:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575515/real 1788575515]  req@ffff8dc005dc0700 x1875453361247616/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575540 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575515.811831:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361247616/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575540 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575515.811838:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575515.811841:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575515.811843:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361247616:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575515.811849:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361247744:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575515.811895:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575515.811906:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575515/real 1788575515]  req@ffff8dc005dc3b80 x1875453361247744/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575540 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575515.811918:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361247744/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575540 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575515.811925:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575515.811928:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575515.811931:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361247744:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575516.194986:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575516.194999:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575516.195045:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575516.195131:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575516.195146:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575516.195173:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575516.834972:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575517.218970:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575517.218971:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575517.218996:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575517.219002:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575517.219004:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575517.219015:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575517.858952:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575518.242951:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575518.242951:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575518.242964:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575518.242975:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575518.242979:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575518.242985:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575518.882980:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575519.266961:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575519.266963:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575519.266964:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575519.266989:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575519.266991:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575519.266993:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575519.906997:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575520.290980:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575520.290980:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575520.291005:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575520.291078:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575520.291101:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575520.291181:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00080000:1.0:1788575520.930985:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575520.930995:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:2.0:1788575520.930996:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575520.931000:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575520.931011:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3866
00000100:00080000:1.0:1788575520.931022:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575520.931031:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575520.931065:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361247872/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575520.931085:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575520.931088:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575520.931089:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575520.931091:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3866
00000100:00080000:1.0:1788575520.931094:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575520.931097:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575520.931105:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575520.931114:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361248000/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575520.931120:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575520.931123:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575520.931124:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575520.931126:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3866
00000100:00080000:1.0:1788575520.931128:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575520.931130:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575520.931134:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575520.931135:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361247872:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788575520.931143:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361248128/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575520.931149:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575520.931151:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575520.931153:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575520.931154:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3866
00000100:00080000:1.0:1788575520.931167:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575520.931170:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575520.931174:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575520.931185:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361248256/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575520.931194:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575520.931198:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575520.931199:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575520.931203:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3866
00000100:00080000:1.0:1788575520.931207:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1788575520.931209:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788575520.931214:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575520.931219:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575520.931232:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361248384/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575520.931241:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575520.931244:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575520.931246:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575520.931253:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3866
00000100:00100000:3.0:1788575520.931255:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575520/real 1788575520]  req@ffff8dc005dc1180 x1875453361247872/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575545 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575520.931257:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575520.931263:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575520.931268:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575520.931281:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361248512/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575520.931289:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575520.931292:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575520.931295:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788575520.931295:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361247872/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575545 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575520.931305:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3866
00000100:00080000:3.0:1788575520.931308:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575520.931310:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575520.931313:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788575520.931318:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575520.931319:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361247872:192.168.202.140@tcp:250:kworker.0
00000008:00100000:1.0:1788575520.931329:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575520.931329:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361248000:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788575520.931345:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361248640/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788575520.931354:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575520.931365:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575520/real 1788575520]  req@ffff8dc005dc3b80 x1875453361248000/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575545 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575520.931375:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361248000/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575545 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575520.931382:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575520.931384:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575520.931386:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361248000:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575520.931404:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361248128:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575520.931428:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575520.931437:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575520/real 1788575520]  req@ffff8dc005dc0700 x1875453361248128/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575545 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575520.931445:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361248128/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575545 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575520.931460:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575520.931462:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575520.931465:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361248128:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575520.931470:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361248256:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575520.931495:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575520.931511:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575520/real 1788575520]  req@ffff8dc005dc1c00 x1875453361248256/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575545 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575520.931523:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361248256/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575545 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575520.931530:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575520.931532:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575520.931536:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361248256:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575520.931540:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361248384:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575520.931560:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575520.931571:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575520/real 1788575520]  req@ffff8dc005dc0a80 x1875453361248384/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575545 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575520.931581:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361248384/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575545 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575520.931586:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575520.931588:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575520.931591:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361248384:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575520.931643:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361248512:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575520.931661:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575520.931671:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575520/real 1788575520]  req@ffff8dc005dc1500 x1875453361248512/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575545 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575520.931690:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361248512/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575545 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575520.931804:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575520.931808:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575520.931810:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361248512:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575520.931816:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361248640:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575520.931840:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575520.931855:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575520/real 1788575520]  req@ffff8dc005dc3800 x1875453361248640/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575545 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575520.931902:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361248640/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575545 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575520.931908:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575520.931911:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575520.931914:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361248640:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575521.314982:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575521.314988:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575521.315000:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575521.315018:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575521.315020:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575521.315023:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575521.954979:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575522.338935:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575522.338937:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575522.338940:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575522.338948:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575522.338967:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575522.338993:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575522.978979:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575523.362962:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575523.362962:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575523.362962:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575523.362963:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575523.362994:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575523.363019:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575524.002945:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575524.386924:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575524.386935:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575524.386955:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575524.386968:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575524.386978:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575524.386993:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575525.026960:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575525.410950:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575525.410958:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575525.410959:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575525.410976:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575525.410977:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575525.410983:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575526.050988:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788575526.050996:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575526.051002:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788575526.051006:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575526.051021:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3871
00000100:00080000:3.0:1788575526.051030:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575526.051037:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575526.051073:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e680 x1875453361248768/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575526.051101:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575526.051105:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575526.051106:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575526.051110:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3871
00000100:00080000:3.0:1788575526.051113:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575526.051118:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575526.051127:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575526.051140:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361248768:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788575526.051142:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d180 x1875453361248896/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575526.051155:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575526.051158:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575526.051160:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575526.051164:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3871
00000100:00080000:3.0:1788575526.051168:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575526.051172:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575526.051177:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575526.051188:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f480 x1875453361249024/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575526.051197:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1788575526.051201:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788575526.051203:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575526.051206:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575526.051211:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3871
00000100:00080000:3.0:1788575526.051215:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575526.051219:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575526.051223:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575526.051240:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575526/real 1788575526]  req@ffff8dc00644e680 x1875453361248768/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575551 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575526.051243:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c380 x1875453361249152/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575526.051277:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575526.051280:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575526.051284:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788575526.051285:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453361248768/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575551 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575526.051291:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3871
00000100:00080000:3.0:1788575526.051298:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575526.051303:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:0.0:1788575526.051308:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:3.0:1788575526.051310:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1788575526.051317:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575526.051325:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361248768:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788575526.051325:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d500 x1875453361249280/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575526.051337:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575526.051341:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575526.051342:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788575526.051348:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361248896:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788575526.051349:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3871
00000100:00080000:3.0:1788575526.051356:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575526.051362:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575526.051366:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788575526.051372:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575526.051380:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ea00 x1875453361249408/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575526.051384:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575526/real 1788575526]  req@ffff8dc00644d180 x1875453361248896/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575551 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575526.051408:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453361248896/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575551 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575526.051409:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575526.051419:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575526.051422:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575526.051424:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575526.051428:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3871
00000100:00080000:0.0:1788575526.051430:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575526.051435:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361248896:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788575526.051436:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788575526.051441:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361249024:192.168.202.140@tcp:8:kworker.0
00000100:00080000:3.0:1788575526.051444:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575526.051451:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788575526.051456:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575526.051465:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ca80 x1875453361249536/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575526.051466:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575526/real 1788575526]  req@ffff8dc00644f480 x1875453361249024/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575551 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575526.051496:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453361249024/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575551 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575526.051502:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575526.051504:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575526.051506:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361249024:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575526.051511:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361249152:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575526.051520:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575526.051525:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575526/real 1788575526]  req@ffff8dc00644c380 x1875453361249152/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575551 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575526.051531:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453361249152/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575551 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575526.051537:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575526.051538:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575526.051540:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361249152:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575526.051543:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361249280:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575526.051551:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575526.051557:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575526/real 1788575526]  req@ffff8dc00644d500 x1875453361249280/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575551 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575526.051563:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d500 x1875453361249280/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575551 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575526.051568:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575526.051569:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575526.051571:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361249280:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575526.051580:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361249408:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575526.051588:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575526.051593:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575526/real 1788575526]  req@ffff8dc00644ea00 x1875453361249408/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575551 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575526.051598:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ea00 x1875453361249408/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575551 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575526.051603:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575526.051605:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575526.051607:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361249408:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575526.051610:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361249536:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575526.051618:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575526.051622:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575526/real 1788575526]  req@ffff8dc00644ca80 x1875453361249536/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575551 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575526.051628:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ca80 x1875453361249536/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575551 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575526.051633:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575526.051634:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575526.051636:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361249536:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575526.434963:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575526.434974:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575526.435001:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575526.435003:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575526.435015:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575526.435020:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575527.074972:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575527.458948:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575527.458948:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575527.458965:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575527.459051:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575527.459056:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575527.459061:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575528.098961:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575528.482955:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575528.482955:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575528.482985:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575528.482986:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575528.482990:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575528.483002:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575529.122997:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575529.506945:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575529.506963:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575529.506968:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575529.506985:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575529.506989:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788575529.506999:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575530.147051:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575530.531038:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575530.531038:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575530.531077:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575530.531088:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575530.531094:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575530.531096:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00080000:2.0:1788575531.171004:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575531.171015:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788575531.171020:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575531.171033:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3876
00000100:00100000:3.0:1788575531.171045:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788575531.171046:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575531.171057:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575531.171103:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453361249664/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575531.171127:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575531.171130:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575531.171131:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575531.171135:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3876
00000100:00080000:2.0:1788575531.171138:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575531.171140:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575531.171151:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575531.171165:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453361249792/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575531.171175:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788575531.171180:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361249664:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788575531.171182:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575531.171188:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575531.171197:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3876
00000100:00080000:2.0:1788575531.171201:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575531.171207:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575531.171214:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575531.171229:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361249920/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575531.171237:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575531.171240:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575531.171241:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575531.171244:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3876
00000100:00080000:2.0:1788575531.171247:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575531.171250:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575531.171254:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788575531.171261:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575531.171270:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453361250048/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575531.171278:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575531.171280:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575531.171282:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575531.171285:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3876
00000100:00080000:2.0:1788575531.171287:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575531.171289:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575531.171294:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575531.171305:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453361250176/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575531.171313:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575531/real 1788575531]  req@ffff8dc020496a00 x1875453361249664/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575556 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575531.171316:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575531.171325:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575531.171330:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575531.171352:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3876
00000100:00080000:2.0:1788575531.171356:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575531.171359:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575531.171365:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575531.171371:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453361249664/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575556 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575531.171379:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361250304/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575531.171407:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575531.171411:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575531.171412:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575531.171415:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575531.171416:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3876
00000100:00080000:2.0:1788575531.171425:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575531.171434:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788575531.171434:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575531.171443:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575531.171449:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361249664:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788575531.171454:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453361250432/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575531.171482:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361249792:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575531.171511:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575531.171524:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575531/real 1788575531]  req@ffff8dc020496d80 x1875453361249792/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575556 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575531.171536:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453361249792/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575556 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575531.171546:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575531.171549:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575531.171553:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361249792:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575531.171559:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361249920:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575531.171577:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575531.171587:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575531/real 1788575531]  req@ffff8dc020494700 x1875453361249920/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575556 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575531.171599:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361249920/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575556 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575531.171609:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575531.171612:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575531.171615:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361249920:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575531.171621:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361250048:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575531.171638:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575531.171648:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575531/real 1788575531]  req@ffff8dc020494380 x1875453361250048/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575556 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575531.171659:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453361250048/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575556 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575531.171668:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575531.171671:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575531.171674:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361250048:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575531.171680:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361250176:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575531.171696:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575531.171706:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575531/real 1788575531]  req@ffff8dc020497100 x1875453361250176/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575556 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575531.171717:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453361250176/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575556 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575531.171726:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575531.171729:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575531.171732:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361250176:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575531.171739:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361250304:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575531.171757:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575531.171766:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575531/real 1788575531]  req@ffff8dc020495180 x1875453361250304/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575556 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575531.171777:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361250304/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575556 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575531.171785:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575531.171788:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575531.171792:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361250304:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575531.171798:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361250432:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575531.171815:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575531.171835:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575531/real 1788575531]  req@ffff8dc020497480 x1875453361250432/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575556 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575531.171847:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453361250432/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575556 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575531.171854:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575531.171858:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575531.171861:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361250432:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575531.554928:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575531.554939:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575531.554953:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575531.554980:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575531.555008:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575531.555020:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575532.194951:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575532.578972:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575532.578973:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575532.578995:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575532.579012:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788575532.579025:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575532.579044:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575533.218957:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575533.602996:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575533.603005:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575533.603007:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575533.603047:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575533.603048:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788575533.603065:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575534.242943:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575534.626981:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575534.626981:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575534.626983:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575534.627010:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575534.627016:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575534.627028:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575535.267022:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575535.650968:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575535.650968:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575535.650971:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788575535.651001:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575535.651008:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575535.651022:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575536.290961:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788575536.290961:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575536.290969:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788575536.290973:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575536.290981:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3881
00000100:00080000:2.0:1788575536.290988:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575536.290994:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575536.291028:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361250560/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575536.291053:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575536.291056:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575536.291057:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575536.291060:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3881
00000100:00080000:2.0:1788575536.291062:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575536.291065:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575536.291072:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575536.291082:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361250688/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575536.291091:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575536.291094:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575536.291096:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575536.291099:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3881
00000100:00080000:2.0:1788575536.291102:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575536.291106:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575536.291111:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361250560:192.168.202.140@tcp:250:kworker.0
00000008:00100000:2.0:1788575536.291113:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575536.291128:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453361250816/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575536.291139:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575536.291141:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575536.291142:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575536.291144:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3881
00000100:00080000:2.0:1788575536.291147:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575536.291150:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575536.291153:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575536.291161:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453361250944/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575536.291167:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575536.291169:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575536.291170:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575536.291173:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3881
00000100:00080000:2.0:1788575536.291175:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1788575536.291179:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788575536.291181:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575536.291185:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575536.291194:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361251072/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575536.291201:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575536.291205:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575536.291207:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575536.291211:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3881
00000100:00080000:2.0:1788575536.291214:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575536.291219:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575536.291222:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575536/real 1788575536]  req@ffff8dc020494000 x1875453361250560/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575561 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1788575536.291225:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575536.291241:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453361251200/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575536.291252:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361250560/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575561 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575536.291253:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575536.291259:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575536.291262:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575536.291268:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3881
00000100:00080000:2.0:1788575536.291271:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575536.291272:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575536.291275:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:0.0:1788575536.291280:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000008:00100000:2.0:1788575536.291280:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575536.291288:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361250560:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788575536.291293:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361251328/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575536.291299:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361250688:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575536.291322:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575536.291334:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575536/real 1788575536]  req@ffff8dc020495500 x1875453361250688/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575561 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575536.291346:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361250688/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575561 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575536.291363:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575536.291369:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575536.291371:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361250688:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575536.291391:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361250816:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575536.291412:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575536.291451:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575536/real 1788575536]  req@ffff8dc020494a80 x1875453361250816/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575561 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575536.291469:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453361250816/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575561 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575536.291481:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575536.291485:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575536.291488:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361250816:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575536.291494:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361250944:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575536.291513:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575536.291523:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575536/real 1788575536]  req@ffff8dc020494e00 x1875453361250944/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575561 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575536.291535:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453361250944/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575561 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575536.291543:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575536.291546:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575536.291548:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361250944:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575536.291554:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361251072:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575536.291571:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575536.291581:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575536/real 1788575536]  req@ffff8dc020495880 x1875453361251072/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575561 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575536.291591:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361251072/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575561 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575536.291599:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575536.291603:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575536.291606:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361251072:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575536.291611:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361251200:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575536.291629:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575536.291639:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575536/real 1788575536]  req@ffff8dc020497480 x1875453361251200/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575561 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575536.291649:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453361251200/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575561 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575536.291655:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575536.291658:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575536.291661:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361251200:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575536.291666:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361251328:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575536.291681:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575536.291690:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575536/real 1788575536]  req@ffff8dc020495180 x1875453361251328/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575561 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575536.291699:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361251328/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575561 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575536.291706:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575536.291709:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575536.291712:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361251328:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575536.674968:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575536.674976:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575536.674978:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575536.674979:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575536.675007:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575536.675037:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575537.314956:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575537.698961:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575537.698962:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575537.698962:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575537.699003:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575537.699006:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575537.699029:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575538.338953:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575538.723061:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575538.723062:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575538.723065:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575538.723107:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575538.723108:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575538.723110:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575539.362976:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575539.746976:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575539.746978:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575539.747000:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575539.747013:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575539.747020:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575539.747039:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575540.386999:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575540.770976:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575540.771001:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575540.771003:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575540.771014:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575540.771031:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575540.771042:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00080000:1.0:1788575541.410988:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575541.410998:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575541.411002:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788575541.411015:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575541.411023:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3887
00000100:00080000:1.0:1788575541.411036:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575541.411044:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575541.411076:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361251456/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575541.411098:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575541.411100:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575541.411101:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575541.411104:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3887
00000100:00080000:1.0:1788575541.411106:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575541.411108:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575541.411115:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575541.411126:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361251584/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575541.411133:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575541.411135:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575541.411136:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575541.411140:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3887
00000100:00100000:0.0:1788575541.411141:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361251456:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788575541.411142:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575541.411147:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575541.411152:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575541.411159:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361251712/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575541.411164:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575541.411166:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575541.411167:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575541.411169:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3887
00000100:00080000:1.0:1788575541.411171:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575541.411172:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575541.411175:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575541.411182:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361251840/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575541.411187:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575541.411189:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575541.411190:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575541.411193:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3887
00000100:00080000:1.0:1788575541.411201:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575541.411204:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575541.411206:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788575541.411210:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575541.411214:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361251968/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575541.411221:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575541.411223:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575541.411224:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575541.411227:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3887
00000100:00080000:1.0:1788575541.411229:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575541.411230:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575541.411233:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575541.411244:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361252096/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575541.411247:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575541/real 1788575541]  req@ffff8dc005dc2d80 x1875453361251456/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575566 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575541.411252:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575541.411258:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575541.411259:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575541.411266:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3887
00000100:00080000:1.0:1788575541.411269:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575541.411272:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575541.411274:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575541.411280:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361252224/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575541.411291:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361251456/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575566 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575541.411300:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575541.411303:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575541.411306:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361251456:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788575541.411325:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361251584:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575541.411341:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575541.411349:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575541/real 1788575541]  req@ffff8dc005dc3800 x1875453361251584/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575566 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575541.411356:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361251584/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575566 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575541.411362:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575541.411364:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575541.411367:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361251584:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575541.411370:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361251712:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575541.411381:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575541.411386:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575541/real 1788575541]  req@ffff8dc005dc1500 x1875453361251712/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575566 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575541.411393:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361251712/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575566 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575541.411397:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575541.411399:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575541.411401:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361251712:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575541.411404:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361251840:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575541.411412:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575541.411417:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575541/real 1788575541]  req@ffff8dc005dc0a80 x1875453361251840/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575566 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575541.411424:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361251840/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575566 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575541.411429:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575541.411430:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575541.411432:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361251840:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575541.411434:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361251968:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575541.411443:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575541.411449:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575541/real 1788575541]  req@ffff8dc005dc1c00 x1875453361251968/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575566 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575541.411455:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361251968/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575566 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575541.411460:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575541.411461:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575541.411463:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361251968:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575541.411466:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361252096:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575541.411475:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575541.411480:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575541/real 1788575541]  req@ffff8dc005dc0700 x1875453361252096/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575566 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575541.411486:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361252096/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575566 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575541.411490:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575541.411492:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575541.411493:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361252096:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575541.411509:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361252224:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575541.411522:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575541.411529:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575541/real 1788575541]  req@ffff8dc005dc3b80 x1875453361252224/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575566 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575541.411535:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361252224/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575566 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575541.411549:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575541.411552:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575541.411555:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361252224:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575541.794932:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575541.794952:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575541.794985:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575541.795000:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575541.795001:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575541.795011:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575542.435068:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575542.818958:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575542.818960:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575542.818966:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575542.818985:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575542.818990:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788575542.818998:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575543.458937:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575543.842939:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575543.842939:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575543.842962:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575543.842963:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575543.842976:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575543.842990:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575544.482972:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575544.866972:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575544.866976:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575544.866978:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575544.867004:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575544.867043:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575544.867066:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575545.506993:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575545.891029:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575545.891029:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575545.891030:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575545.891085:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575545.891092:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788575545.891114:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575546.530969:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788575546.531003:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575546.531011:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788575546.531016:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575546.531025:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3892
00000100:00080000:2.0:1788575546.531035:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575546.531042:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575546.531080:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453361252352/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575546.531107:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575546.531110:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575546.531112:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575546.531115:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3892
00000100:00080000:2.0:1788575546.531117:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575546.531120:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575546.531129:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575546.531136:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453361252480/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575546.531144:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575546.531147:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575546.531148:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575546.531150:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3892
00000100:00080000:2.0:1788575546.531152:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575546.531155:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575546.531159:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575546.531167:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361252608/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575546.531175:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788575546.531178:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361252352:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788575546.531179:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575546.531183:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575546.531191:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3892
00000100:00080000:2.0:1788575546.531196:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575546.531198:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575546.531200:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575546.531208:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453361252736/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575546.531214:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575546.531217:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575546.531218:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575546.531220:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3892
00000100:00080000:2.0:1788575546.531222:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575546.531224:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575546.531226:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575546.531233:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453361252864/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575546.531241:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575546.531244:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575546.531246:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575546.531251:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3892
00000100:00080000:2.0:1788575546.531255:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575546.531259:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575546.531264:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788575546.531276:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575546.531281:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361252992/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575546.531292:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575546.531296:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575546.531298:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575546.531304:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3892
00000100:00080000:2.0:1788575546.531310:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575546.531314:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575546.531320:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575546.531333:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453361253120/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575546.531335:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575546/real 1788575546]  req@ffff8dc020497100 x1875453361252352/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575571 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575546.531374:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453361252352/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575571 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575546.531387:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575546.531392:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575546.531396:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361252352:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788575546.531404:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361252480:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575546.531428:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575546.531440:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575546/real 1788575546]  req@ffff8dc020494380 x1875453361252480/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575571 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575546.531451:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453361252480/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575571 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575546.531461:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575546.531464:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575546.531467:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361252480:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575546.531491:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361252608:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575546.531510:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575546.531520:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575546/real 1788575546]  req@ffff8dc020494700 x1875453361252608/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575571 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575546.531531:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361252608/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575571 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575546.531539:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575546.531542:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575546.531545:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361252608:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575546.531551:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361252736:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575546.531569:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575546.531594:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575546/real 1788575546]  req@ffff8dc020496d80 x1875453361252736/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575571 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575546.531605:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453361252736/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575571 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575546.531613:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575546.531616:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575546.531619:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361252736:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575546.531626:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361252864:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575546.531644:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575546.531653:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575546/real 1788575546]  req@ffff8dc020496a00 x1875453361252864/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575571 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575546.531662:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453361252864/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575571 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575546.531670:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575546.531673:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575546.531676:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361252864:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575546.531683:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361252992:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575546.531700:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575546.531711:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575546/real 1788575546]  req@ffff8dc020495180 x1875453361252992/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575571 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575546.531721:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361252992/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575571 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575546.531728:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575546.531731:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575546.531742:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361252992:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575546.531748:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361253120:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575546.531765:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575546.531775:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575546/real 1788575546]  req@ffff8dc020497480 x1875453361253120/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575571 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575546.531786:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453361253120/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575571 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575546.531793:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575546.531795:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575546.531798:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361253120:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575546.914998:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575546.914998:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575546.914998:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575546.915014:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575546.915040:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575546.915086:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575547.554961:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575547.938980:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575547.938986:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575547.939008:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575547.939069:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788575547.939130:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575547.939159:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575548.578991:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575548.962947:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575548.962959:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575548.962978:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575548.963066:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575548.963077:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788575548.963142:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575549.602967:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575549.986974:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575549.986974:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575549.986984:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575549.987002:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575549.987012:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788575549.987017:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575550.626972:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575551.010924:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575551.010934:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575551.010954:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575551.010964:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575551.010976:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788575551.010989:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1788575551.650986:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788575551.650987:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575551.650995:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788575551.650999:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575551.651007:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3897
00000100:00080000:0.0:1788575551.651016:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575551.651023:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575551.651060:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361253248/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575551.651079:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575551.651082:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575551.651083:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575551.651085:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3897
00000100:00080000:0.0:1788575551.651088:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575551.651090:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575551.651098:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575551.651107:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361253376/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575551.651113:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575551.651116:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575551.651118:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788575551.651119:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361253248:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788575551.651122:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3897
00000100:00080000:0.0:1788575551.651126:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575551.651129:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575551.651132:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575551.651138:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361253504/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575551.651144:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575551.651146:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575551.651147:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575551.651149:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3897
00000100:00080000:0.0:1788575551.651152:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575551.651154:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575551.651157:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575551.651163:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361253632/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575551.651168:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575551.651170:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575551.651171:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575551.651174:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3897
00000100:00080000:0.0:1788575551.651176:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575551.651178:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575551.651180:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575551.651187:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361253760/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575551.651192:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575551.651194:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575551.651195:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575551.651197:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3897
00000100:00080000:0.0:1788575551.651199:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575551.651201:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575551.651204:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575551.651214:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361253888/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575551.651224:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361253376:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788575551.651234:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575551.651238:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575551.651240:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575551.651245:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3897
00000100:00080000:0.0:1788575551.651249:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575551.651253:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575551.651258:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575551.651265:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361253504:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575551.651273:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361254016/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575551.651312:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361253632:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575551.651336:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361253760:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575551.651362:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361253888:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575551.651382:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361254016:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575552.034957:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575552.034961:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575552.034962:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575552.034981:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575552.034988:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788575552.035013:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575552.674995:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575553.058996:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575553.059024:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575553.059033:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575553.059046:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575553.059048:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575553.059070:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575553.699160:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575554.083004:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575554.083006:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575554.083016:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575554.083046:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575554.083056:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575554.083059:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575554.722997:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000400:00000100:2.0:1788575554.723207:0:2337:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.140:988
00000400:00000100:2.0:1788575554.723255:0:2337:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.140@tcp at host 192.168.202.140 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:2.0:1788575554.723277:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:2.0:1788575554.723321:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:2.0:1788575554.723342:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:2.0:1788575554.723365:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:3.0:1788575554.723371:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575551/real 1788575554]  req@ffff8dc006711880 x1875453361253376/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575576 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:2.0:1788575554.723378:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:2.0:1788575554.723390:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:2.0:1788575554.723404:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:3.0:1788575554.723408:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361253376/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575576 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575554.723426:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575554.723432:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575554.723437:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361253376:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575554.723445:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575551/real 1788575554]  req@ffff8dc006713100 x1875453361253504/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575576 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575554.723458:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361253504/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575576 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575554.723472:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575554.723476:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575554.723480:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361253504:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575554.723487:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575551/real 1788575554]  req@ffff8dc006710e00 x1875453361253632/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575576 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575554.723499:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361253632/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575576 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575554.723508:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575554.723512:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575554.723515:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361253632:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575554.723522:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575551/real 1788575554]  req@ffff8dc006712a00 x1875453361253760/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575576 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575554.723534:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361253760/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575576 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575554.723543:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575554.723547:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575554.723551:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361253760:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575554.723559:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575551/real 1788575554]  req@ffff8dc006713b80 x1875453361253248/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575576 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575554.723573:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361253248/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575576 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575554.723581:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575554.723585:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575554.723589:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361253248:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788575554.723625:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575551/real 1788575554]  req@ffff8dc006711500 x1875453361253888/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575576 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575554.723638:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361253888/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575576 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575554.723646:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575554.723650:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575554.723653:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361253888:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575554.723661:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575551/real 1788575554]  req@ffff8dc006712680 x1875453361254016/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575576 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575554.723673:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361254016/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575576 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575554.723681:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575554.723684:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575554.723687:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361254016:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575555.107026:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575555.107026:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575555.107065:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575555.107210:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575555.107220:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575555.107364:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575555.746974:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575556.131010:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575556.131029:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575556.131031:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575556.131057:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575556.131058:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575556.131062:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00080000:3.0:1788575556.770996:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575556.771008:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788575556.771012:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575556.771023:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3902
00000100:00080000:3.0:1788575556.771035:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575556.771043:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575556.771084:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575556.771099:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ce00 x1875453361254144/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575556.771127:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575556.771132:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575556.771134:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575556.771139:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3902
00000100:00080000:3.0:1788575556.771143:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575556.771147:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575556.771160:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575556.771182:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361254144:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788575556.771189:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644dc00 x1875453361254272/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575556.771201:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575556.771207:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575556.771210:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575556.771232:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3902
00000100:00080000:3.0:1788575556.771238:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575556.771244:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575556.771252:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575556.771266:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c000 x1875453361254400/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575556.771277:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575556.771280:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575556.771283:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:2.0:1788575556.771288:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788575556.771290:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3902
00000100:00080000:3.0:1788575556.771300:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575556.771306:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575556.771314:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575556.771331:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f800 x1875453361254528/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575556.771344:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575556.771349:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575556.771351:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575556.771357:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3902
00000100:00100000:2.0:1788575556.771361:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575556/real 1788575556]  req@ffff8dc00644ce00 x1875453361254144/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575581 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575556.771363:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575556.771373:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575556.771382:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575556.771396:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ce00 x1875453361254144/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575581 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575556.771401:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ca80 x1875453361254656/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575556.771419:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575556.771420:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575556.771428:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575556.771430:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788575556.771431:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788575556.771439:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361254144:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788575556.771442:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3902
00000100:00080000:3.0:1788575556.771450:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575556.771456:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575556.771461:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575556.771475:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ea00 x1875453361254784/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575556.771484:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575556.771488:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:2.0:1788575556.771491:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361254272:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788575556.771492:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575556.771503:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3902
00000100:00080000:3.0:1788575556.771508:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575556.771513:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575556.771519:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788575556.771527:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575556.771535:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d500 x1875453361254912/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575556.771545:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575556/real 1788575556]  req@ffff8dc00644dc00 x1875453361254272/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575581 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575556.771561:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644dc00 x1875453361254272/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575581 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575556.771587:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575556.771592:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575556.771596:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361254272:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575556.771603:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361254400:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575556.771629:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575556.771641:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575556/real 1788575556]  req@ffff8dc00644c000 x1875453361254400/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575581 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575556.771653:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c000 x1875453361254400/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575581 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575556.771662:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575556.771666:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575556.771668:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361254400:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575556.771674:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361254528:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575556.771710:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575556.771721:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575556/real 1788575556]  req@ffff8dc00644f800 x1875453361254528/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575581 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575556.771732:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f800 x1875453361254528/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575581 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575556.771754:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575556.771757:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575556.771760:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361254528:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575556.771766:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361254656:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575556.771789:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575556.771800:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575556/real 1788575556]  req@ffff8dc00644ca80 x1875453361254656/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575581 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575556.771812:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ca80 x1875453361254656/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575581 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575556.771820:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575556.771824:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575556.771827:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361254656:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575556.771833:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361254784:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575556.771854:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575556.771896:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575556/real 1788575556]  req@ffff8dc00644ea00 x1875453361254784/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575581 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575556.771910:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ea00 x1875453361254784/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575581 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575556.771917:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575556.771920:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575556.771923:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361254784:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575556.771942:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361254912:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575556.771961:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575556.771974:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575556/real 1788575556]  req@ffff8dc00644d500 x1875453361254912/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575581 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575556.771985:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d500 x1875453361254912/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575581 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575556.771993:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575556.771996:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575556.772000:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361254912:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575557.154997:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575557.155012:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575557.155045:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575557.155164:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575557.155171:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575557.155244:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575557.795075:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575558.178971:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575558.178971:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575558.178971:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575558.178999:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575558.179001:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575558.179002:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575558.818953:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575559.202962:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575559.202970:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575559.202974:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575559.202994:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575559.202996:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575559.203000:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575559.842993:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575560.226973:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575560.226973:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575560.226974:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575560.226995:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575560.227005:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575560.227006:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575560.866950:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575561.250948:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575561.250948:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575561.250948:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575561.250951:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575561.250979:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575561.251003:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575561.890977:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575561.890985:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575561.890990:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788575561.890994:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575561.891004:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3907
00000100:00080000:0.0:1788575561.891013:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575561.891021:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575561.891052:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361255040/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575561.891070:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575561.891072:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575561.891074:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575561.891076:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3907
00000100:00080000:0.0:1788575561.891078:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575561.891081:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575561.891088:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575561.891098:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361255168/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575561.891108:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575561.891112:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575561.891114:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788575561.891117:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361255040:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788575561.891120:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3907
00000100:00080000:0.0:1788575561.891126:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575561.891132:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575561.891137:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575561.891149:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361255296/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575561.891158:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575561.891161:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575561.891164:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575561.891167:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3907
00000100:00080000:0.0:1788575561.891171:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575561.891174:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575561.891179:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575561.891190:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453361255424/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788575561.891196:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788575561.891203:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575561.891215:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575561.891217:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575561.891224:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3907
00000100:00080000:0.0:1788575561.891228:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575561.891232:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575561.891237:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575561.891241:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575561/real 1788575561]  req@ffff8dc006713480 x1875453361255040/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575586 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575561.891250:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361255552/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575561.891261:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788575561.891265:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361255040/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575586 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575561.891266:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575561.891269:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575561.891277:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3907
00000100:00080000:0.0:1788575561.891283:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575561.891287:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575561.891288:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:2.0:1788575561.891297:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000008:00100000:0.0:1788575561.891298:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575561.891305:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361255040:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788575561.891315:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361255680/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575561.891325:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575561.891329:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575561.891331:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788575561.891333:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361255168:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788575561.891342:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3907
00000100:00080000:0.0:1788575561.891347:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575561.891351:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575561.891356:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788575561.891362:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575561.891369:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361255808/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575561.891380:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575561/real 1788575561]  req@ffff8dc006713800 x1875453361255168/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575586 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575561.891395:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361255168/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575586 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575561.891406:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575561.891409:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575561.891412:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361255168:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575561.891419:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361255296:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575561.891441:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575561.891453:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575561/real 1788575561]  req@ffff8dc006712300 x1875453361255296/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575586 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575561.891464:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361255296/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575586 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575561.891472:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575561.891475:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575561.891478:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361255296:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575561.891485:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361255424:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575561.891503:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575561.891513:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575561/real 1788575561]  req@ffff8dc006710380 x1875453361255424/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575586 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575561.891524:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453361255424/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575586 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575561.891532:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575561.891535:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575561.891538:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361255424:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575561.891544:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361255552:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575561.891562:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575561.891573:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575561/real 1788575561]  req@ffff8dc006711c00 x1875453361255552/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575586 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575561.891583:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361255552/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575586 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575561.891591:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575561.891594:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575561.891597:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361255552:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575561.891603:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361255680:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575561.891621:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575561.891633:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575561/real 1788575561]  req@ffff8dc006712680 x1875453361255680/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575586 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575561.891659:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361255680/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575586 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575561.891667:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575561.891670:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575561.891673:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361255680:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575561.891690:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361255808:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575561.891711:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575561.891722:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575561/real 1788575561]  req@ffff8dc006711500 x1875453361255808/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575586 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575561.891732:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361255808/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575586 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575561.891740:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575561.891743:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575561.891747:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361255808:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575562.274965:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575562.274969:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575562.274970:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575562.274973:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575562.274999:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575562.275033:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575562.914936:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575563.298961:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575563.298961:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575563.298961:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575563.298965:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575563.299005:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575563.299029:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575563.939007:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575564.323007:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575564.323007:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575564.323007:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575564.323012:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575564.323051:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575564.323095:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575564.963004:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575565.347006:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575565.347007:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575565.347008:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575565.347090:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575565.347157:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575565.347180:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575565.987037:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575566.370988:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575566.370993:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575566.370993:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575566.370993:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575566.371036:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575566.371079:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1788575567.011008:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788575567.011011:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575567.011023:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788575567.011027:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575567.011036:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3912
00000100:00080000:0.0:1788575567.011044:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575567.011051:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575567.011082:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361255936/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575567.011104:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575567.011107:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575567.011108:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575567.011111:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3912
00000100:00080000:0.0:1788575567.011113:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575567.011115:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575567.011123:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575567.011131:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361256064/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575567.011138:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575567.011140:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575567.011140:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575567.011142:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3912
00000100:00080000:0.0:1788575567.011144:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575567.011146:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575567.011148:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575567.011156:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361255936:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788575567.011157:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361256192/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575567.011177:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575567.011179:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575567.011181:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575567.011185:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3912
00000100:00080000:0.0:1788575567.011187:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575567.011189:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575567.011192:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575567.011198:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361256320/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575567.011203:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575567.011204:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575567.011205:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575567.011208:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3912
00000100:00080000:0.0:1788575567.011210:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575567.011212:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575567.011215:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575567.011220:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361256448/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575567.011225:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575567.011226:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575567.011228:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575567.011230:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3912
00000100:00080000:0.0:1788575567.011233:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575567.011235:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575567.011237:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575567.011244:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361256576/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575567.011249:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575567.011251:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575567.011252:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575567.011254:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3912
00000100:00080000:0.0:1788575567.011256:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575567.011260:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575567.011264:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788575567.011265:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575567.011272:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361256704/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575567.011327:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575567/real 1788575567]  req@ffff8dc006713b80 x1875453361255936/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575592 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575567.011344:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361255936/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575592 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575567.011354:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575567.011357:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575567.011360:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361255936:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788575567.011386:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361256064:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575567.011410:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575567.011423:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575567/real 1788575567]  req@ffff8dc006712a00 x1875453361256064/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575592 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575567.011435:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361256064/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575592 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575567.011446:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575567.011450:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575567.011453:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361256064:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575567.011460:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361256192:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575567.011480:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575567.011490:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575567/real 1788575567]  req@ffff8dc006710e00 x1875453361256192/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575592 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575567.011502:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361256192/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575592 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575567.011510:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575567.011512:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575567.011514:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361256192:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575567.011518:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361256320:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575567.011531:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575567.011538:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575567/real 1788575567]  req@ffff8dc006713100 x1875453361256320/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575592 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575567.011545:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361256320/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575592 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575567.011550:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575567.011552:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575567.011554:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361256320:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575567.011557:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361256448:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575567.011567:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575567.011572:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575567/real 1788575567]  req@ffff8dc006711880 x1875453361256448/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575592 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575567.011579:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361256448/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575592 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575567.011589:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575567.011591:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575567.011593:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361256448:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575567.011596:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361256576:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575567.011605:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575567.011610:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575567/real 1788575567]  req@ffff8dc006711500 x1875453361256576/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575592 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575567.011616:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361256576/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575592 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575567.011622:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575567.011623:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575567.011625:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361256576:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575567.011628:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361256704:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575567.011638:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575567.011643:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575567/real 1788575567]  req@ffff8dc006712680 x1875453361256704/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575592 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575567.011649:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361256704/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575592 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575567.011653:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575567.011655:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575567.011658:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361256704:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575567.394980:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575567.394980:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575567.394987:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575567.395000:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575567.395021:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575567.395033:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575568.035005:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575568.418976:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575568.418976:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575568.418976:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575568.418983:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575568.419008:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575568.419045:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575569.058969:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575569.442974:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575569.442974:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575569.442977:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575569.442978:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575569.442998:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575569.443038:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575570.082981:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575570.466926:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575570.466940:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575570.466942:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575570.466961:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575570.466980:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575570.467017:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575571.106980:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575571.490981:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575571.490981:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575571.490982:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575571.490991:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575571.491016:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575571.491062:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1788575572.130955:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788575572.130956:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575572.130965:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788575572.130970:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575572.130996:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3917
00000100:00080000:0.0:1788575572.131005:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575572.131010:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575572.131040:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361256832/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575572.131058:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575572.131061:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575572.131062:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575572.131065:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3917
00000100:00080000:0.0:1788575572.131067:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575572.131070:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575572.131078:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575572.131084:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361256832:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788575572.131088:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453361256960/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575572.131096:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575572.131098:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575572.131100:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575572.131102:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3917
00000100:00080000:0.0:1788575572.131103:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575572.131105:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575572.131109:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575572.131116:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361257088/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575572.131121:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575572.131123:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575572.131125:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575572.131127:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3917
00000100:00080000:0.0:1788575572.131129:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575572.131131:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:2.0:1788575572.131137:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:0.0:1788575572.131141:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575572.131151:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361257216/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575572.131157:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575572.131159:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575572.131160:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575572.131163:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3917
00000100:00080000:0.0:1788575572.131165:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575572.131168:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575572.131171:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575572.131173:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575572/real 1788575572]  req@ffff8dc006711c00 x1875453361256832/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575597 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575572.131180:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361257344/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575572.131188:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788575572.131191:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361256832/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575597 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575572.131192:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575572.131195:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575572.131202:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3917
00000100:00080000:2.0:1788575572.131208:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575572.131211:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575572.131213:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575572.131216:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361256832:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788575572.131219:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575572.131224:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575572.131232:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361257472/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575572.131238:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361256960:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788575572.131239:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575572.131244:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575572.131245:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575572.131249:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3917
00000100:00080000:0.0:1788575572.131252:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575572.131255:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575572.131258:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1788575572.131259:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575572.131269:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361257600/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575572.131272:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575572/real 1788575572]  req@ffff8dc006710380 x1875453361256960/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575597 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575572.131294:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453361256960/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575597 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575572.131304:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575572.131306:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575572.131308:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361256960:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575572.131312:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361257088:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575572.131323:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575572.131328:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575572/real 1788575572]  req@ffff8dc006712300 x1875453361257088/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575597 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575572.131335:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361257088/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575597 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575572.131340:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575572.131342:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575572.131343:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361257088:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575572.131346:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361257216:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575572.131355:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575572.131360:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575572/real 1788575572]  req@ffff8dc006713800 x1875453361257216/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575597 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575572.131366:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361257216/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575597 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575572.131371:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575572.131372:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575572.131374:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361257216:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575572.131377:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361257344:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575572.131385:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575572.131391:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575572/real 1788575572]  req@ffff8dc006713480 x1875453361257344/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575597 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575572.131396:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361257344/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575597 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575572.131401:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575572.131402:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575572.131404:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361257344:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575572.131412:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361257472:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575572.131421:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575572.131426:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575572/real 1788575572]  req@ffff8dc006712680 x1875453361257472/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575597 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575572.131433:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361257472/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575597 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575572.131437:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575572.131439:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575572.131440:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361257472:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575572.131443:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361257600:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575572.131451:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575572.131457:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575572/real 1788575572]  req@ffff8dc006711500 x1875453361257600/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575597 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575572.131463:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361257600/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575597 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575572.131467:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575572.131468:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575572.131470:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361257600:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575572.514965:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575572.514965:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575572.514965:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575572.514965:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575572.515009:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575572.515061:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575573.154960:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575573.538961:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575573.538961:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575573.538963:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575573.538964:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575573.538998:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575573.539055:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575574.178979:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575574.562983:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575574.562983:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575574.562983:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575574.562983:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575574.563012:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575574.563067:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575575.202926:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575575.586965:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575575.586965:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575575.586965:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575575.586973:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575575.586995:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788575575.587055:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575576.226961:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575576.610972:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575576.610972:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575576.610972:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575576.610975:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575576.611002:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575576.611033:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1788575577.250984:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788575577.250984:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575577.250992:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575577.250995:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575577.251003:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3922
00000100:00080000:1.0:1788575577.251012:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575577.251019:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575577.251055:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361257728/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575577.251098:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575577.251101:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575577.251102:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575577.251104:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3922
00000100:00080000:1.0:1788575577.251107:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575577.251111:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575577.251119:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575577.251130:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361257728:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788575577.251136:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361257856/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575577.251147:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575577.251151:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575577.251152:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575577.251156:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3922
00000100:00080000:1.0:1788575577.251160:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575577.251164:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575577.251169:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575577.251181:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361257984/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788575577.251189:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788575577.251196:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575577.251207:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575577.251210:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575577.251216:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3922
00000100:00080000:1.0:1788575577.251220:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575577.251223:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575577.251228:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575577.251239:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575577/real 1788575577]  req@ffff8dc005dc1180 x1875453361257728/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575602 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575577.251242:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361258112/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575577.251264:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575577.251268:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:2.0:1788575577.251271:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361257728/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575602 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575577.251272:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575577.251281:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3922
00000100:00080000:1.0:1788575577.251287:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575577.251292:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:2.0:1788575577.251296:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:1.0:1788575577.251298:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1788575577.251303:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575577.251308:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361257728:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788575577.251313:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361258240/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575577.251324:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575577.251326:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575577.251327:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788575577.251331:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361257856:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788575577.251332:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3922
00000100:00080000:1.0:1788575577.251338:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575577.251341:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575577.251344:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575577.251354:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361258368/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788575577.251363:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575577.251378:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575577/real 1788575577]  req@ffff8dc005dc3b80 x1875453361257856/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575602 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575577.251379:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575577.251387:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575577.251391:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575577.251398:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3922
00000100:00100000:2.0:1788575577.251402:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361257856/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575602 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575577.251403:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575577.251411:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:2.0:1788575577.251418:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:1.0:1788575577.251419:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1788575577.251425:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575577.251430:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361257856:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788575577.251433:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361258496/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575577.251439:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361257984:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575577.251463:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575577.251474:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575577/real 1788575577]  req@ffff8dc005dc0700 x1875453361257984/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575602 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575577.251484:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361257984/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575602 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575577.251492:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575577.251495:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575577.251498:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361257984:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575577.251503:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361258112:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575577.251518:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575577.251527:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575577/real 1788575577]  req@ffff8dc005dc1c00 x1875453361258112/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575602 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575577.251537:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361258112/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575602 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575577.251544:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575577.251547:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575577.251550:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361258112:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575577.251555:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361258240:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575577.251570:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575577.251579:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575577/real 1788575577]  req@ffff8dc005dc0a80 x1875453361258240/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575602 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575577.251588:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361258240/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575602 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575577.251596:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575577.251599:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575577.251602:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361258240:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575577.251616:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361258368:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575577.251630:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575577.251639:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575577/real 1788575577]  req@ffff8dc005dc1500 x1875453361258368/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575602 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575577.251649:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361258368/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575602 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575577.251656:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575577.251659:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575577.251662:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361258368:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575577.251666:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361258496:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575577.251682:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575577.251690:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575577/real 1788575577]  req@ffff8dc005dc3800 x1875453361258496/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575602 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575577.251699:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361258496/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575602 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575577.251706:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575577.251709:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575577.251712:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361258496:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575577.634964:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575577.634964:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575577.634965:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575577.634969:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575577.634993:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788575577.635035:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575578.274955:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575578.658954:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575578.658972:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575578.658973:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575578.658990:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575578.659011:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575578.659025:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575579.298993:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575579.682960:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575579.682960:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575579.682961:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575579.682986:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575579.682990:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575579.682992:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575580.322923:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575580.706949:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575580.706950:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575580.706953:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575580.706976:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575580.706979:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575580.706979:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575581.346953:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575581.730983:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575581.730984:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575581.731004:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575581.731010:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575581.731013:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575581.731018:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575582.370969:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575582.370970:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575582.370979:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788575582.370983:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575582.370993:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3928
00000100:00080000:0.0:1788575582.371002:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575582.371009:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575582.371043:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361258624/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575582.371069:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575582.371073:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575582.371075:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575582.371079:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3928
00000100:00080000:0.0:1788575582.371084:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575582.371088:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575582.371093:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361258624:192.168.202.140@tcp:250:kworker.0
00000008:00100000:0.0:1788575582.371099:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575582.371115:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361258752/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575582.371126:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575582.371130:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575582.371132:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575582.371136:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3928
00000100:00080000:0.0:1788575582.371157:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575582.371160:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:2.0:1788575582.371165:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:0.0:1788575582.371167:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575582.371179:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361258880/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575582.371188:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575582.371191:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575582.371193:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575582.371197:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3928
00000100:00100000:2.0:1788575582.371200:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575582/real 1788575582]  req@ffff8dc006711880 x1875453361258624/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575607 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575582.371203:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575582.371212:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575582.371218:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575582.371219:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361258624/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575607 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575582.371232:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361259008/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575582.371241:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575582.371243:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575582.371248:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575582.371249:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788575582.371251:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788575582.371258:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361258624:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788575582.371259:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3928
00000100:00080000:0.0:1788575582.371265:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575582.371271:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575582.371276:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575582.371287:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361258752:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575582.371289:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361259136/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575582.371302:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575582.371305:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575582.371308:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575582.371312:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3928
00000100:00080000:0.0:1788575582.371316:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575582.371320:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:2.0:1788575582.371325:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:0.0:1788575582.371335:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575582.371338:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575582/real 1788575582]  req@ffff8dc006713100 x1875453361258752/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575607 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575582.371351:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361258752/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575607 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575582.371354:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361259264/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575582.371365:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575582.371371:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575582.371376:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361258752:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575582.371386:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361258880:192.168.202.140@tcp:8:kworker.0
00000100:00080000:0.0:1788575582.371390:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575582.371394:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575582.371397:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575582.371403:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3928
00000800:00000100:2.0:1788575582.371403:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788575582.371410:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1788575582.371416:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575582/real 1788575582]  req@ffff8dc006710e00 x1875453361258880/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575607 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575582.371418:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575582.371427:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575582.371431:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361258880/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575607 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575582.371440:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1788575582.371444:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361259392/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575582.371447:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575582.371455:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361258880:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575582.371466:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361259008:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575582.371488:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575582.371498:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575582/real 1788575582]  req@ffff8dc006712a00 x1875453361259008/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575607 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575582.371509:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361259008/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575607 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575582.371517:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575582.371520:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575582.371523:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361259008:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575582.371537:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361259136:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575582.371553:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575582.371562:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575582/real 1788575582]  req@ffff8dc006713b80 x1875453361259136/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575607 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575582.371572:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361259136/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575607 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575582.371581:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575582.371584:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575582.371586:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361259136:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575582.371590:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361259264:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575582.371601:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575582.371608:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575582/real 1788575582]  req@ffff8dc006711880 x1875453361259264/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575607 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575582.371614:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361259264/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575607 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575582.371619:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575582.371621:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575582.371622:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361259264:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575582.371625:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361259392:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575582.371642:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575582.371648:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575582/real 1788575582]  req@ffff8dc006711500 x1875453361259392/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575607 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575582.371654:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361259392/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575607 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575582.371659:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575582.371661:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575582.371663:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361259392:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575582.754941:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575582.754941:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575582.754951:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575582.754976:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575582.754980:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575582.755002:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575583.394966:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575583.778942:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575583.778949:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575583.778950:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575583.779002:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575583.779048:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575583.779061:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575584.418992:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575584.802971:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575584.802971:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575584.802971:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575584.802972:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575584.803003:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575584.803035:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575585.442961:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575585.826963:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575585.826963:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575585.826966:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575585.826966:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575585.827010:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575585.827036:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575586.467000:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575586.850968:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575586.850968:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575586.850968:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575586.850970:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575586.850997:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575586.851033:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1788575587.490960:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788575587.490962:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575587.490970:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788575587.490974:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575587.490981:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3933
00000100:00080000:0.0:1788575587.490989:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575587.490995:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575587.491027:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361259520/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575587.491051:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575587.491054:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575587.491055:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575587.491058:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3933
00000100:00080000:0.0:1788575587.491061:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575587.491064:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575587.491071:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575587.491080:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361259520:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788575587.491083:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361259648/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575587.491092:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575587.491095:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575587.491096:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575587.491099:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3933
00000100:00080000:0.0:1788575587.491101:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575587.491103:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575587.491106:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575587.491115:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361259776/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575587.491121:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575587.491124:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575587.491125:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575587.491127:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3933
00000100:00080000:0.0:1788575587.491129:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575587.491131:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:2.0:1788575587.491135:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:0.0:1788575587.491137:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575587.491146:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361259904/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575587.491152:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575587.491154:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575587.491155:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575587.491158:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3933
00000100:00080000:0.0:1788575587.491160:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575587.491162:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575587.491166:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575587.491170:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575587/real 1788575587]  req@ffff8dc006712680 x1875453361259520/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575612 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575587.491174:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453361260032/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575587.491190:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575587.491193:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:2.0:1788575587.491194:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361259520/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575612 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575587.491195:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575587.491203:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3933
00000100:00080000:0.0:1788575587.491206:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575587.491208:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575587.491209:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575587.491227:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1788575587.491236:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575587.491237:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361260160/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575587.491243:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361259520:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788575587.491250:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575587.491252:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575587.491254:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575587.491257:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3933
00000100:00080000:0.0:1788575587.491259:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575587.491262:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575587.491266:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575587.491266:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361259648:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575587.491276:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361260288/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788575587.491291:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575587.491310:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575587/real 1788575587]  req@ffff8dc006713480 x1875453361259648/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575612 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575587.491323:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361259648/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575612 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575587.491331:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575587.491334:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575587.491336:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361259648:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575587.491340:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361259776:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575587.491354:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575587.491361:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575587/real 1788575587]  req@ffff8dc006713800 x1875453361259776/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575612 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575587.491368:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361259776/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575612 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575587.491372:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575587.491374:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575587.491376:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361259776:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575587.491379:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361259904:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575587.491388:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575587.491392:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575587/real 1788575587]  req@ffff8dc006712300 x1875453361259904/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575612 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575587.491399:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361259904/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575612 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575587.491403:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575587.491405:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575587.491407:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361259904:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575587.491409:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361260032:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575587.491418:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575587.491423:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575587/real 1788575587]  req@ffff8dc006710380 x1875453361260032/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575612 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575587.491430:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453361260032/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575612 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575587.491435:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575587.491436:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575587.491438:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361260032:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575587.491441:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361260160:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575587.491449:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575587.491453:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575587/real 1788575587]  req@ffff8dc006711c00 x1875453361260160/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575612 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575587.491459:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361260160/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575612 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575587.491463:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575587.491465:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575587.491467:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361260160:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575587.491477:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361260288:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575587.491485:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575587.491490:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575587/real 1788575587]  req@ffff8dc006712680 x1875453361260288/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575612 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575587.491496:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361260288/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575612 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575587.491501:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575587.491503:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575587.491505:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361260288:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575587.874961:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575587.874961:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575587.874993:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575587.874996:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575587.875011:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575587.875021:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575588.514963:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575588.898963:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575588.898963:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575588.898969:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575588.898991:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575588.898996:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788575588.899006:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575589.538960:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575589.922944:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575589.922949:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575589.922967:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788575589.922982:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575589.922984:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575589.922997:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575590.562972:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575590.946988:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575590.946988:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575590.946988:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575590.946989:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575590.947019:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788575590.947071:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575591.587008:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575591.970967:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575591.970967:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575591.970969:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575591.970975:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575591.970999:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788575591.971053:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575592.610963:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575592.610970:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575592.610977:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575592.610981:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575592.610990:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3938
00000100:00080000:1.0:1788575592.611001:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575592.611009:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575592.611044:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361260416/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575592.611072:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575592.611075:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575592.611077:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575592.611081:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3938
00000100:00080000:1.0:1788575592.611085:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575592.611090:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575592.611100:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575592.611117:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361260416:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788575592.611118:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361260544/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575592.611135:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575592.611139:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575592.611142:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575592.611147:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3938
00000100:00080000:1.0:1788575592.611152:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575592.611156:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575592.611161:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575592.611174:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361260672/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575592.611184:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:2.0:1788575592.611188:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788575592.611190:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575592.611193:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575592.611199:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3938
00000100:00080000:1.0:1788575592.611203:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575592.611214:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575592.611220:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575592.611237:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575592/real 1788575592]  req@ffff8dc005dc2d80 x1875453361260416/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575617 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575592.611245:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361260800/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575592.611261:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788575592.611265:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361260416/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575617 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575592.611266:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575592.611271:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575592.611281:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3938
00000100:00080000:2.0:1788575592.611285:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575592.611286:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575592.611294:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788575592.611296:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575592.611303:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361260416:192.168.202.140@tcp:250:kworker.0
00000008:00100000:1.0:1788575592.611304:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575592.611332:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361260928/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575592.611332:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361260544:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788575592.611348:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575592.611353:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575592.611355:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:2.0:1788575592.611359:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788575592.611364:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3938
00000100:00080000:1.0:1788575592.611370:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1788575592.611373:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575592/real 1788575592]  req@ffff8dc005dc3800 x1875453361260544/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575617 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575592.611378:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575592.611389:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575592.611392:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361260544/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575617 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575592.611401:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1788575592.611407:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361261056/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575592.611414:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575592.611421:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361260544:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788575592.611429:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788575592.611430:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361260672:192.168.202.140@tcp:8:kworker.0
00000100:00080000:1.0:1788575592.611438:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575592.611440:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575592.611445:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3938
00000100:00080000:1.0:1788575592.611451:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1788575592.611452:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788575592.611460:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575592.611465:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575592/real 1788575592]  req@ffff8dc005dc1500 x1875453361260672/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575617 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1788575592.611467:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575592.611483:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361260672/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575617 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575592.611488:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361261184/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575592.611492:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575592.611500:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575592.611502:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361260672:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575592.611506:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361260800:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575592.611524:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575592.611533:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575592/real 1788575592]  req@ffff8dc005dc0a80 x1875453361260800/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575617 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575592.611540:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361260800/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575617 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575592.611547:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575592.611548:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575592.611550:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361260800:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575592.611559:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361260928:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575592.611568:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575592.611575:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575592/real 1788575592]  req@ffff8dc005dc1c00 x1875453361260928/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575617 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575592.611586:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361260928/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575617 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575592.611594:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575592.611597:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575592.611600:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361260928:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575592.611606:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361261056:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575592.611624:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575592.611635:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575592/real 1788575592]  req@ffff8dc005dc0700 x1875453361261056/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575617 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575592.611647:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361261056/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575617 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575592.611654:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575592.611657:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575592.611660:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361261056:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575592.611665:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361261184:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575592.611681:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575592.611690:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575592/real 1788575592]  req@ffff8dc005dc3b80 x1875453361261184/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575617 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575592.611706:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361261184/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575617 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575592.611713:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575592.611716:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575592.611719:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361261184:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575592.994973:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575592.994982:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575592.995104:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575592.995116:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575592.995123:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575592.995136:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575593.634982:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575594.019011:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575594.019012:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575594.019021:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575594.019053:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788575594.019064:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575594.019072:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575594.658960:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575595.043001:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575595.043018:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575595.043018:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575595.043019:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575595.043056:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788575595.043096:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575595.682981:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575596.066986:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575596.067018:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575596.067028:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575596.067030:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575596.067059:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575596.067074:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575596.706945:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575597.090966:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575597.090966:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575597.090967:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575597.090967:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575597.091000:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788575597.091038:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1788575597.730987:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575597.730995:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:3.0:1788575597.730997:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575597.731000:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575597.731011:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3943
00000100:00080000:0.0:1788575597.731019:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575597.731026:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575597.731065:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361261312/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575597.731091:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575597.731093:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575597.731095:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575597.731097:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3943
00000100:00080000:0.0:1788575597.731100:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575597.731103:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575597.731110:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575597.731120:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361261440/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575597.731127:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575597.731129:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575597.731130:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575597.731132:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3943
00000100:00080000:0.0:1788575597.731134:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575597.731136:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575597.731139:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575597.731143:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361261312:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788575597.731148:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361261568/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575597.731157:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575597.731159:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575597.731160:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575597.731163:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3943
00000100:00080000:0.0:1788575597.731165:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575597.731167:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575597.731169:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575597.731176:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361261696/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575597.731181:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575597.731183:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575597.731183:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575597.731186:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3943
00000100:00080000:0.0:1788575597.731188:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575597.731190:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575597.731193:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575597.731198:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361261824/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575597.731203:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575597.731206:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575597.731216:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575597.731222:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3943
00000800:00000100:2.0:1788575597.731223:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788575597.731229:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575597.731234:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575597.731239:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575597.731282:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361261952/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575597.731289:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575597.731292:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575597.731294:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575597.731298:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3943
00000100:00100000:2.0:1788575597.731300:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575597/real 1788575597]  req@ffff8dc006711500 x1875453361261312/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575622 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575597.731302:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575597.731309:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575597.731317:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575597.731332:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361262080/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575597.731337:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361261312/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575622 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575597.731360:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575597.731364:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575597.731369:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361261312:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788575597.731375:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361261440:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575597.731404:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575597.731419:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575597/real 1788575597]  req@ffff8dc006711880 x1875453361261440/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575622 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575597.731440:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361261440/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575622 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575597.731452:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575597.731455:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575597.731458:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361261440:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575597.731482:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361261568:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575597.731505:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575597.731524:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575597/real 1788575597]  req@ffff8dc006713b80 x1875453361261568/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575622 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575597.731535:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361261568/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575622 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575597.731543:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575597.731545:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575597.731548:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361261568:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575597.731554:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361261696:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575597.731570:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575597.731579:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575597/real 1788575597]  req@ffff8dc006712a00 x1875453361261696/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575622 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575597.731590:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361261696/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575622 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575597.731598:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575597.731602:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575597.731605:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361261696:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575597.731610:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361261824:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575597.731624:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575597.731632:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575597/real 1788575597]  req@ffff8dc006710e00 x1875453361261824/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575622 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575597.731638:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361261824/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575622 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575597.731651:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575597.731654:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575597.731657:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361261824:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575597.731662:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361261952:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575597.731680:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575597.731690:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575597/real 1788575597]  req@ffff8dc006713100 x1875453361261952/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575622 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575597.731702:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361261952/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575622 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575597.731708:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575597.731710:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575597.731712:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361261952:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575597.731715:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361262080:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575597.731728:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575597.731735:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575597/real 1788575597]  req@ffff8dc006712680 x1875453361262080/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575622 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575597.731742:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361262080/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575622 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575597.731746:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575597.731747:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575597.731749:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361262080:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575598.114956:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575598.114956:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575598.114959:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575598.114959:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575598.114988:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575598.115024:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575598.755014:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575599.138972:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575599.138972:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575599.138972:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575599.139100:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788575599.139179:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575599.139208:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575599.778936:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575600.162963:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575600.162963:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575600.162967:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575600.163026:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575600.163117:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575600.163158:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575600.802994:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575601.186984:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575601.186984:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575601.187021:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788575601.187112:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575601.187129:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575601.187130:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575601.826945:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575602.210954:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575602.210964:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575602.210972:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575602.210985:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575602.210985:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575602.210998:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00080000:0.0:1788575602.853631:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575602.853642:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:3.0:1788575602.853644:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575602.853647:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575602.853660:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3948
00000100:00080000:0.0:1788575602.853671:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575602.853679:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575602.853717:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361262208/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575602.853744:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575602.853748:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575602.853750:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575602.853754:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3948
00000100:00080000:0.0:1788575602.853757:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575602.853760:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575602.853770:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575602.853784:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453361262336/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575602.853795:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361262208:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788575602.853809:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575602.853814:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575602.853816:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575602.853821:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3948
00000100:00080000:0.0:1788575602.853824:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575602.853829:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575602.853835:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575602.853847:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361262464/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575602.853855:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575602.853858:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575602.853860:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575602.853883:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3948
00000100:00080000:0.0:1788575602.853887:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575602.853891:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575602.853896:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575602.853907:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361262592/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575602.853916:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575602.853918:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575602.853922:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:2.0:1788575602.853922:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788575602.853929:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3948
00000100:00080000:0.0:1788575602.853932:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575602.853937:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575602.853942:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575602.853952:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361262720/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575602.853960:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575602.853963:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575602.853965:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788575602.853970:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575602/real 1788575602]  req@ffff8dc006711c00 x1875453361262208/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575627 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575602.853972:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3948
00000100:00080000:0.0:1788575602.853978:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575602.853985:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575602.853989:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575602.854005:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361262848/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575602.854009:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361262208/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575627 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575602.854030:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575602.854032:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575602.854036:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575602.854039:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788575602.854041:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788575602.854047:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361262208:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788575602.854050:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3948
00000100:00080000:0.0:1788575602.854056:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575602.854060:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575602.854065:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575602.854077:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361262336:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575602.854078:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361262976/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1788575602.854112:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575602.854127:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575602/real 1788575602]  req@ffff8dc006710380 x1875453361262336/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575627 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575602.854140:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453361262336/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575627 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575602.854151:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575602.854154:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575602.854158:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361262336:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575602.854165:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361262464:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575602.854185:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575602.854196:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575602/real 1788575602]  req@ffff8dc006712300 x1875453361262464/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575627 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575602.854224:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361262464/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575627 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575602.854233:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575602.854236:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575602.854240:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361262464:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575602.854246:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361262592:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575602.854305:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575602.854318:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575602/real 1788575602]  req@ffff8dc006713800 x1875453361262592/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575627 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575602.854331:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361262592/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575627 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575602.854339:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575602.854343:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575602.854346:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361262592:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575602.854352:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361262720:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575602.854372:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575602.854384:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575602/real 1788575602]  req@ffff8dc006713480 x1875453361262720/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575627 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575602.854396:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361262720/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575627 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575602.854410:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575602.854413:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575602.854416:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361262720:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575602.854422:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361262848:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575602.854441:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575602.854452:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575602/real 1788575602]  req@ffff8dc006712680 x1875453361262848/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575627 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575602.854462:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361262848/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575627 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575602.854469:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575602.854472:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575602.854475:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361262848:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575602.854491:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361262976:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575602.854510:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575602.854521:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575602/real 1788575602]  req@ffff8dc006713100 x1875453361262976/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575627 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575602.854532:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361262976/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575627 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575602.854540:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575602.854543:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575602.854546:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361262976:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575603.234973:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575603.234973:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575603.234974:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575603.235007:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575603.235016:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575603.235019:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575603.875084:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575604.259020:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575604.259020:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788575604.259063:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575604.259160:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575604.259173:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575604.259215:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575604.898949:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575605.282964:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575605.282964:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575605.282969:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575605.282994:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575605.282996:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575605.282998:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575605.923032:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575606.307023:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575606.307023:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575606.307062:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575606.307082:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575606.307183:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575606.307308:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575606.947012:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575607.331008:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575607.331015:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575607.331046:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575607.331047:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575607.331154:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575607.331188:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575607.971092:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575607.971164:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575607.971172:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575607.971177:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575607.971189:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3953
00000100:00080000:1.0:1788575607.971202:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575607.971212:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575607.971258:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361263104/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575607.971313:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575607.971318:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575607.971321:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575607.971325:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3953
00000100:00080000:1.0:1788575607.971329:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575607.971333:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575607.971345:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575607.971361:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361263232/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575607.971370:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575607.971373:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575607.971375:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575607.971379:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3953
00000100:00080000:1.0:1788575607.971383:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575607.971386:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575607.971391:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575607.971400:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361263360/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575607.971409:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575607.971412:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575607.971414:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575607.971417:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3953
00000100:00080000:1.0:1788575607.971420:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575607.971423:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575607.971428:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575607.971438:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361263488/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575607.971447:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575607.971450:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575607.971451:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575607.971455:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3953
00000100:00080000:1.0:1788575607.971458:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575607.971462:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575607.971466:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575607.971475:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361263616/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575607.971483:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575607.971486:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575607.971488:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575607.971493:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3953
00000100:00080000:1.0:1788575607.971495:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575607.971499:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575607.971503:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575607.971512:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361263744/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575607.971521:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575607.971525:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575607.971527:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575607.971531:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3953
00000100:00080000:1.0:1788575607.971534:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575607.971538:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575607.971543:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575607.971552:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361263872/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575607.971762:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361263104:192.168.202.140@tcp:250:kworker.0
00000800:00000100:2.0:1788575607.971852:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575607.971941:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575607/real 1788575607]  req@ffff8dc005dc1180 x1875453361263104/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575632 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575607.971961:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361263104/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575632 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575607.971973:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575607.971977:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575607.971980:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361263104:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788575607.971988:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361263232:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575607.972012:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575607.972025:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575607/real 1788575607]  req@ffff8dc005dc3b80 x1875453361263232/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575632 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575607.972036:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361263232/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575632 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575607.972046:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575607.972049:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575607.972052:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361263232:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575607.972058:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361263360:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575607.972079:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575607.972090:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575607/real 1788575607]  req@ffff8dc005dc0700 x1875453361263360/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575632 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575607.972102:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361263360/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575632 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575607.972110:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575607.972114:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575607.972117:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361263360:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575607.972122:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361263488:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575607.972140:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575607.972151:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575607/real 1788575607]  req@ffff8dc005dc1c00 x1875453361263488/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575632 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575607.972161:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361263488/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575632 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575607.972176:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575607.972179:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575607.972183:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361263488:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575607.972188:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361263616:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788575607.972207:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575607.972218:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575607/real 1788575607]  req@ffff8dc005dc0a80 x1875453361263616/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575632 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575607.972228:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361263616/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575632 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575607.972238:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575607.972241:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575607.972244:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361263616:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575607.972249:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361263744:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575607.972267:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575607.972294:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575607/real 1788575607]  req@ffff8dc005dc1500 x1875453361263744/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575632 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575607.972310:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361263744/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575632 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575607.972318:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575607.972320:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575607.972324:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361263744:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575607.972331:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361263872:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788575607.972351:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575607.972362:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575607/real 1788575607]  req@ffff8dc005dc3800 x1875453361263872/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575632 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575607.972373:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361263872/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575632 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575607.972381:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575607.972384:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575607.972387:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361263872:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575608.355030:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575608.355041:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575608.356388:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575608.356402:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575608.357738:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575608.357760:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575608.995023:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575609.378959:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575609.378959:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575609.378959:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575609.378995:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575609.379038:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575609.379062:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575610.018993:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575610.403020:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575610.403020:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575610.403020:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575610.403020:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575610.403061:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575610.403101:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575611.043214:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575611.427024:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575611.427024:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575611.427071:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575611.427073:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575611.427085:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575611.427088:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575612.066951:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575612.451013:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575612.451018:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575612.451024:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575612.451151:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575612.451165:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575612.451215:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575613.091003:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788575613.091017:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575613.091025:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788575613.091031:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575613.091042:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3958
00000100:00080000:2.0:1788575613.091054:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575613.091062:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575613.091106:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361264000/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575613.091134:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575613.091138:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575613.091140:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575613.091144:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3958
00000100:00080000:2.0:1788575613.091147:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575613.091151:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575613.091162:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575613.091168:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361264000:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788575613.091176:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453361264128/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575613.091186:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575613.091189:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575613.091191:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575613.091195:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3958
00000100:00080000:2.0:1788575613.091198:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575613.091201:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575613.091206:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575613.091216:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453361264256/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575613.091224:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575613.091227:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575613.091229:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575613.091232:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3958
00000100:00080000:2.0:1788575613.091235:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575613.091238:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575613.091243:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575613.091253:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361264384/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788575613.091262:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788575613.091264:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575613.091268:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575613.091270:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575613.091274:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3958
00000100:00080000:2.0:1788575613.091277:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575613.091282:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575613.091286:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575613.091311:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361264512/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575613.091320:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575613.091324:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575613.091326:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788575613.091330:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575613/real 1788575613]  req@ffff8dc020495880 x1875453361264000/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575638 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575613.091334:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3958
00000100:00080000:2.0:1788575613.091339:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575613.091347:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575613.091352:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575613.091360:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361264000/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575638 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575613.091366:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453361264640/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575613.091379:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575613.091385:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575613.091388:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575613.091389:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575613.091392:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3958
00000100:00080000:2.0:1788575613.091396:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575613.091398:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788575613.091403:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575613.091408:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361264000:192.168.202.140@tcp:250:kworker.0
00000008:00100000:2.0:1788575613.091419:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575613.091433:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361264128:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575613.091436:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361264768/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788575613.091459:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575613.091474:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575613/real 1788575613]  req@ffff8dc020494e00 x1875453361264128/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575638 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575613.091486:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453361264128/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575638 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575613.091496:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575613.091499:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575613.091503:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361264128:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575613.091509:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361264256:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575613.091531:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575613.091542:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575613/real 1788575613]  req@ffff8dc020494a80 x1875453361264256/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575638 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575613.091554:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453361264256/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575638 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575613.091562:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575613.091565:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575613.091568:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361264256:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575613.091575:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361264384:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575613.091594:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575613.091605:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575613/real 1788575613]  req@ffff8dc020495500 x1875453361264384/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575638 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575613.091617:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361264384/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575638 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575613.091625:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575613.091628:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575613.091631:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361264384:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575613.091637:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361264512:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575613.091657:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575613.091668:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575613/real 1788575613]  req@ffff8dc020494000 x1875453361264512/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575638 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575613.091686:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361264512/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575638 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575613.091695:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575613.091698:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575613.091702:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361264512:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575613.091707:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361264640:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575613.091728:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575613.091739:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575613/real 1788575613]  req@ffff8dc020497480 x1875453361264640/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575638 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575613.091750:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453361264640/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575638 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575613.091757:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575613.091760:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575613.091763:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361264640:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575613.091781:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361264768:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575613.091799:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575613.091808:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575613/real 1788575613]  req@ffff8dc020495180 x1875453361264768/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575638 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575613.091819:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361264768/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575638 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575613.091833:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575613.091836:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575613.091839:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361264768:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575613.475010:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575613.475010:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575613.475010:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575613.475011:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575613.475047:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575613.475096:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575614.115016:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575614.499020:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575614.499026:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575614.499026:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575614.499027:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575614.499087:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575614.499120:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575615.139150:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575615.522990:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575615.522994:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575615.523031:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575615.523037:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575615.523046:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575615.523073:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575616.163022:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575616.547027:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575616.547028:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575616.547038:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575616.547083:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575616.547103:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575616.547105:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575617.187013:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575617.570998:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575617.570998:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575617.571036:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575617.571044:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575617.571071:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575617.571098:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00080000:2.0:1788575618.211010:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788575618.211011:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788575618.211028:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788575618.211033:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575618.211047:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3963
00000100:00080000:2.0:1788575618.211062:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575618.211071:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575618.211120:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453361264896/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575618.211162:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575618.211167:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575618.211170:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575618.211176:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3963
00000100:00080000:2.0:1788575618.211181:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575618.211187:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575618.211201:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575618.211202:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361264896:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788575618.211221:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453361265024/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575618.211235:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575618.211238:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575618.211240:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575618.211245:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3963
00000100:00080000:2.0:1788575618.211250:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575618.211255:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575618.211261:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575618.211274:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361265152/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575618.211284:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575618.211288:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575618.211290:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575618.211295:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3963
00000100:00080000:2.0:1788575618.211300:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575618.211331:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575618.211339:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575618.211348:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361265024:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575618.211358:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453361265280/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575618.211375:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575618.211380:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575618.211383:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575618.211393:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3963
00000100:00100000:3.0:1788575618.211394:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361265152:192.168.202.140@tcp:8:kworker.0
00000100:00080000:2.0:1788575618.211407:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575618.211417:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575618.211426:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575618.211448:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361265280:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575618.211466:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453361265408/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575618.211493:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575618.211498:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575618.211501:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575618.211509:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3963
00000100:00080000:2.0:1788575618.211517:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575618.211522:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575618.211528:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361265408:192.168.202.140@tcp:38:kworker.0
00000008:00100000:2.0:1788575618.211532:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575618.211553:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361265536/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575618.211570:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575618.211574:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575618.211578:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788575618.211579:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361265536:192.168.202.140@tcp:8:kworker.0
00000100:00080000:2.0:1788575618.211594:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3963
00000100:00080000:2.0:1788575618.211603:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575618.211609:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575618.211616:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575618.211629:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453361265664/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575618.211691:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361265664:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575618.594996:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575618.595009:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575618.595052:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575618.595054:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575618.595058:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575618.595061:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575619.234977:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575619.618985:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575619.618989:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575619.619015:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575619.619115:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575619.619124:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575619.619186:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575620.258966:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575620.642976:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575620.642981:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575620.643022:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575620.643046:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575620.643051:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575620.643077:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575621.282936:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000400:00000100:3.0:1788575621.283128:0:2336:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.140:988
00000400:00000100:3.0:1788575621.283161:0:2336:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.140@tcp at host 192.168.202.140 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:3.0:1788575621.283178:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788575621.283225:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788575621.283234:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788575621.283241:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788575621.283247:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788575621.283254:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788575621.283261:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:1.0:1788575621.283327:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575618/real 1788575621]  req@ffff8dc020497480 x1875453361265664/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575643 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575621.283353:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453361265664/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575643 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575621.283372:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575621.283377:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575621.283382:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361265664:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575621.283389:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575618/real 1788575621]  req@ffff8dc020495180 x1875453361265536/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575643 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575621.283401:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361265536/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575643 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575621.283408:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575621.283411:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575621.283415:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361265536:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575621.283421:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575618/real 1788575621]  req@ffff8dc020497100 x1875453361265408/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575643 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575621.283432:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453361265408/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575643 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575621.283441:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575621.283444:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575621.283447:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361265408:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788575621.283454:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575618/real 1788575621]  req@ffff8dc020494380 x1875453361265280/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575643 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575621.283465:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453361265280/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575643 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575621.283473:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575621.283477:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575621.283480:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361265280:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575621.283486:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575618/real 1788575621]  req@ffff8dc020496d80 x1875453361265024/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575643 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575621.283497:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453361265024/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575643 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575621.283506:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575621.284268:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575621.284275:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361265024:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788575621.284284:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575618/real 1788575621]  req@ffff8dc020494700 x1875453361265152/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575643 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575621.284301:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361265152/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575643 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575621.284309:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575621.284326:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575621.284329:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361265152:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575621.284336:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575618/real 1788575621]  req@ffff8dc020496a00 x1875453361264896/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575643 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575621.284347:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453361264896/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575643 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575621.284354:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575621.284364:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575621.284367:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361264896:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788575621.666956:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575621.666956:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575621.666956:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575621.666960:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575621.666995:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575621.667032:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575622.307117:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575622.690958:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575622.690958:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575622.691052:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575622.691179:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575622.691180:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575622.691253:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00080000:2.0:1788575623.330974:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788575623.330974:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788575623.330984:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788575623.330988:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575623.330998:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3968
00000100:00080000:2.0:1788575623.331007:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575623.331014:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575623.331045:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361265792/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575623.331070:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575623.331074:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575623.331076:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575623.331079:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3968
00000100:00080000:2.0:1788575623.331083:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575623.331088:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575623.331097:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575623.331108:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361265792:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788575623.331110:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361265920/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575623.331124:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575623.331127:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575623.331129:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575623.331133:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3968
00000100:00080000:2.0:1788575623.331136:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575623.331141:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575623.331146:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575623.331169:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453361266048/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788575623.331170:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788575623.331182:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575623.331186:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575623.331188:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575623.331193:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3968
00000100:00080000:2.0:1788575623.331197:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575623.331201:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575623.331206:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575623.331211:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575623/real 1788575623]  req@ffff8dc020494000 x1875453361265792/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575648 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575623.331219:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453361266176/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575623.331232:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788575623.331237:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361265792/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575648 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575623.331247:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575623.331249:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575623.331252:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575623.331256:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788575623.331260:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3968
00000100:00100000:1.0:1788575623.331263:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361265792:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788575623.331266:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575623.331274:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575623.331279:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575623.331291:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361266304/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788575623.331293:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361265920:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788575623.331308:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575623.331318:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000800:00000100:1.0:1788575623.331337:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788575623.331345:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575623.331351:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3968
00000100:00100000:1.0:1788575623.331353:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575623/real 1788575623]  req@ffff8dc020495500 x1875453361265920/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575648 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575623.331356:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575623.331364:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575623.331372:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575623.331378:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361265920/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575648 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575623.331388:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361266432/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575623.331392:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575623.331401:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788575623.331402:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788575623.331408:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361265920:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788575623.331416:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361266048:192.168.202.140@tcp:8:kworker.0
00000100:00080000:2.0:1788575623.331419:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575623.331423:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575623.331428:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3968
00000100:00080000:2.0:1788575623.331434:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575623.331438:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:1.0:1788575623.331443:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:2.0:1788575623.331447:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575623.331457:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575623/real 1788575623]  req@ffff8dc020494a80 x1875453361266048/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575648 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575623.331467:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453361266560/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788575623.331474:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453361266048/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575648 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575623.331504:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575623.331509:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575623.331514:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361266048:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575623.331521:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361266176:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788575623.331539:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575623.331549:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575623/real 1788575623]  req@ffff8dc020494e00 x1875453361266176/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575648 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575623.331560:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453361266176/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575648 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575623.331569:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575623.331571:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575623.331575:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361266176:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575623.331589:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361266304:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788575623.331606:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575623.331616:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575623/real 1788575623]  req@ffff8dc020495880 x1875453361266304/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575648 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575623.331627:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361266304/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575648 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575623.331650:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575623.331653:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575623.331656:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361266304:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788575623.331663:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361266432:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788575623.331681:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575623.331692:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575623/real 1788575623]  req@ffff8dc020494000 x1875453361266432/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575648 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575623.331703:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361266432/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575648 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575623.331711:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575623.331715:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575623.331718:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361266432:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575623.331724:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361266560:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788575623.331740:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575623.331750:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575623/real 1788575623]  req@ffff8dc020496a00 x1875453361266560/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575648 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575623.331759:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453361266560/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575648 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575623.331766:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575623.331768:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575623.331771:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361266560:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575623.714982:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575623.714982:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575623.714982:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575623.714992:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575623.715015:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575623.715054:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575624.355104:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575624.738952:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575624.738953:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575624.738992:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575624.739098:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575624.739099:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575624.739153:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575625.378973:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575625.762961:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575625.762961:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575625.762963:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575625.763029:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575625.763087:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575625.763090:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575626.403033:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575626.786958:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575626.786970:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575626.786972:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575626.786993:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575626.787034:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575626.787110:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575627.426976:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575627.810977:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575627.810977:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575627.810979:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575627.811002:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575627.811006:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575627.811008:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00080000:2.0:1788575628.450968:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788575628.450971:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788575628.450977:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788575628.450981:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575628.450989:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3974
00000100:00080000:2.0:1788575628.450997:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575628.451002:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575628.451029:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361266688/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575628.451052:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575628.451054:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575628.451056:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575628.451059:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3974
00000100:00080000:2.0:1788575628.451061:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575628.451063:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575628.451071:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575628.451080:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453361266816/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575628.451090:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575628.451095:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:3.0:1788575628.451095:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361266688:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788575628.451099:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575628.451107:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3974
00000100:00080000:2.0:1788575628.451110:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575628.451114:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575628.451119:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575628.451133:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453361266944/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575628.451143:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575628.451146:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575628.451148:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575628.451152:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3974
00000100:00080000:2.0:1788575628.451157:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575628.451161:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575628.451165:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788575628.451171:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575628.451188:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453361267072/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575628.451198:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575628.451201:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575628.451202:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575628.451205:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3974
00000100:00080000:2.0:1788575628.451209:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575628.451214:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575628.451220:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575628.451233:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575628/real 1788575628]  req@ffff8dc020494700 x1875453361266688/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575653 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575628.451235:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361267200/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575628.451257:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575628.451261:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575628.451263:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575628.451267:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3974
00000100:00080000:2.0:1788575628.451270:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575628.451274:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575628.451279:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575628.451291:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453361267328/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575628.451300:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575628.451303:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575628.451305:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575628.451308:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3974
00000100:00080000:2.0:1788575628.451311:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788575628.451312:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361266688/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575653 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575628.451316:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575628.451324:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788575628.451330:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1788575628.451348:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453361267456/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575628.451348:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575628.451355:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361266688:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788575628.451482:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361266816:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575628.451510:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575628.451567:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575628/real 1788575628]  req@ffff8dc020496d80 x1875453361266816/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575653 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575628.451576:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453361266816/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575653 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575628.451583:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575628.451585:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575628.451587:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361266816:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575628.451591:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361266944:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575628.451606:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575628.451612:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575628/real 1788575628]  req@ffff8dc020494380 x1875453361266944/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575653 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575628.451619:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453361266944/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575653 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575628.451624:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575628.451626:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575628.451628:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361266944:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575628.451631:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361267072:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575628.451644:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575628.451653:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575628/real 1788575628]  req@ffff8dc020497100 x1875453361267072/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575653 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575628.451663:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453361267072/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575653 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575628.451671:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575628.451674:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575628.451677:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361267072:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575628.451683:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361267200:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575628.451700:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575628.451710:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575628/real 1788575628]  req@ffff8dc020495180 x1875453361267200/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575653 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575628.451720:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361267200/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575653 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575628.451729:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575628.451732:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575628.451735:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361267200:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575628.451740:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361267328:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575628.451753:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575628.451761:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575628/real 1788575628]  req@ffff8dc020497480 x1875453361267328/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575653 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575628.451771:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453361267328/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575653 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575628.451779:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575628.451781:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575628.451782:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361267328:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575628.451786:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361267456:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575628.451797:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575628.451803:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575628/real 1788575628]  req@ffff8dc020496a00 x1875453361267456/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575653 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575628.451809:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453361267456/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575653 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575628.451814:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575628.451816:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575628.451818:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361267456:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575628.834948:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575628.834948:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575628.834955:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575628.834970:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575628.834979:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575628.835021:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575629.474995:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575629.858981:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575629.858981:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575629.858982:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575629.858982:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575629.859015:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575629.859047:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575630.499004:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575630.882926:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575630.882948:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575630.882951:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575630.882969:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575630.882969:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575630.883020:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575631.522983:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575631.906986:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575631.906986:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575631.907028:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575631.907135:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575631.907135:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575631.907362:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575632.546980:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575632.930982:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575632.930982:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575632.930982:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575632.930989:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575632.931008:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575632.931054:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575633.570954:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788575633.570956:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575633.570965:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788575633.570970:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575633.570980:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3979
00000100:00080000:2.0:1788575633.570990:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575633.571006:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575633.571044:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361267584/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575633.571068:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575633.571071:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575633.571073:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575633.571076:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3979
00000100:00080000:2.0:1788575633.571080:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575633.571084:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575633.571093:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575633.571103:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361267584:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788575633.571110:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361267712/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575633.571122:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575633.571133:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575633.571135:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575633.571139:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3979
00000100:00080000:2.0:1788575633.571150:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575633.571155:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575633.571161:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788575633.571164:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575633.571183:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453361267840/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575633.571194:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575633.571197:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575633.571201:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788575633.571202:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575633/real 1788575633]  req@ffff8dc020494000 x1875453361267584/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575658 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575633.571209:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3979
00000100:00080000:2.0:1788575633.571216:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575633.571222:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575633.571222:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361267584/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575658 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575633.571233:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:2.0:1788575633.571236:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788575633.571239:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575633.571243:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361267584:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788575633.571250:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453361267968/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575633.571256:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575633.571259:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575633.571260:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788575633.571263:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361267712:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788575633.571267:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3979
00000100:00080000:2.0:1788575633.571271:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575633.571274:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575633.571277:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788575633.571285:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575633.571287:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361268096/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575633.571297:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575633/real 1788575633]  req@ffff8dc020495880 x1875453361267712/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575658 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575633.571303:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575633.571310:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575633.571312:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788575633.571316:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361267712/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575658 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575633.571317:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3979
00000100:00080000:2.0:1788575633.571321:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575633.571325:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575633.571330:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575633.571341:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361268224/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575633.571341:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575633.571360:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788575633.571367:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788575633.571368:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361267712:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788575633.571370:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575633.571373:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575633.571378:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3979
00000100:00080000:2.0:1788575633.571381:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788575633.571384:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361267840:192.168.202.140@tcp:8:kworker.0
00000100:00080000:2.0:1788575633.571385:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575633.571394:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575633.571402:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453361268352/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788575633.571421:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575633.571434:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575633/real 1788575633]  req@ffff8dc020494e00 x1875453361267840/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575658 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575633.571446:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453361267840/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575658 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575633.571454:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575633.571457:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575633.571460:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361267840:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575633.571466:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361267968:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575633.571485:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575633.571496:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575633/real 1788575633]  req@ffff8dc020494a80 x1875453361267968/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575658 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575633.571508:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453361267968/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575658 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575633.571517:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575633.571520:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575633.571523:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361267968:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575633.571536:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361268096:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575633.571550:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575633.571556:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575633/real 1788575633]  req@ffff8dc020495500 x1875453361268096/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575658 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575633.571563:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361268096/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575658 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575633.571570:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575633.571572:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575633.571575:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361268096:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575633.571580:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361268224:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575633.571597:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575633.571607:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575633/real 1788575633]  req@ffff8dc020494000 x1875453361268224/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575658 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575633.571617:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361268224/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575658 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575633.571624:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575633.571627:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575633.571630:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361268224:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575633.571636:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361268352:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575633.571653:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575633.571662:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575633/real 1788575633]  req@ffff8dc020496a00 x1875453361268352/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575658 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575633.571673:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453361268352/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575658 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575633.571680:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575633.571682:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575633.571685:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361268352:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575633.954980:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575633.954980:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788575633.955023:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575633.955133:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575633.955172:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575633.955173:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575634.594948:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575634.979015:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575634.979044:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575634.979809:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575634.979900:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575634.980787:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575634.980838:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575635.618979:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575636.002989:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575636.002989:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575636.003013:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575636.003019:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575636.003053:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788575636.003294:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575636.645136:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575637.026967:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575637.027518:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788575637.027563:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575637.028482:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575637.029466:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575637.029482:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575637.667039:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575638.051016:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575638.051016:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575638.051070:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575638.051198:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575638.051205:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575638.051282:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575638.690992:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788575638.691098:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575638.691104:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788575638.691108:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575638.691116:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3984
00000100:00080000:2.0:1788575638.691126:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575638.691132:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575638.691165:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453361268480/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575638.691189:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575638.691192:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575638.691194:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575638.691197:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3984
00000100:00080000:2.0:1788575638.691200:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575638.691203:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575638.691212:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575638.691221:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361268608/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575638.691229:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575638.691232:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575638.691233:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575638.691237:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3984
00000100:00080000:2.0:1788575638.691239:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575638.691242:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575638.691246:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575638.691253:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453361268736/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575638.691261:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575638.691263:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575638.691265:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575638.691267:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3984
00000100:00080000:2.0:1788575638.691269:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575638.691272:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575638.691275:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575638.691282:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453361268864/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575638.691289:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575638.691291:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575638.691292:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575638.691295:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3984
00000100:00080000:2.0:1788575638.691297:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575638.691300:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575638.691303:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575638.691310:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453361268992/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575638.691317:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575638.691320:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575638.691321:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575638.691324:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3984
00000100:00080000:2.0:1788575638.691326:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575638.691329:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575638.691332:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575638.691339:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361269120/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575638.691346:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575638.691348:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575638.691350:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575638.691352:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3984
00000100:00080000:2.0:1788575638.691354:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575638.691357:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575638.691360:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575638.691384:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453361269248/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575638.691443:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361268480:192.168.202.140@tcp:250:kworker.0
00000800:00000100:3.0:1788575638.691497:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575638.691530:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575638/real 1788575638]  req@ffff8dc020497480 x1875453361268480/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575663 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575638.691544:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453361268480/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575663 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575638.691552:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575638.691555:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575638.691559:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361268480:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788575638.691565:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361268608:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575638.691591:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575638.691602:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575638/real 1788575638]  req@ffff8dc020495180 x1875453361268608/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575663 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575638.691612:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361268608/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575663 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575638.691621:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575638.691624:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575638.691627:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361268608:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575638.691633:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361268736:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575638.691651:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575638.691661:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575638/real 1788575638]  req@ffff8dc020497100 x1875453361268736/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575663 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575638.691677:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453361268736/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575663 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575638.691685:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575638.691687:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575638.691690:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361268736:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575638.691695:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361268864:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575638.691713:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575638.691723:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575638/real 1788575638]  req@ffff8dc020494380 x1875453361268864/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575663 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575638.691733:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453361268864/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575663 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575638.691741:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575638.691744:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575638.691747:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361268864:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575638.691752:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361268992:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575638.691769:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575638.691778:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575638/real 1788575638]  req@ffff8dc020496d80 x1875453361268992/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575663 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575638.691788:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453361268992/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575663 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575638.691801:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575638.691804:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575638.691807:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361268992:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575638.691813:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361269120:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575638.691845:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575638.691856:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575638/real 1788575638]  req@ffff8dc020494700 x1875453361269120/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575663 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575638.691884:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361269120/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575663 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575638.691893:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575638.691896:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575638.691899:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361269120:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575638.691904:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361269248:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575638.691921:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575638.691930:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575638/real 1788575638]  req@ffff8dc020496a00 x1875453361269248/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575663 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575638.691941:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453361269248/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575663 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575638.691948:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575638.691950:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575638.691954:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361269248:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575639.074980:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575639.074985:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575639.075006:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575639.075015:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575639.075022:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575639.075029:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575639.715023:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575640.098979:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575640.098979:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575640.098986:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575640.099013:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575640.099016:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575640.099030:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575640.738979:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575641.122969:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575641.122969:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575641.122971:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575641.123103:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575641.123108:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575641.123142:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575641.762994:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575642.146937:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575642.146941:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788575642.146963:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575642.146975:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575642.146982:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575642.146983:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575642.786975:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575643.170978:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575643.170978:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575643.170978:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575643.170989:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575643.171012:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575643.171046:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575643.810976:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788575643.810978:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575643.810986:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788575643.810991:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575643.811000:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3989
00000100:00080000:2.0:1788575643.811010:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575643.811017:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575643.811050:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361269376/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575643.811083:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575643.811087:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575643.811089:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575643.811093:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3989
00000100:00080000:2.0:1788575643.811096:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575643.811099:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575643.811108:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575643.811131:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361269376:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788575643.811132:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361269504/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575643.811148:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575643.811150:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575643.811152:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575643.811157:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3989
00000100:00080000:2.0:1788575643.811160:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575643.811164:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575643.811171:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575643.811184:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453361269632/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575643.811194:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575643.811198:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575643.811200:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575643.811203:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3989
00000100:00080000:2.0:1788575643.811207:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1788575643.811212:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788575643.811214:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575643.811220:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575643.811233:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453361269760/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575643.811242:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575643.811245:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575643.811246:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575643.811251:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3989
00000100:00080000:2.0:1788575643.811255:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788575643.811257:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575643/real 1788575643]  req@ffff8dc020494000 x1875453361269376/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575668 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575643.811261:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575643.811269:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575643.811282:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361269376/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575668 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575643.811285:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361269888/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575643.811309:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575643.811310:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575643.811317:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575643.811319:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788575643.811320:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788575643.811328:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361269376:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788575643.811329:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3989
00000100:00080000:2.0:1788575643.811335:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575643.811340:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575643.811345:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575643.811356:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361269504:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575643.811358:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361270016/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575643.811372:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575643.811376:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575643.811378:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1788575643.811399:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788575643.811410:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3989
00000100:00100000:3.0:1788575643.811414:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575643/real 1788575643]  req@ffff8dc020495500 x1875453361269504/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575668 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575643.811417:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575643.811425:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575643.811432:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575643.811443:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361269504/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575668 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575643.811449:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453361270144/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575643.811460:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575643.811466:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575643.811471:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361269504:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575643.811479:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361269632:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575643.811501:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575643.811512:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575643/real 1788575643]  req@ffff8dc020494a80 x1875453361269632/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575668 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575643.811522:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453361269632/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575668 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575643.811530:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575643.811533:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575643.811536:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361269632:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575643.811550:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361269760:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575643.811567:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575643.811576:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575643/real 1788575643]  req@ffff8dc020494e00 x1875453361269760/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575668 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575643.811586:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453361269760/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575668 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575643.811599:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575643.811602:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575643.811605:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361269760:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575643.811610:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361269888:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575643.811625:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575643.811634:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575643/real 1788575643]  req@ffff8dc020495880 x1875453361269888/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575668 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575643.811644:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361269888/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575668 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575643.811652:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575643.811655:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575643.811657:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361269888:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575643.811671:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361270016:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575643.811686:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575643.811704:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575643/real 1788575643]  req@ffff8dc020494000 x1875453361270016/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575668 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575643.811714:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361270016/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575668 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575643.811720:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575643.811723:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575643.811726:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361270016:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575643.811731:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361270144:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575643.811746:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575643.811754:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575643/real 1788575643]  req@ffff8dc020496a00 x1875453361270144/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575668 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575643.811763:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453361270144/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575668 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575643.811770:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575643.811772:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575643.811775:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361270144:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575644.194949:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575644.194949:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575644.194979:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575644.194993:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788575644.195006:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575644.195008:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575644.834986:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575645.218964:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575645.218964:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575645.218965:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575645.218986:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575645.218997:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575645.218997:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575645.858952:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575646.242975:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575646.242975:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575646.242977:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575646.242999:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575646.243008:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575646.243010:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575646.882924:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575647.266977:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575647.266977:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575647.266990:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575647.267007:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575647.267009:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575647.267013:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575647.906977:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575648.290975:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575648.290976:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575648.291004:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575648.291077:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575648.291097:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575648.291108:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575648.930966:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575648.930992:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575648.930998:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788575648.931003:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575648.931012:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3994
00000100:00080000:0.0:1788575648.931021:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575648.931028:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575648.931061:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361270272/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575648.931083:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575648.931087:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575648.931089:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575648.931093:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3994
00000100:00080000:0.0:1788575648.931097:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575648.931101:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575648.931111:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575648.931124:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361270272:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788575648.931126:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361270400/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575648.931140:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575648.931143:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575648.931145:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575648.931149:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3994
00000100:00080000:0.0:1788575648.931153:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575648.931157:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575648.931162:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575648.931180:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361270528/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575648.931190:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575648.931196:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000800:00000100:3.0:1788575648.931196:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788575648.931201:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575648.931206:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3994
00000100:00080000:0.0:1788575648.931210:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575648.931215:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575648.931220:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575648.931232:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361270656/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575648.931241:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575648/real 1788575648]  req@ffff8dc006710e00 x1875453361270272/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575673 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575648.931243:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575648.931250:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575648.931255:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575648.931263:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3994
00000100:00080000:0.0:1788575648.931270:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575648.931276:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575648.931281:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575648.931283:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361270272/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575673 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575648.931296:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361270784/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575648.931296:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575648.931304:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575648.931311:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361270272:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788575648.931315:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575648.931318:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575648.931320:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575648.931324:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3994
00000100:00080000:0.0:1788575648.931327:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575648.931330:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575648.931335:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575648.931347:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361270912/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575648.931351:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361270400:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788575648.931365:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575648.931368:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575648.931370:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575648.931375:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3994
00000100:00080000:0.0:1788575648.931380:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1788575648.931384:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788575648.931387:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575648.931405:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575648.931415:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361271040/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575648.931421:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575648/real 1788575648]  req@ffff8dc006712a00 x1875453361270400/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575673 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575648.931436:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361270400/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575673 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575648.931446:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575648.931450:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575648.931453:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361270400:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575648.931459:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361270528:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575648.931484:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575648.931492:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575648/real 1788575648]  req@ffff8dc006713b80 x1875453361270528/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575673 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575648.931501:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361270528/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575673 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575648.931516:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575648.931519:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575648.931522:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361270528:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575648.931528:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361270656:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575648.931547:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575648.931558:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575648/real 1788575648]  req@ffff8dc006711880 x1875453361270656/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575673 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575648.931568:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361270656/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575673 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575648.931577:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575648.931580:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575648.931583:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361270656:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575648.931589:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361270784:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575648.931607:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575648.931618:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575648/real 1788575648]  req@ffff8dc006711500 x1875453361270784/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575673 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575648.931629:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361270784/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575673 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575648.931637:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575648.931640:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575648.931643:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361270784:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575648.931659:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361270912:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575648.931677:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575648.931687:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575648/real 1788575648]  req@ffff8dc006710e00 x1875453361270912/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575673 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575648.931698:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361270912/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575673 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575648.931705:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575648.931708:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575648.931711:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361270912:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575648.931716:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361271040:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575648.931733:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575648.931743:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575648/real 1788575648]  req@ffff8dc006713100 x1875453361271040/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575673 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575648.931754:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361271040/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575673 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575648.931762:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575648.931765:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575648.931768:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361271040:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575649.314977:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575649.314977:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575649.314990:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575649.315088:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575649.315113:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575649.315146:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575649.954986:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575650.338973:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575650.338973:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575650.338989:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575650.339006:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575650.339014:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575650.339016:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575650.978980:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575651.362929:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575651.362939:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575651.362951:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575651.362967:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575651.362977:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575651.362989:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575652.002965:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575652.386963:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575652.386963:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575652.386971:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575652.387068:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575652.387110:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575652.387154:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575653.026935:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575653.410981:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575653.410987:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575653.410988:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575653.411049:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575653.411112:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575653.411160:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575654.050937:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788575654.050938:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575654.050944:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788575654.050947:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575654.050956:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 3999
00000100:00080000:0.0:1788575654.050965:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575654.050972:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575654.051006:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361271168/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575654.051025:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575654.051028:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575654.051030:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575654.051034:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3999
00000100:00080000:0.0:1788575654.051038:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575654.051041:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575654.051050:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575654.051055:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361271168:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788575654.051061:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361271296/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575654.051074:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575654.051076:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575654.051078:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575654.051081:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3999
00000100:00080000:0.0:1788575654.051083:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575654.051087:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575654.051090:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575654.051100:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361271424/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575654.051107:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1788575654.051108:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788575654.051110:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575654.051111:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575654.051114:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 3999
00000100:00080000:0.0:1788575654.051117:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575654.051119:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575654.051123:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575654.051131:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361271552/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575654.051139:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788575654.051141:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575654/real 1788575654]  req@ffff8dc006712680 x1875453361271168/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575679 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575654.051142:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575654.051143:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575654.051147:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3999
00000100:00080000:0.0:1788575654.051150:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575654.051153:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575654.051156:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361271168/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575679 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575654.051165:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1788575654.051166:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788575654.051168:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575654.051172:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361271168:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788575654.051175:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453361271680/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575654.051182:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575654.051185:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575654.051186:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575654.051189:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3999
00000100:00100000:3.0:1788575654.051191:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361271296:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788575654.051192:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575654.051195:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575654.051199:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575654.051207:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361271808/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788575654.051209:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788575654.051215:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575654.051218:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575654.051220:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788575654.051220:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575654/real 1788575654]  req@ffff8dc006713480 x1875453361271296/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575679 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575654.051223:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 3999
00000100:00080000:0.0:1788575654.051226:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575654.051229:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575654.051231:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361271296/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575679 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1788575654.051233:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575654.051241:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361271936/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575654.051246:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575654.051249:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575654.051252:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361271296:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575654.051257:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361271424:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575654.051275:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575654.051284:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575654/real 1788575654]  req@ffff8dc006713800 x1875453361271424/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575679 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575654.051295:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361271424/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575679 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575654.051303:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575654.051306:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575654.051309:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361271424:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575654.051315:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361271552:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575654.051330:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575654.051337:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575654/real 1788575654]  req@ffff8dc006712300 x1875453361271552/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575679 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575654.051343:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361271552/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575679 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575654.051349:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575654.051351:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575654.051353:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361271552:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575654.051356:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361271680:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575654.051365:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575654.051370:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575654/real 1788575654]  req@ffff8dc006710380 x1875453361271680/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575679 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575654.051377:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453361271680/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575679 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575654.051381:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575654.051383:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575654.051384:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361271680:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575654.051394:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361271808:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575654.051423:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575654.051430:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575654/real 1788575654]  req@ffff8dc006711c00 x1875453361271808/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575679 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575654.051437:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361271808/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575679 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575654.051442:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575654.051443:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575654.051445:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361271808:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575654.051448:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361271936:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575654.051458:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575654.051463:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575654/real 1788575654]  req@ffff8dc006712680 x1875453361271936/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575679 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575654.051470:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361271936/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575679 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575654.051474:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575654.051476:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575654.051477:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361271936:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575654.434971:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575654.434971:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575654.434971:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575654.434971:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575654.435013:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575654.435040:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575655.074962:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575655.458976:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575655.458976:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575655.458976:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575655.459016:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575655.459022:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575655.459023:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575656.098961:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575656.482963:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575656.482963:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575656.482967:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575656.482990:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575656.483000:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575656.483003:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575657.122994:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575657.506996:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575657.506996:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575657.507031:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575657.507097:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575657.507112:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575657.507121:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575658.147008:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575658.530992:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575658.531012:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575658.531014:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575658.531047:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575658.531068:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575658.531089:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575659.170990:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575659.170991:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575659.170997:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575659.171001:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575659.171011:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4004
00000100:00080000:1.0:1788575659.171020:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575659.171027:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575659.171062:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361272064/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575659.171086:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575659.171089:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575659.171091:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575659.171094:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4004
00000100:00080000:1.0:1788575659.171098:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575659.171101:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575659.171111:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575659.171126:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361272192/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575659.171129:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361272064:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788575659.171152:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575659.171155:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575659.171157:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575659.171162:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4004
00000100:00080000:1.0:1788575659.171165:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575659.171169:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575659.171175:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575659.171187:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361272320/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575659.171196:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1788575659.171199:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788575659.171202:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575659.171206:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575659.171211:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4004
00000100:00080000:1.0:1788575659.171218:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575659.171221:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575659.171225:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575659.171240:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361272448/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575659.171240:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575659/real 1788575659]  req@ffff8dc005dc2d80 x1875453361272064/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575684 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575659.171266:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575659.171274:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575659.171275:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575659.171280:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4004
00000100:00100000:3.0:1788575659.171285:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361272064/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575684 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575659.171286:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575659.171296:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:3.0:1788575659.171298:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:1.0:1788575659.171300:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788575659.171306:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575659.171311:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361272064:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788575659.171315:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361272576/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575659.171327:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575659.171331:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575659.171333:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788575659.171337:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361272192:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788575659.171346:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4004
00000100:00080000:1.0:1788575659.171350:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575659.171355:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575659.171360:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788575659.171363:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575659.171376:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361272704/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575659.171378:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575659/real 1788575659]  req@ffff8dc005dc3800 x1875453361272192/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575684 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575659.171409:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575659.171413:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575659.171415:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788575659.171420:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361272192/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575684 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575659.171422:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4004
00000100:00080000:1.0:1788575659.171429:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575659.171436:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:3.0:1788575659.171438:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:1.0:1788575659.171441:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788575659.171445:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575659.171451:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361272192:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788575659.171457:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361272832/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575659.171459:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361272320:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575659.171491:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575659.171502:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575659/real 1788575659]  req@ffff8dc005dc1500 x1875453361272320/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575684 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575659.171513:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361272320/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575684 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575659.171521:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575659.171524:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575659.171527:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361272320:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575659.171532:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361272448:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575659.171558:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575659.171569:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575659/real 1788575659]  req@ffff8dc005dc0a80 x1875453361272448/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575684 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575659.171580:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361272448/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575684 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575659.171588:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575659.171590:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575659.171592:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361272448:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575659.171597:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361272576:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575659.171611:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575659.171620:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575659/real 1788575659]  req@ffff8dc005dc1c00 x1875453361272576/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575684 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575659.171631:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361272576/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575684 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575659.171640:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575659.171642:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575659.171645:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361272576:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575659.171661:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361272704:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575659.171681:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575659.171691:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575659/real 1788575659]  req@ffff8dc005dc0700 x1875453361272704/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575684 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575659.171709:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361272704/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575684 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575659.171724:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575659.171727:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575659.171730:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361272704:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575659.171735:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361272832:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575659.171751:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575659.171760:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575659/real 1788575659]  req@ffff8dc005dc3b80 x1875453361272832/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575684 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575659.171770:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361272832/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575684 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575659.171778:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575659.171781:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575659.171784:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361272832:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575659.554994:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575659.554994:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575659.554998:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575659.555034:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575659.555036:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575659.555059:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575660.194977:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575660.579004:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575660.579004:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575660.579004:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575660.579043:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575660.579046:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575660.579046:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575661.218998:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575661.603012:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575661.603012:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575661.603012:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575661.603045:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575661.603050:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575661.603051:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575662.243007:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575662.626998:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575662.627003:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575662.627006:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575662.627040:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575662.627048:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575662.627053:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575663.266966:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575663.651041:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575663.651041:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575663.651042:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575663.651057:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575663.651086:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575663.651103:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575664.291036:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575664.292094:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575664.292098:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788575664.292102:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575664.292112:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4009
00000100:00080000:0.0:1788575664.292123:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575664.292131:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575664.292168:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361272960/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575664.292191:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575664.292195:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575664.292196:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575664.292201:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4009
00000100:00080000:0.0:1788575664.292204:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575664.292208:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575664.292217:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575664.292229:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361273088/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575664.292238:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575664.292241:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575664.292243:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575664.292247:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4009
00000100:00080000:0.0:1788575664.292249:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575664.292253:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575664.292257:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575664.292268:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361273216/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575664.292289:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575664.292293:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575664.292294:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575664.292298:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4009
00000100:00080000:0.0:1788575664.292302:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575664.292306:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575664.292311:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575664.292324:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361273344/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575664.292343:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575664.292347:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575664.292349:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575664.292354:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4009
00000100:00080000:0.0:1788575664.292357:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575664.292361:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575664.292366:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575664.292378:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361273472/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575664.292386:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575664.292389:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575664.292390:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575664.292394:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4009
00000100:00080000:0.0:1788575664.292397:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575664.292409:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575664.292414:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575664.292426:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361273600/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575664.292434:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575664.292437:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575664.292439:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575664.292442:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4009
00000100:00080000:0.0:1788575664.292446:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575664.292449:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575664.292452:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575664.292462:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361273728/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575664.292938:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361272960:192.168.202.140@tcp:250:kworker.0
00000800:00000100:3.0:1788575664.293154:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575664.293193:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575664/real 1788575664]  req@ffff8dc006713100 x1875453361272960/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575689 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575664.293211:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361272960/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575689 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575664.293262:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575664.293268:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575664.293272:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361272960:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788575664.293305:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361273088:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575664.293325:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575664.293334:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575664/real 1788575664]  req@ffff8dc006710e00 x1875453361273088/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575689 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575664.293345:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361273088/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575689 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575664.293356:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575664.293359:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575664.293362:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361273088:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575664.293368:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361273216:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575664.293389:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575664.293491:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575664/real 1788575664]  req@ffff8dc006711500 x1875453361273216/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575689 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575664.293504:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361273216/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575689 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575664.293512:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575664.293515:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575664.293518:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361273216:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575664.293524:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361273344:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575664.293546:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575664.293557:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575664/real 1788575664]  req@ffff8dc006711880 x1875453361273344/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575689 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575664.293567:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361273344/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575689 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575664.293575:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575664.293578:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575664.293581:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361273344:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575664.293587:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361273472:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575664.293612:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575664.293624:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575664/real 1788575664]  req@ffff8dc006713b80 x1875453361273472/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575689 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575664.293634:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361273472/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575689 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575664.293644:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575664.293647:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575664.293650:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361273472:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575664.293656:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361273600:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575664.293676:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575664.293687:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575664/real 1788575664]  req@ffff8dc006712a00 x1875453361273600/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575689 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575664.293697:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361273600/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575689 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575664.293705:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575664.293708:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575664.293711:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361273600:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575664.293716:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361273728:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575664.293734:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575664.293743:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575664/real 1788575664]  req@ffff8dc006712680 x1875453361273728/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575689 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575664.293753:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361273728/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575689 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575664.293760:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575664.293763:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575664.293766:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361273728:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575664.674981:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575664.674982:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575664.674982:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575664.675010:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575664.675030:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575664.675044:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575665.314990:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575665.698987:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575665.698987:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575665.699011:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575665.699016:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788575665.699029:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575665.699049:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575666.338976:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575666.722980:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575666.722980:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575666.722980:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575666.723180:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575666.723197:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575666.723245:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575667.362990:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575667.746977:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575667.746984:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575667.747008:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575667.747026:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575667.747028:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575667.747043:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575668.386982:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575668.770991:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575668.770995:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575668.772610:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788575668.772682:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575668.774448:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575668.774487:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575669.410952:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788575669.410958:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575669.410963:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788575669.410967:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575669.410983:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4015
00000100:00080000:2.0:1788575669.410993:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575669.410999:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575669.411037:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361273856/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575669.411059:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575669.411062:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575669.411065:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575669.411069:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4015
00000100:00080000:2.0:1788575669.411072:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575669.411075:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575669.411089:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575669.411100:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361273856:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788575669.411101:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453361273984/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575669.411113:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575669.411115:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575669.411116:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575669.411118:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4015
00000100:00080000:2.0:1788575669.411121:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575669.411123:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575669.411126:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575669.411134:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453361274112/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575669.411145:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575669.411147:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575669.411149:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575669.411154:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4015
00000100:00080000:2.0:1788575669.411156:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575669.411158:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575669.411161:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788575669.411163:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575669.411170:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453361274240/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575669.411177:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575669.411179:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575669.411181:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575669.411183:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4015
00000100:00080000:2.0:1788575669.411184:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575669.411186:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575669.411189:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575669.411197:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361274368/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575669.411203:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575669/real 1788575669]  req@ffff8dc020494700 x1875453361273856/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575694 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575669.411206:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575669.411221:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575669.411223:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788575669.411226:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361273856/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575694 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575669.411235:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4015
00000100:00080000:2.0:1788575669.411242:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575669.411243:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575669.411248:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:3.0:1788575669.411252:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000008:00100000:2.0:1788575669.411256:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575669.411258:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361273856:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788575669.411269:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453361274496/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575669.411276:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575669.411278:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575669.411279:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788575669.411283:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361273984:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788575669.411284:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4015
00000100:00080000:2.0:1788575669.411289:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575669.411292:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575669.411295:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575669.411303:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361274624/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788575669.411311:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575669.411324:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575669/real 1788575669]  req@ffff8dc020496d80 x1875453361273984/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575694 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575669.411336:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453361273984/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575694 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575669.411346:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575669.411349:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575669.411352:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361273984:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575669.411359:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361274112:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575669.411374:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575669.411382:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575669/real 1788575669]  req@ffff8dc020494380 x1875453361274112/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575694 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575669.411393:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453361274112/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575694 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575669.411414:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575669.411417:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575669.411420:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361274112:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575669.411425:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361274240:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575669.411441:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575669.411450:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575669/real 1788575669]  req@ffff8dc020497100 x1875453361274240/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575694 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575669.411460:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453361274240/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575694 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575669.411475:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575669.411477:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575669.411480:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361274240:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575669.411486:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361274368:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575669.411500:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575669.411507:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575669/real 1788575669]  req@ffff8dc020495180 x1875453361274368/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575694 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575669.411518:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361274368/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575694 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575669.411525:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575669.411528:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575669.411531:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361274368:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575669.411537:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361274496:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575669.411556:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575669.411564:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575669/real 1788575669]  req@ffff8dc020497480 x1875453361274496/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575694 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575669.411575:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453361274496/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575694 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575669.411581:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575669.411584:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575669.411588:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361274496:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575669.411603:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361274624:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575669.411617:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575669.411625:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575669/real 1788575669]  req@ffff8dc020494700 x1875453361274624/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575694 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575669.411636:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361274624/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575694 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575669.411643:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575669.411646:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575669.411649:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361274624:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575669.794976:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575669.794976:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575669.794979:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575669.794990:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575669.795007:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575669.795041:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575670.434978:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575670.818958:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575670.818958:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575670.818958:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575670.818988:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575670.818998:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575670.819000:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575671.458947:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575671.842965:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575671.842976:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575671.842988:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575671.842993:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575671.842996:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575671.843011:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575672.482956:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575672.866982:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575672.866983:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575672.867022:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575672.867022:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575672.867022:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575672.867027:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575673.506971:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575673.890966:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575673.890966:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575673.890983:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575673.890998:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575673.890999:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575673.890999:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575674.530950:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575674.530956:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575674.530962:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788575674.530965:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575674.530972:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4020
00000100:00080000:0.0:1788575674.530979:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575674.530984:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575674.531013:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361274752/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575674.531035:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575674.531038:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575674.531039:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575674.531042:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4020
00000100:00080000:0.0:1788575674.531043:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575674.531046:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575674.531053:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575674.531061:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453361274880/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575674.531068:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575674.531070:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575674.531071:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575674.531073:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4020
00000100:00080000:0.0:1788575674.531075:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788575674.531079:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361274752:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788575674.531080:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575674.531093:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575674.531110:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361275008/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575674.531120:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575674.531123:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575674.531125:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575674.531129:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4020
00000100:00080000:0.0:1788575674.531133:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575674.531137:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575674.531142:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788575674.531143:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575674.531158:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361275136/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575674.531166:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575674.531169:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575674.531171:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575674.531176:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4020
00000100:00080000:0.0:1788575674.531179:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575674.531183:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575674.531188:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575674.531198:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575674/real 1788575674]  req@ffff8dc006711c00 x1875453361274752/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575699 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575674.531201:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361275264/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575674.531225:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361274752/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575699 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575674.531228:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575674.531237:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575674.531241:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575674.531243:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575674.531248:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4020
00000100:00080000:3.0:1788575674.531252:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788575674.531255:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788575674.531258:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361274752:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788575674.531262:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575674.531266:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361274880:192.168.202.140@tcp:38:kworker.0
00000008:00100000:0.0:1788575674.531268:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575674.531280:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361275392/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788575674.531291:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788575674.531293:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575674.531296:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575674.531298:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575674.531301:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4020
00000100:00080000:0.0:1788575674.531304:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788575674.531307:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575674/real 1788575674]  req@ffff8dc006710380 x1875453361274880/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575699 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575674.531308:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575674.531312:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575674.531322:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361275520/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575674.531328:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453361274880/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575699 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575674.531350:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575674.531354:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575674.531357:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361274880:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575674.531378:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361275008:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575674.531420:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575674.531429:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575674/real 1788575674]  req@ffff8dc006712300 x1875453361275008/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575699 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575674.531436:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361275008/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575699 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575674.531445:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575674.531447:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575674.531449:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361275008:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575674.531452:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361275136:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575674.531463:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575674.531468:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575674/real 1788575674]  req@ffff8dc006713800 x1875453361275136/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575699 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575674.531475:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361275136/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575699 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575674.531480:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575674.531481:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575674.531483:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361275136:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575674.531486:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361275264:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575674.531495:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575674.531500:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575674/real 1788575674]  req@ffff8dc006713480 x1875453361275264/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575699 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575674.531506:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361275264/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575699 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575674.531511:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575674.531512:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575674.531514:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361275264:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575674.531518:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361275392:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575674.531526:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575674.531531:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575674/real 1788575674]  req@ffff8dc006712680 x1875453361275392/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575699 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575674.531536:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361275392/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575699 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575674.531541:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575674.531542:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575674.531544:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361275392:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575674.531553:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361275520:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575674.531569:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575674.531578:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575674/real 1788575674]  req@ffff8dc006712a00 x1875453361275520/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575699 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575674.531589:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361275520/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575699 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575674.531596:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575674.531599:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575674.531602:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361275520:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575674.914981:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575674.914981:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575674.914981:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575674.915012:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575674.915013:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575674.915014:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575675.555027:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575675.939004:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575675.939021:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575675.939035:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575675.939109:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575675.939130:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575675.939148:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575676.579001:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575676.963051:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575676.963066:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575676.963069:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575676.963180:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575676.963294:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575676.963651:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575677.603165:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575677.987003:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575677.987010:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575677.987024:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575677.987050:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575677.987065:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788575677.987098:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575678.627008:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575679.010982:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575679.010984:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575679.011022:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575679.011103:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575679.011115:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575679.011156:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575679.650985:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575679.651077:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575679.651081:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788575679.651084:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575679.651093:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4025
00000100:00080000:0.0:1788575679.651101:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575679.651109:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575679.651143:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361275648/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575679.651164:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575679.651166:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575679.651168:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575679.651178:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4025
00000100:00080000:0.0:1788575679.651182:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575679.651185:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575679.651195:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575679.651208:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361275776/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575679.651216:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575679.651219:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575679.651220:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575679.651224:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4025
00000100:00080000:0.0:1788575679.651227:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575679.651230:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575679.651234:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575679.651244:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361275904/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575679.651249:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575679.651251:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575679.651252:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575679.651254:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4025
00000100:00080000:0.0:1788575679.651256:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575679.651258:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575679.651261:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575679.651266:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361276032/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575679.651271:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575679.651273:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575679.651274:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575679.651277:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4025
00000100:00080000:0.0:1788575679.651278:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575679.651288:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575679.651295:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575679.651304:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361276160/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575679.651313:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575679.651316:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575679.651317:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575679.651321:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4025
00000100:00080000:0.0:1788575679.651324:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575679.651327:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575679.651331:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575679.651342:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361276288/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575679.651349:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575679.651352:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575679.651354:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575679.651357:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4025
00000100:00080000:0.0:1788575679.651360:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575679.651363:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575679.651368:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575679.651376:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361276416/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575679.651450:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361275648:192.168.202.140@tcp:250:kworker.0
00000800:00000100:3.0:1788575679.651508:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575679.651544:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575679/real 1788575679]  req@ffff8dc006713b80 x1875453361275648/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575704 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575679.651558:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361275648/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575704 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575679.651567:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575679.651571:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575679.651574:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361275648:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788575679.651580:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361275776:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575679.651601:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575679.651613:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575679/real 1788575679]  req@ffff8dc006711880 x1875453361275776/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575704 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575679.651624:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361275776/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575704 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575679.651638:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575679.651642:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575679.651645:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361275776:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575679.651651:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361275904:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575679.651671:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575679.651692:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575679/real 1788575679]  req@ffff8dc006711500 x1875453361275904/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575704 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575679.651703:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361275904/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575704 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575679.651711:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575679.651714:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575679.651717:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361275904:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575679.651723:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361276032:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575679.651742:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575679.651752:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575679/real 1788575679]  req@ffff8dc006710e00 x1875453361276032/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575704 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575679.651759:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361276032/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575704 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575679.651766:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575679.651769:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575679.651773:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361276032:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575679.651778:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361276160:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575679.651795:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575679.651805:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575679/real 1788575679]  req@ffff8dc006713100 x1875453361276160/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575704 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575679.651817:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361276160/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575704 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575679.651825:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575679.651828:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575679.651831:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361276160:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575679.651837:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361276288:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575679.651852:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575679.651861:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575679/real 1788575679]  req@ffff8dc006712a00 x1875453361276288/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575704 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575679.651892:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361276288/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575704 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575679.651900:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575679.651903:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575679.651906:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361276288:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575679.651911:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361276416:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575679.651931:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575679.651942:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575679/real 1788575679]  req@ffff8dc006712680 x1875453361276416/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575704 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575679.651954:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361276416/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575704 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575679.651961:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575679.651964:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575679.651967:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361276416:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575680.034986:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575680.034995:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575680.035014:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575680.035480:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575680.035489:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575680.035500:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575680.674975:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575681.058996:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575681.059020:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575681.059037:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575681.059479:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575681.059537:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788575681.059567:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575681.698976:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575682.082976:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575682.082976:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575682.082984:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575682.083117:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575682.083165:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575682.083218:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575682.722994:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575683.107013:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575683.107014:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575683.107015:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575683.107015:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575683.107056:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788575683.107108:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575683.746970:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575684.130984:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575684.130984:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575684.131116:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575684.131165:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575684.131170:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575684.131789:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575684.770976:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788575684.770983:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575684.770987:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788575684.770994:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575684.771004:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4030
00000100:00080000:0.0:1788575684.771015:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575684.771023:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575684.771066:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361276544/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575684.771095:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575684.771099:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575684.771100:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575684.771104:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4030
00000100:00080000:0.0:1788575684.771108:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575684.771112:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575684.771122:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575684.771134:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361276672/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575684.771144:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575684.771148:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575684.771150:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788575684.771155:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361276544:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788575684.771156:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4030
00000100:00080000:0.0:1788575684.771163:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575684.771169:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575684.771174:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575684.771187:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361276800/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575684.771197:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575684.771200:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575684.771202:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575684.771206:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4030
00000100:00080000:0.0:1788575684.771210:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575684.771214:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575684.771219:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575684.771231:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453361276928/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575684.771240:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575684.771243:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575684.771245:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575684.771249:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4030
00000100:00080000:0.0:1788575684.771252:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575684.771256:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575684.771261:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575684.771272:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361277056/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575684.771274:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361276672:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788575684.771289:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575684.771293:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575684.771295:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575684.771300:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4030
00000100:00080000:0.0:1788575684.771304:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575684.771308:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575684.771313:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575684.771319:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361276800:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575684.771327:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361277184/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575684.771338:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575684.771342:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575684.771344:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788575684.771348:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361276928:192.168.202.140@tcp:8:kworker.0
00000100:00080000:0.0:1788575684.771351:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4030
00000100:00080000:0.0:1788575684.771369:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788575684.771370:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361277056:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788575684.771377:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575684.771383:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575684.771417:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361277184:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575684.771424:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361277312/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575684.771449:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361277312:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575685.154973:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575685.154974:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575685.154974:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788575685.154999:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575685.155002:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575685.155017:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575685.794964:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575686.178984:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575686.178984:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575686.178998:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575686.179022:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575686.179032:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575686.179040:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575686.818965:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575687.202970:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575687.202972:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575687.202984:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575687.203012:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575687.203017:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788575687.203018:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575687.842986:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000400:00000100:1.0:1788575687.843116:0:2334:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.140:988
00000400:00000100:1.0:1788575687.843152:0:2334:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.140@tcp at host 192.168.202.140 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:1.0:1788575687.843168:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788575687.843205:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788575687.843213:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788575687.843220:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788575687.843228:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788575687.843238:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788575687.843247:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:3.0:1788575687.843258:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575684/real 1788575687]  req@ffff8dc006712680 x1875453361277184/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575709 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575687.843283:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361277184/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575709 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575687.843293:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575687.843297:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575687.843301:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361277184:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575687.843308:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575684/real 1788575687]  req@ffff8dc006712300 x1875453361276800/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575709 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575687.843320:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361276800/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575709 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575687.843328:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575687.843332:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575687.843341:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361276800:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575687.843348:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575684/real 1788575687]  req@ffff8dc006710380 x1875453361276928/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575709 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575687.843359:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453361276928/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575709 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575687.843368:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575687.843370:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575687.843373:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361276928:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575687.843378:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575684/real 1788575687]  req@ffff8dc006711c00 x1875453361277056/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575709 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575687.843387:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361277056/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575709 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575687.843426:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575687.843429:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575687.843432:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361277056:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575687.843437:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575684/real 1788575687]  req@ffff8dc006713480 x1875453361276544/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575709 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575687.843449:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361276544/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575709 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575687.843456:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575687.843458:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575687.843461:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361276544:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788575687.843467:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575684/real 1788575687]  req@ffff8dc006713800 x1875453361276672/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575709 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575687.843476:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361276672/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575709 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575687.843484:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575687.843487:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575687.843489:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361276672:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575687.843513:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575684/real 1788575687]  req@ffff8dc006712a00 x1875453361277312/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575709 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575687.843523:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361277312/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575709 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575687.843529:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575687.843532:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575687.843534:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361277312:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575688.226964:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575688.226965:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575688.227078:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575688.227090:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788575688.227148:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575688.227180:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575688.866942:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575689.250984:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575689.250984:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575689.250991:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575689.251017:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788575689.251017:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575689.251036:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575689.890958:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788575689.890960:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575689.890969:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788575689.890973:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575689.890983:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4035
00000100:00080000:0.0:1788575689.890992:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575689.890999:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575689.891039:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361277440/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575689.891065:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575689.891069:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575689.891071:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575689.891074:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4035
00000100:00080000:0.0:1788575689.891086:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575689.891091:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575689.891100:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361277440:192.168.202.140@tcp:250:kworker.0
00000008:00100000:0.0:1788575689.891101:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575689.891118:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361277568/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575689.891129:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575689.891139:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575689.891141:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575689.891145:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4035
00000100:00080000:0.0:1788575689.891149:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575689.891154:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575689.891159:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788575689.891165:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575689.891174:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361277696/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575689.891184:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575689.891188:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575689.891190:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575689.891193:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4035
00000100:00080000:0.0:1788575689.891197:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575689.891201:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575689.891206:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575689.891211:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575689/real 1788575689]  req@ffff8dc006713100 x1875453361277440/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575714 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575689.891221:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361277824/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575689.891235:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361277440/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575714 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575689.891242:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575689.891249:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575689.891251:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575689.891252:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575689.891259:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788575689.891261:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4035
00000100:00100000:3.0:1788575689.891267:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361277440:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788575689.891268:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575689.891276:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575689.891281:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575689.891293:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361277952/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575689.891303:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575689.891308:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:3.0:1788575689.891308:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361277568:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788575689.891312:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575689.891319:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4035
00000100:00080000:0.0:1788575689.891323:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575689.891326:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575689.891332:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788575689.891339:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575689.891346:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361278080/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575689.891354:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575689/real 1788575689]  req@ffff8dc006710e00 x1875453361277568/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575714 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575689.891360:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575689.891367:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575689.891369:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788575689.891373:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361277568/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575714 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575689.891375:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4035
00000100:00080000:0.0:1788575689.891382:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575689.891390:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:3.0:1788575689.891401:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1788575689.891407:0:36:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788575689.891408:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575689.891415:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361277568:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575689.891426:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361277696:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575689.891427:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361278208/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788575689.891451:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575689.891463:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575689/real 1788575689]  req@ffff8dc006711500 x1875453361277696/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575714 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575689.891474:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361277696/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575714 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575689.891482:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575689.891485:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575689.891488:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361277696:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575689.891494:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361277824:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575689.891510:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575689.891519:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575689/real 1788575689]  req@ffff8dc006711880 x1875453361277824/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575714 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575689.891529:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361277824/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575714 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575689.891536:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575689.891539:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575689.891541:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361277824:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575689.891546:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361277952:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575689.891566:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575689.891575:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575689/real 1788575689]  req@ffff8dc006713b80 x1875453361277952/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575714 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575689.891586:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361277952/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575714 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575689.891593:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575689.891596:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575689.891598:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361277952:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575689.891613:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361278080:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575689.891630:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575689.891639:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575689/real 1788575689]  req@ffff8dc006713100 x1875453361278080/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575714 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575689.891649:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361278080/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575714 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575689.893126:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575689.893135:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575689.893140:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361278080:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575689.893151:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361278208:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575689.893207:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575689.893229:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575689/real 1788575689]  req@ffff8dc006712a00 x1875453361278208/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575714 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575689.893243:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361278208/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575714 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575689.893251:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575689.893254:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575689.893257:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361278208:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575690.274986:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575690.275001:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575690.275108:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575690.275124:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575690.275167:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575690.275197:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575690.914947:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575691.299002:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575691.299002:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575691.299006:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575691.299058:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575691.299065:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788575691.299096:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575691.938936:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575692.322982:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575692.322983:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575692.323013:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575692.323029:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788575692.323060:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575692.325492:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575692.962985:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575693.346947:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575693.346947:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575693.346952:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575693.346956:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575693.346976:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788575693.347032:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575693.986985:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575694.370934:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575694.370950:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575694.370953:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575694.370956:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575694.370969:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788575694.371021:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1788575695.010991:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788575695.010999:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788575695.010999:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788575695.011004:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575695.011012:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4040
00000100:00080000:2.0:1788575695.011020:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575695.011027:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575695.011060:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453361278336/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575695.011081:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575695.011084:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575695.011085:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575695.011088:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4040
00000100:00080000:2.0:1788575695.011090:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575695.011093:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575695.011100:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575695.011109:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361278464/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575695.011115:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575695.011118:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575695.011119:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575695.011121:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4040
00000100:00080000:2.0:1788575695.011123:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575695.011127:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575695.011128:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361278336:192.168.202.140@tcp:250:kworker.0
00000008:00100000:2.0:1788575695.011130:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575695.011137:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361278592/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575695.011147:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575695.011150:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575695.011151:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575695.011153:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4040
00000100:00080000:2.0:1788575695.011155:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575695.011156:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575695.011159:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575695.011169:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453361278720/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575695.011177:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575695.011180:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575695.011182:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575695.011185:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4040
00000100:00080000:2.0:1788575695.011190:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575695.011193:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575695.011197:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788575695.011203:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575695.011210:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453361278848/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575695.011219:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575695.011222:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575695.011223:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575695.011236:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4040
00000100:00080000:2.0:1788575695.011240:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788575695.011242:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575695/real 1788575695]  req@ffff8dc020496a00 x1875453361278336/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575720 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575695.011247:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575695.011254:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575695.011273:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361278976/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575695.011273:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453361278336/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575720 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575695.011295:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575695.011303:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575695.011303:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788575695.011309:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575695.011311:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788575695.011315:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361278336:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788575695.011316:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4040
00000100:00080000:2.0:1788575695.011321:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788575695.011326:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361278464:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788575695.011328:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575695.011335:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575695.011347:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361279104/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788575695.011362:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575695.011376:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575695/real 1788575695]  req@ffff8dc020494000 x1875453361278464/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575720 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575695.011410:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361278464/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575720 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575695.011418:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575695.011420:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575695.011422:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361278464:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575695.011444:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361278592:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575695.011460:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575695.011473:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575695/real 1788575695]  req@ffff8dc020495880 x1875453361278592/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575720 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575695.011480:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361278592/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575720 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575695.011489:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575695.011491:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575695.011493:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361278592:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575695.011496:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361278720:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575695.011507:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575695.011512:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575695/real 1788575695]  req@ffff8dc020494e00 x1875453361278720/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575720 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575695.011519:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453361278720/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575720 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575695.011530:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575695.011533:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575695.011536:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361278720:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575695.011541:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361278848:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575695.011559:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575695.011569:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575695/real 1788575695]  req@ffff8dc020494a80 x1875453361278848/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575720 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575695.011580:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453361278848/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575720 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575695.011585:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575695.011587:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575695.011590:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361278848:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575695.011593:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361278976:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575695.011605:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575695.011611:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575695/real 1788575695]  req@ffff8dc020495500 x1875453361278976/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575720 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575695.011618:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361278976/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575720 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575695.011622:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575695.011624:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575695.011625:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361278976:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575695.011628:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361279104:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575695.011637:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575695.011641:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575695/real 1788575695]  req@ffff8dc020494700 x1875453361279104/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575720 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575695.011648:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361279104/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575720 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575695.011652:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575695.011653:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575695.011655:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361279104:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575695.394961:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575695.394962:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575695.394962:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575695.394962:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575695.394990:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788575695.395049:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575696.034985:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575696.418959:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575696.418965:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788575696.419014:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575696.419070:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575696.419082:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575696.419103:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575697.058975:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575697.442958:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575697.442959:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575697.442960:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788575697.443033:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575697.443056:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575697.443091:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575698.082968:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575698.466945:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575698.467045:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575698.467071:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788575698.467117:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575698.467848:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575698.467862:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575699.106984:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575699.490976:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575699.490982:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788575699.491190:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575699.491266:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575699.491269:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575699.491281:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575700.130996:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575700.131430:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575700.131435:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575700.131439:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575700.131453:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4045
00000100:00080000:1.0:1788575700.131463:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575700.131471:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575700.131509:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361279232/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575700.131530:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575700.131534:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575700.131536:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575700.131541:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4045
00000100:00080000:1.0:1788575700.131545:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575700.131549:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575700.131558:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575700.131583:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361279360/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575700.131595:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788575700.131597:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361279232:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788575700.131602:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575700.131606:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575700.131611:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4045
00000100:00080000:1.0:1788575700.131616:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575700.131621:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575700.131626:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575700.131639:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361279488/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575700.131648:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575700.131652:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575700.131654:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575700.131658:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4045
00000100:00080000:1.0:1788575700.131663:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1788575700.131663:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788575700.131670:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575700.131676:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575700.131686:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361279616/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575700.131692:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575700.131695:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575700.131696:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575700.131698:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4045
00000100:00080000:1.0:1788575700.131700:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575700.131703:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575700.131705:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575700.131712:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575700/real 1788575700]  req@ffff8dc005dc1180 x1875453361279232/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575725 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575700.131714:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361279744/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575700.131742:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575700.131745:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575700.131746:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788575700.131752:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361279232/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575725 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575700.131753:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4045
00000100:00080000:1.0:1788575700.131758:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575700.131766:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:3.0:1788575700.131770:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:1.0:1788575700.131772:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788575700.131778:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575700.131784:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361279232:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788575700.131787:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361279872/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575700.131798:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575700.131801:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575700.131803:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575700.131807:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4045
00000100:00100000:3.0:1788575700.131808:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361279360:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788575700.131810:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575700.131815:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575700.131819:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575700.131830:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361280000/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788575700.131839:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575700.131855:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575700/real 1788575700]  req@ffff8dc005dc3b80 x1875453361279360/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575725 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575700.131890:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361279360/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575725 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575700.131907:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575700.131912:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575700.131917:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361279360:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575700.131925:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361279488:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575700.131949:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575700.131964:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575700/real 1788575700]  req@ffff8dc005dc0700 x1875453361279488/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575725 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575700.131977:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361279488/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575725 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575700.131985:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575700.131988:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575700.131991:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361279488:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575700.132007:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361279616:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575700.132027:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575700.132038:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575700/real 1788575700]  req@ffff8dc005dc1c00 x1875453361279616/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575725 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575700.132048:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361279616/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575725 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575700.132056:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575700.132059:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575700.132063:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361279616:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575700.132068:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361279744:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575700.132085:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575700.132094:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575700/real 1788575700]  req@ffff8dc005dc0a80 x1875453361279744/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575725 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575700.132105:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361279744/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575725 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575700.132119:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575700.132123:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575700.132126:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361279744:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575700.132132:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361279872:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575700.132150:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575700.132160:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575700/real 1788575700]  req@ffff8dc005dc1500 x1875453361279872/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575725 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575700.132180:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361279872/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575725 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575700.132189:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575700.132192:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575700.132195:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361279872:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575700.132212:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361280000:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575700.132239:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575700.132250:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575700/real 1788575700]  req@ffff8dc005dc3800 x1875453361280000/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575725 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575700.132261:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361280000/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575725 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575700.132268:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575700.132271:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575700.132274:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361280000:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575700.514980:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575700.514981:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575700.514983:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575700.515016:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575700.515017:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575700.515028:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575701.154985:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575701.538931:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575701.538954:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575701.538955:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575701.538968:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575701.538968:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575701.538975:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575702.179163:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575702.563030:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575702.563039:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575702.563040:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575702.563072:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575702.563079:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575702.563086:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575703.202979:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575703.586991:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575703.586994:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575703.587030:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575703.587271:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575703.587284:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575703.587309:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575704.226990:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575704.610978:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575704.610979:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575704.610984:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575704.611114:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575704.611126:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575704.611162:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1788575705.251136:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575705.251147:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575705.251152:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575705.251162:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4050
00000100:00080000:1.0:1788575705.251171:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575705.251177:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575705.251213:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361280128/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575705.251241:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575705.251244:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575705.251246:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575705.251250:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4050
00000100:00080000:1.0:1788575705.251253:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575705.251257:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575705.251266:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575705.251281:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361280256/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575705.251289:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361280128:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788575705.251293:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575705.251299:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575705.251300:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575705.251304:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4050
00000100:00080000:1.0:1788575705.251308:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575705.251312:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575705.251317:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575705.251329:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361280384/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575705.251340:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575705.251343:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000800:00000100:3.0:1788575705.251347:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788575705.251348:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575705.251354:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4050
00000100:00080000:1.0:1788575705.251359:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575705.251363:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575705.251367:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575705.251380:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361280512/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575705.251385:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575705/real 1788575705]  req@ffff8dc005dc2d80 x1875453361280128/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575730 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575705.251414:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575705.251418:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575705.251420:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788575705.251422:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361280128/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575730 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575705.251426:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4050
00000100:00080000:3.0:1788575705.251433:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575705.251434:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575705.251442:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:3.0:1788575705.251443:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000008:00100000:1.0:1788575705.251450:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575705.251451:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361280128:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788575705.251466:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361280640/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575705.251475:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575705.251478:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575705.251480:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575705.251485:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4050
00000100:00100000:3.0:1788575705.251489:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361280256:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788575705.251491:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575705.251499:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575705.251504:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575705.251516:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361280768/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788575705.251524:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788575705.251533:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575705.251537:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575705.251538:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575705.251543:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4050
00000100:00080000:1.0:1788575705.251546:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788575705.251550:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575705/real 1788575705]  req@ffff8dc005dc3800 x1875453361280256/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575730 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575705.251553:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575705.251562:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575705.251568:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361280256/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575730 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575705.251576:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361280896/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575705.251576:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575705.251586:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575705.251593:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361280256:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575705.251601:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361280384:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575705.251623:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575705.251633:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575705/real 1788575705]  req@ffff8dc005dc1500 x1875453361280384/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575730 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575705.251645:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361280384/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575730 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575705.251654:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575705.251657:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575705.251661:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361280384:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575705.251667:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361280512:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575705.251685:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575705.251686:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575705.251694:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575705/real 1788575705]  req@ffff8dc005dc0a80 x1875453361280512/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575730 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575705.251703:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361280512/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575730 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575705.251709:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575705.251711:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575705.251713:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361280512:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575705.251716:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361280640:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575705.251726:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575705.251732:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575705/real 1788575705]  req@ffff8dc005dc1c00 x1875453361280640/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575730 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575705.251738:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361280640/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575730 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575705.251751:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575705.251753:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575705.251755:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361280640:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575705.251767:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361280768:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575705.251777:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575705.251783:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575705/real 1788575705]  req@ffff8dc005dc0700 x1875453361280768/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575730 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575705.251790:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361280768/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575730 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575705.251794:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575705.251796:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575705.251798:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361280768:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575705.251801:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361280896:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575705.251809:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575705.251813:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575705/real 1788575705]  req@ffff8dc005dc3b80 x1875453361280896/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575730 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575705.251824:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361280896/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575730 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575705.251829:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575705.251830:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575705.251832:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361280896:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575705.634986:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575705.634986:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575705.634986:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575705.634987:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575705.635019:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575705.635051:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575706.275024:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575706.659024:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575706.659077:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575706.659513:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575706.659534:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575706.659676:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575706.659886:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575707.299037:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575707.682975:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575707.683008:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575707.683064:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575707.683126:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575707.683137:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575707.683333:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575708.322967:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575708.706980:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575708.706980:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575708.707092:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575708.707140:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575708.707432:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575708.707490:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575709.346938:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575709.730992:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575709.730992:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575709.730996:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575709.731023:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575709.731040:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788575709.731041:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1788575710.371008:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575710.371018:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788575710.371022:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575710.371030:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4056
00000100:00080000:2.0:1788575710.371038:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575710.371043:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575710.371072:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453361281024/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575710.371105:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575710.371109:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575710.371111:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575710.371116:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4056
00000100:00080000:2.0:1788575710.371120:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575710.371124:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575710.371137:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361281024:192.168.202.140@tcp:250:kworker.0
00000008:00100000:2.0:1788575710.371139:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575710.371158:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361281152/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575710.371168:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788575710.371168:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575710.371175:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575710.371177:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575710.371182:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4056
00000100:00080000:2.0:1788575710.371192:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575710.371197:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575710.371201:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788575710.371207:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575710.371213:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453361281280/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575710.371223:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575710.371226:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575710.371228:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575710.371232:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4056
00000100:00080000:2.0:1788575710.371236:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575710.371239:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575710.371244:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575710.371251:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575710/real 1788575710]  req@ffff8dc020497480 x1875453361281024/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575735 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575710.371256:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453361281408/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575710.371283:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575710.371286:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575710.371287:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575710.371292:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4056
00000100:00100000:3.0:1788575710.371293:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453361281024/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575735 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575710.371295:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575710.371301:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575710.371308:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788575710.371310:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575710.371315:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788575710.371318:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453361281536/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575710.371322:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361281024:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788575710.371331:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575710.371334:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575710.371335:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575710.371338:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4056
00000100:00080000:2.0:1788575710.371340:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575710.371342:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575710.371345:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575710.371348:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361281152:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575710.371355:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453361281664/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575710.371363:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575710.371366:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575710.371368:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575710.371372:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4056
00000800:00000100:3.0:1788575710.371376:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788575710.371378:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575710.371384:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575710.371400:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575710.371404:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575710/real 1788575710]  req@ffff8dc020495180 x1875453361281152/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575735 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575710.371415:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361281792/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575710.371422:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361281152/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575735 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575710.371435:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575710.371438:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575710.371440:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361281152:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575710.371446:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361281280:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575710.371463:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575710.371470:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575710/real 1788575710]  req@ffff8dc020497100 x1875453361281280/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575735 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575710.371477:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453361281280/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575735 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575710.371482:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575710.371484:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575710.371486:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361281280:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575710.371489:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361281408:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575710.371498:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575710.371502:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575710/real 1788575710]  req@ffff8dc020494380 x1875453361281408/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575735 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575710.371509:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453361281408/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575735 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575710.371515:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575710.371516:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575710.371518:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361281408:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575710.371521:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361281536:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575710.371530:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575710.371535:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575710/real 1788575710]  req@ffff8dc020496d80 x1875453361281536/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575735 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575710.371541:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453361281536/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575735 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575710.371546:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575710.371547:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575710.371549:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361281536:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575710.371560:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361281664:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575710.371568:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575710.371573:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575710/real 1788575710]  req@ffff8dc020497480 x1875453361281664/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575735 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575710.371579:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453361281664/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575735 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575710.371588:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575710.371590:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575710.371592:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361281664:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575710.371595:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361281792:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575710.371603:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575710.371608:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575710/real 1788575710]  req@ffff8dc020494700 x1875453361281792/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575735 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575710.371614:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361281792/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575735 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575710.371619:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575710.371620:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575710.371622:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361281792:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575710.754961:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575710.754961:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575710.754964:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575710.754990:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575710.754991:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575710.754995:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575711.394930:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575711.778966:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575711.778966:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575711.778972:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575711.778995:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788575711.779006:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575711.779011:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575712.418974:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575712.802989:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575712.802990:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575712.803131:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575712.803146:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575712.803157:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575712.803261:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575713.442951:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575713.826976:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575713.826989:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788575713.827009:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575713.827110:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575713.827134:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575713.827201:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575714.466965:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575714.851000:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788575714.851042:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575714.851130:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575714.851140:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575714.851296:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575714.851432:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575715.490975:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788575715.490975:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575715.490986:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788575715.490990:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575715.491000:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4061
00000100:00080000:3.0:1788575715.491010:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575715.491016:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575715.491045:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c380 x1875453361281920/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575715.491067:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575715.491069:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575715.491071:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575715.491073:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4061
00000100:00080000:3.0:1788575715.491075:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575715.491077:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575715.491085:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575715.491093:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f480 x1875453361282048/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575715.491100:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788575715.491101:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361281920:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788575715.491105:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575715.491108:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575715.491112:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4061
00000100:00080000:3.0:1788575715.491114:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575715.491116:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575715.491118:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575715.491126:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d180 x1875453361282176/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575715.491131:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575715.491133:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575715.491134:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575715.491136:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4061
00000100:00080000:3.0:1788575715.491139:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575715.491141:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575715.491144:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575715.491151:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e680 x1875453361282304/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575715.491159:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575715.491163:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575715.491164:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1788575715.491168:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788575715.491170:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4061
00000100:00080000:3.0:1788575715.491175:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575715.491180:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575715.491185:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575715.491195:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c700 x1875453361282432/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575715.491201:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575715.491203:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575715.491204:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575715.491207:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4061
00000100:00080000:3.0:1788575715.491211:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788575715.491214:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575715/real 1788575715]  req@ffff8dc00644c380 x1875453361281920/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575740 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575715.491225:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575715.491232:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575715.491242:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e300 x1875453361282560/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575715.491250:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453361281920/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575740 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575715.491272:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575715.491274:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575715.491275:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575715.491278:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575715.491282:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788575715.491284:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4061
00000100:00080000:3.0:1788575715.491289:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788575715.491291:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361281920:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788575715.491294:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575715.491301:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575715.491311:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d880 x1875453361282688/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575715.491316:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361282048:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575715.491341:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575715.491355:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575715/real 1788575715]  req@ffff8dc00644f480 x1875453361282048/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575740 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575715.491368:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453361282048/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575740 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575715.491377:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575715.491380:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575715.491412:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361282048:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575715.491419:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361282176:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575715.491440:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575715.491451:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575715/real 1788575715]  req@ffff8dc00644d180 x1875453361282176/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575740 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575715.491461:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453361282176/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575740 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575715.491470:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575715.491473:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575715.491476:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361282176:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575715.491482:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361282304:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575715.491501:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575715.491512:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575715/real 1788575715]  req@ffff8dc00644e680 x1875453361282304/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575740 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575715.491522:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453361282304/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575740 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575715.491528:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575715.491530:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575715.491532:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361282304:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575715.491536:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361282432:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575715.491554:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575715.491564:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575715/real 1788575715]  req@ffff8dc00644c700 x1875453361282432/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575740 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575715.491575:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453361282432/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575740 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575715.491584:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575715.491587:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575715.491590:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361282432:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575715.491594:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361282560:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575715.491607:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575715.491613:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575715/real 1788575715]  req@ffff8dc00644e300 x1875453361282560/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575740 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575715.491620:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453361282560/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575740 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575715.491625:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575715.491626:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575715.491628:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361282560:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575715.491640:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361282688:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575715.491649:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575715.491654:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575715/real 1788575715]  req@ffff8dc00644d880 x1875453361282688/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575740 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575715.491660:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d880 x1875453361282688/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575740 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575715.491665:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575715.491666:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575715.491668:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361282688:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575715.874931:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575715.874946:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575715.874971:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575715.874991:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575715.875004:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788575715.875015:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575716.514990:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575716.898992:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575716.899001:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575716.899091:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575716.899094:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575716.899113:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575716.899153:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575717.539000:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575717.922970:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575717.922998:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788575717.923002:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575717.923045:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575717.923056:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575717.923072:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575718.563031:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575718.946984:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575718.946990:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575718.947015:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575718.947027:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575718.947457:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575718.947483:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575719.586989:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575719.970979:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575719.970988:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575719.970995:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788575719.971113:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575719.971911:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575719.971959:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575720.610965:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788575720.610975:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575720.610980:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788575720.610983:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575720.610991:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4066
00000100:00080000:2.0:1788575720.610999:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575720.611005:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575720.611034:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361282816/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575720.611052:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575720.611054:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575720.611056:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575720.611058:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4066
00000100:00080000:2.0:1788575720.611061:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575720.611063:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575720.611071:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575720.611078:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361282816:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788575720.611081:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453361282944/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575720.611089:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575720.611091:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575720.611092:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575720.611094:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4066
00000100:00080000:2.0:1788575720.611096:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575720.611098:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575720.611101:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575720.611110:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453361283072/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575720.611118:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575720.611122:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575720.611123:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575720.611127:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4066
00000800:00000100:0.0:1788575720.611131:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788575720.611147:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575720.611155:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575720.611161:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575720.611174:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361283200/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575720.611180:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575720.611183:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575720.611184:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575720.611187:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4066
00000100:00080000:2.0:1788575720.611190:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788575720.611192:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575720/real 1788575720]  req@ffff8dc020495500 x1875453361282816/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575745 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575720.611195:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575720.611201:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575720.611219:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361282816/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575745 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575720.611228:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361283328/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575720.611232:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575720.611241:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788575720.611246:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788575720.611248:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361282816:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788575720.611251:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575720.611255:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575720.611261:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4066
00000100:00080000:2.0:1788575720.611265:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575720.611270:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575720.611275:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575720.611276:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361282944:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575720.611292:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453361283456/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575720.611303:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1788575720.611307:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788575720.611309:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575720.611313:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575720.611318:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4066
00000100:00080000:2.0:1788575720.611323:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575720.611327:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575720.611328:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575720/real 1788575720]  req@ffff8dc020494a80 x1875453361282944/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575745 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1788575720.611332:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575720.611344:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361283584/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575720.611350:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453361282944/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575745 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575720.611360:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575720.611362:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575720.611366:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361282944:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575720.611372:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361283072:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575720.611388:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575720.611395:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575720/real 1788575720]  req@ffff8dc020494e00 x1875453361283072/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575745 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575720.611402:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453361283072/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575745 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575720.611407:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575720.611409:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575720.611411:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361283072:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575720.611415:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361283200:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575720.611430:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575720.611440:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575720/real 1788575720]  req@ffff8dc020495880 x1875453361283200/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575745 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575720.611450:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361283200/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575745 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575720.611459:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575720.611462:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575720.611465:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361283200:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575720.611470:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361283328:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575720.611489:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575720.611499:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575720/real 1788575720]  req@ffff8dc020494000 x1875453361283328/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575745 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575720.611508:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361283328/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575745 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575720.611513:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575720.611515:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575720.611517:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361283328:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575720.611528:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361283456:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575720.611543:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575720.611553:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575720/real 1788575720]  req@ffff8dc020496a00 x1875453361283456/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575745 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575720.611563:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453361283456/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575745 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575720.611570:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575720.611573:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575720.611576:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361283456:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575720.611581:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361283584:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575720.611599:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575720.611609:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575720/real 1788575720]  req@ffff8dc020495500 x1875453361283584/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575745 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575720.611620:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361283584/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575745 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575720.611629:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575720.611631:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575720.611633:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361283584:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575720.995001:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575720.995001:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575720.995001:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575720.995132:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575720.995178:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575720.995190:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575721.634964:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575722.019009:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575722.019020:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575722.019028:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575722.019129:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575722.019148:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788575722.019197:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575722.658962:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575723.042993:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575723.042993:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575723.042993:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575723.043009:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575723.043058:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575723.043114:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575723.683009:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575724.067034:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575724.067034:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575724.067035:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575724.067075:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575724.067094:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575724.067114:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575724.707044:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575725.091032:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575725.091050:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575725.091051:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575725.091102:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575725.091102:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575725.091138:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575725.731006:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788575725.731024:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575725.731036:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788575725.731040:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575725.731049:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4071
00000100:00080000:3.0:1788575725.731059:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575725.731066:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575725.731099:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f100 x1875453361283712/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575725.731127:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575725.731131:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575725.731132:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575725.731136:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4071
00000100:00080000:3.0:1788575725.731139:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575725.731143:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575725.731153:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575725.731165:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ed80 x1875453361283840/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575725.731168:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361283712:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788575725.731183:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575725.731186:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575725.731188:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575725.731193:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4071
00000100:00080000:3.0:1788575725.731196:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575725.731199:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575725.731203:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575725.731222:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644df80 x1875453361283968/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575725.731232:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575725.731235:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575725.731242:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575725.731246:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4071
00000800:00000100:0.0:1788575725.731254:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788575725.731254:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575725.731261:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575725.731266:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575725.731279:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644fb80 x1875453361284096/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575725.731288:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575725.731291:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575725.731293:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788575725.731296:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575725/real 1788575725]  req@ffff8dc00644f100 x1875453361283712/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575750 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575725.731300:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4071
00000100:00080000:3.0:1788575725.731306:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575725.731312:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575725.731318:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575725.731323:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f100 x1875453361283712/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575750 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575725.731331:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d880 x1875453361284224/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575725.731343:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575725.731346:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575725.731348:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575725.731351:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575725.731352:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788575725.731360:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4071
00000100:00100000:0.0:1788575725.731361:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361283712:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788575725.731366:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575725.731372:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575725.731377:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575725.731387:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e300 x1875453361284352/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575725.731391:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361283840:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788575725.731404:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575725.731408:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575725.731410:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575725.731414:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4071
00000100:00080000:3.0:1788575725.731418:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1788575725.731424:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788575725.731424:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575725.731431:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575725.731443:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575725/real 1788575725]  req@ffff8dc00644ed80 x1875453361283840/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575750 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575725.731444:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c700 x1875453361284480/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575725.731480:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ed80 x1875453361283840/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575750 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575725.731492:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575725.731495:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575725.731498:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361283840:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575725.731504:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361283968:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575725.731523:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575725.731533:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575725/real 1788575725]  req@ffff8dc00644df80 x1875453361283968/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575750 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575725.731543:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644df80 x1875453361283968/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575750 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575725.731550:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575725.731553:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575725.731556:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361283968:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575725.731562:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361284096:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575725.731579:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575725.731597:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575725/real 1788575725]  req@ffff8dc00644fb80 x1875453361284096/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575750 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575725.731614:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644fb80 x1875453361284096/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575750 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575725.731623:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575725.731631:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575725.731633:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361284096:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575725.731639:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361284224:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575725.731658:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575725.731678:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575725/real 1788575725]  req@ffff8dc00644d880 x1875453361284224/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575750 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575725.731690:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d880 x1875453361284224/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575750 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575725.731698:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575725.731701:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575725.731704:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361284224:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575725.731728:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361284352:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575725.731744:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575725.731751:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575725/real 1788575725]  req@ffff8dc00644e300 x1875453361284352/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575750 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575725.731758:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453361284352/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575750 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575725.731766:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575725.731768:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575725.731770:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361284352:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575725.731773:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361284480:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575725.731789:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575725.731795:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575725/real 1788575725]  req@ffff8dc00644c700 x1875453361284480/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575750 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575725.731801:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453361284480/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575750 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575725.731806:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575725.731808:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575725.731809:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361284480:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575726.114974:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575726.114980:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575726.114981:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575726.115007:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575726.115015:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575726.115018:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575726.754980:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575727.139018:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575727.139048:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575727.139213:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575727.139242:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575727.139304:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575727.139331:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575727.778940:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575728.162989:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575728.162989:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575728.163004:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575728.163014:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575728.163030:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575728.163054:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575728.803644:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575729.186961:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575729.186961:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575729.186963:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575729.186965:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575729.186994:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575729.187032:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575729.826986:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575730.210962:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575730.210965:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575730.211115:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575730.211127:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575730.211571:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575730.211573:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575730.850977:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788575730.850979:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575730.850987:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788575730.850990:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575730.850998:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4076
00000100:00080000:2.0:1788575730.851005:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575730.851011:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575730.851040:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361284608/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575730.851061:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575730.851063:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575730.851064:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575730.851067:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4076
00000100:00080000:2.0:1788575730.851069:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575730.851070:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575730.851078:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575730.851087:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453361284736/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575730.851094:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361284608:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788575730.851101:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575730.851106:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575730.851108:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575730.851112:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4076
00000100:00080000:2.0:1788575730.851116:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575730.851120:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575730.851125:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575730.851135:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453361284864/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575730.851144:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575730.851147:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575730.851149:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575730.851153:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4076
00000100:00080000:2.0:1788575730.851157:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1788575730.851162:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788575730.851163:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575730.851170:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575730.851181:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453361284992/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575730.851187:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575730.851190:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575730.851191:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575730.851194:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4076
00000100:00080000:2.0:1788575730.851197:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575730.851199:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575730.851203:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575730.851206:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575730/real 1788575730]  req@ffff8dc020494700 x1875453361284608/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575755 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575730.851215:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453361285120/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575730.851226:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788575730.851230:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361284608/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575755 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575730.851231:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575730.851235:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575730.851241:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4076
00000100:00080000:2.0:1788575730.851245:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575730.851248:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575730.851253:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575730.851261:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361285248/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575730.851267:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575730.851269:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575730.851270:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575730.851272:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4076
00000100:00080000:2.0:1788575730.851273:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575730.851275:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575730.851278:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575730.851286:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361285376/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575730.851303:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575730.851308:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575730.851313:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361284608:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788575730.851330:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361284736:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575730.851347:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575730.851356:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575730/real 1788575730]  req@ffff8dc020497480 x1875453361284736/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575755 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575730.851363:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453361284736/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575755 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575730.851372:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575730.851376:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575730.851379:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361284736:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575730.851384:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361284864:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575730.851402:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575730.851411:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575730/real 1788575730]  req@ffff8dc020496d80 x1875453361284864/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575755 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575730.851422:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453361284864/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575755 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575730.851428:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575730.851429:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575730.851431:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361284864:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575730.851435:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361284992:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575730.851446:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575730.851451:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575730/real 1788575730]  req@ffff8dc020494380 x1875453361284992/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575755 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575730.851457:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453361284992/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575755 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575730.851462:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575730.851464:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575730.851465:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361284992:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575730.851468:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361285120:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575730.851477:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575730.851482:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575730/real 1788575730]  req@ffff8dc020497100 x1875453361285120/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575755 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575730.851488:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453361285120/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575755 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575730.851497:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575730.851499:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575730.851501:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361285120:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575730.851503:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361285248:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575730.851512:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575730.851517:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575730/real 1788575730]  req@ffff8dc020495180 x1875453361285248/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575755 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575730.851523:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361285248/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575755 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575730.851528:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575730.851529:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575730.851531:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361285248:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575730.851533:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361285376:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575730.851541:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575730.851546:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575730/real 1788575730]  req@ffff8dc020495500 x1875453361285376/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575755 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575730.851556:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361285376/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575755 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575730.851562:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575730.851565:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575730.851568:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361285376:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575731.235017:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575731.235018:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575731.235209:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575731.235253:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575731.235319:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575731.235360:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575731.875045:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575732.258989:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575732.258989:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575732.259028:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575732.259132:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575732.259162:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575732.259165:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575732.899029:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575733.282969:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575733.282969:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575733.282970:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575733.283040:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575733.283060:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575733.283077:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575733.922986:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575734.306995:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575734.307031:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575734.307164:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575734.307477:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575734.309488:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575734.309997:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575734.947003:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575735.330982:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575735.330982:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575735.330982:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575735.331010:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575735.331011:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575735.331032:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00080000:2.0:1788575735.970969:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575735.970979:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:3.0:1788575735.970981:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788575735.970983:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575735.970995:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4081
00000100:00080000:2.0:1788575735.971005:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575735.971013:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575735.971048:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453361285504/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575735.971077:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575735.971081:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575735.971083:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575735.971087:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4081
00000100:00080000:2.0:1788575735.971091:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575735.971095:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575735.971106:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575735.971118:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361285632/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575735.971130:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575735.971134:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575735.971138:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788575735.971140:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361285504:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788575735.971144:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4081
00000100:00080000:2.0:1788575735.971159:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575735.971168:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575735.971173:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575735.971186:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361285760/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575735.971196:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575735.971199:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575735.971202:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1788575735.971207:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788575735.971207:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4081
00000100:00080000:2.0:1788575735.971214:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575735.971218:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575735.971223:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575735.971248:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575735/real 1788575735]  req@ffff8dc020496a00 x1875453361285504/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575760 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575735.971256:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453361285888/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575735.971268:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788575735.971270:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453361285504/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575760 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575735.971273:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575735.971277:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575735.971285:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4081
00000100:00080000:0.0:1788575735.971290:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575735.971291:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575735.971298:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788575735.971299:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575735.971307:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575735.971308:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361285504:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788575735.971323:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453361286016/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575735.971332:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575735.971336:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:0.0:1788575735.971337:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361285632:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788575735.971339:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575735.971347:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4081
00000100:00080000:2.0:1788575735.971351:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575735.971355:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575735.971359:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575735.971369:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453361286144/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1788575735.971380:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788575735.971396:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575735.971401:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575735.971403:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788575735.971408:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575735/real 1788575735]  req@ffff8dc020494000 x1875453361285632/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575760 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575735.971408:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4081
00000100:00080000:2.0:1788575735.971414:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575735.971420:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575735.971429:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575735.971432:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361285632/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575760 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575735.971443:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361286272/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575735.971446:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575735.971456:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575735.971474:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361285632:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575735.971482:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361285760:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575735.971512:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575735.971525:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575735/real 1788575735]  req@ffff8dc020495880 x1875453361285760/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575760 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575735.971539:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361285760/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575760 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575735.971547:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575735.971550:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575735.971553:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361285760:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575735.971558:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361285888:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575735.971579:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575735.971594:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575735/real 1788575735]  req@ffff8dc020494e00 x1875453361285888/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575760 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575735.971607:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453361285888/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575760 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575735.971616:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575735.971620:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575735.971624:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361285888:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575735.971632:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361286016:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575735.971654:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575735.971666:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575735/real 1788575735]  req@ffff8dc020494a80 x1875453361286016/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575760 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575735.971690:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453361286016/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575760 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575735.971699:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575735.971702:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575735.971705:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361286016:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575735.971721:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361286144:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575735.971741:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575735.971751:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575735/real 1788575735]  req@ffff8dc020496a00 x1875453361286144/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575760 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575735.971762:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453361286144/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575760 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575735.971770:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575735.971772:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575735.971774:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361286144:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575735.971778:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361286272:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575735.971792:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575735.971800:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575735/real 1788575735]  req@ffff8dc020495500 x1875453361286272/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575760 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575735.971812:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361286272/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575760 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575735.971817:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575735.971819:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575735.971820:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361286272:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575736.354968:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575736.354970:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575736.354980:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575736.354997:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575736.355003:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575736.355013:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575736.995921:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575737.379051:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575737.379051:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575737.379069:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575737.379107:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575737.379294:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788575737.379343:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575738.018992:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575738.402947:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575738.402951:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575738.402966:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575738.403032:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575738.403050:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575738.403091:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575739.043070:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575739.426973:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575739.427004:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575739.427068:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575739.427104:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575739.427156:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575739.427175:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575740.066978:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575740.450931:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575740.450932:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575740.450947:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575740.450947:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575740.450973:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575740.451002:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1788575741.090964:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788575741.090965:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575741.090973:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575741.090976:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575741.090986:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4086
00000100:00080000:1.0:1788575741.090995:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575741.091002:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575741.091040:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361286400/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575741.091059:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575741.091061:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575741.091062:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575741.091065:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4086
00000100:00080000:1.0:1788575741.091068:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575741.091071:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575741.091081:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575741.091095:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361286528/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575741.091107:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788575741.091108:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361286400:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788575741.091113:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575741.091118:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575741.091122:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4086
00000100:00080000:1.0:1788575741.091126:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575741.091130:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575741.091146:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575741.091159:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361286656/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575741.091169:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575741.091181:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575741.091184:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1788575741.091186:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788575741.091191:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4086
00000100:00080000:1.0:1788575741.091198:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575741.091201:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575741.091206:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575741.091221:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361286784/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575741.091228:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575741.091231:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575741.091234:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788575741.091235:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575741/real 1788575741]  req@ffff8dc005dc1180 x1875453361286400/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575766 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575741.091241:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4086
00000100:00080000:1.0:1788575741.091249:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575741.091253:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575741.091256:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575741.091260:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361286400/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575766 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575741.091267:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361286912/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575741.091279:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575741.091285:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788575741.091290:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788575741.091291:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361286400:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788575741.091299:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575741.091302:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575741.091308:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4086
00000100:00080000:1.0:1788575741.091312:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575741.091316:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575741.091321:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575741.091330:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361286528:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788575741.091335:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361287040/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575741.091348:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575741.091351:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575741.091353:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575741.091358:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4086
00000100:00080000:1.0:1788575741.091362:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1788575741.091367:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788575741.091370:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575741.091375:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575741.091386:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361287168/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575741.091388:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575741/real 1788575741]  req@ffff8dc005dc3b80 x1875453361286528/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575766 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575741.091427:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361286528/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575766 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575741.091439:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575741.091443:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575741.091446:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361286528:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575741.091453:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361286656:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575741.091472:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575741.091483:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575741/real 1788575741]  req@ffff8dc005dc0700 x1875453361286656/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575766 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575741.091494:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361286656/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575766 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575741.091502:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575741.091505:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575741.091508:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361286656:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575741.091513:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361286784:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575741.091530:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575741.091540:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575741/real 1788575741]  req@ffff8dc005dc1c00 x1875453361286784/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575766 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575741.091558:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361286784/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575766 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575741.091566:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575741.091569:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575741.091571:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361286784:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575741.091577:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361286912:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575741.091594:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575741.091604:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575741/real 1788575741]  req@ffff8dc005dc0a80 x1875453361286912/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575766 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575741.091614:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361286912/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575766 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575741.091622:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575741.091625:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575741.091628:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361286912:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575741.091644:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361287040:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575741.091662:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575741.091673:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575741/real 1788575741]  req@ffff8dc005dc1500 x1875453361287040/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575766 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575741.091683:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361287040/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575766 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575741.091696:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575741.091699:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575741.091702:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361287040:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575741.091707:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361287168:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575741.091730:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575741.091737:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575741/real 1788575741]  req@ffff8dc005dc3800 x1875453361287168/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575766 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575741.091743:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361287168/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575766 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575741.091748:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575741.091750:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575741.091752:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361287168:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575741.474964:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575741.474964:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575741.474964:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575741.474966:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575741.474992:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575741.475020:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575742.114994:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575742.498962:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575742.498962:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575742.498962:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575742.498963:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575742.498993:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575742.499027:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575743.138955:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575743.522958:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575743.522958:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575743.522960:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575743.522966:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575743.522993:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575743.523041:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575744.162976:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575744.547019:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575744.547042:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575744.547047:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575744.547053:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575744.547078:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575744.547139:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575745.187005:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575745.571018:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575745.571019:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575745.571019:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575745.571020:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575745.571062:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575745.571114:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1788575746.211019:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788575746.211024:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575746.211035:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575746.211040:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575746.211052:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4091
00000100:00080000:1.0:1788575746.211065:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575746.211073:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575746.211117:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361287296/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575746.211145:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575746.211148:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575746.211150:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575746.211153:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4091
00000100:00080000:1.0:1788575746.211155:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575746.211159:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575746.211169:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575746.211183:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361287424/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575746.211191:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575746.211194:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575746.211195:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575746.211199:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4091
00000100:00080000:1.0:1788575746.211201:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575746.211205:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575746.211208:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575746.211217:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361287552/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575746.211220:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361287296:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788575746.211242:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575746.211247:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575746.211249:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575746.211255:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4091
00000100:00080000:1.0:1788575746.211259:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575746.211264:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575746.211270:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575746.211285:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361287680/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1788575746.211295:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788575746.211295:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575746.211304:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575746.211306:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575746.211312:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4091
00000100:00080000:1.0:1788575746.211317:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575746.211323:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575746.211329:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575746.211341:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575746/real 1788575746]  req@ffff8dc005dc2d80 x1875453361287296/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575771 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575746.211347:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361287808/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575746.211384:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575746.211388:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575746.211390:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788575746.211394:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361287296/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575771 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575746.211401:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4091
00000100:00080000:0.0:1788575746.211411:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575746.211412:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575746.211424:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788575746.211425:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575746.211434:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361287296:192.168.202.140@tcp:250:kworker.0
00000008:00100000:1.0:1788575746.211436:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575746.211446:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361287424:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788575746.211452:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361287936/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1788575746.211471:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788575746.211472:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575746.211478:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575746.211481:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788575746.211485:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575746/real 1788575746]  req@ffff8dc005dc3800 x1875453361287424/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575771 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575746.211486:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4091
00000100:00080000:1.0:1788575746.211495:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575746.211506:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575746.211510:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361287424/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575771 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1788575746.211515:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1788575746.211526:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575746.211530:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575746.211535:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361288064/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575746.211536:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361287424:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575746.211575:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361287552:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575746.211596:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575746.211607:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575746/real 1788575746]  req@ffff8dc005dc1500 x1875453361287552/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575771 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575746.211625:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361287552/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575771 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575746.211633:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575746.211636:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575746.211640:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361287552:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575746.211647:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361287680:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575746.211661:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575746.211668:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575746/real 1788575746]  req@ffff8dc005dc0a80 x1875453361287680/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575771 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575746.211675:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361287680/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575771 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575746.211680:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575746.211682:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575746.211684:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361287680:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575746.211688:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361287808:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575746.211697:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575746.211703:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575746/real 1788575746]  req@ffff8dc005dc1c00 x1875453361287808/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575771 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575746.211709:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361287808/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575771 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575746.211718:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575746.211720:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575746.211721:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361287808:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575746.211725:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361287936:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575746.211734:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575746.211739:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575746/real 1788575746]  req@ffff8dc005dc0700 x1875453361287936/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575771 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575746.211744:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361287936/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575771 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575746.211749:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575746.211751:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575746.211752:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361287936:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575746.211755:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361288064:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575746.211764:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575746.211768:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575746/real 1788575746]  req@ffff8dc005dc3b80 x1875453361288064/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575771 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575746.211774:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361288064/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575771 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575746.211779:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575746.211781:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575746.211783:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361288064:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575746.594993:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575746.594993:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575746.594996:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575746.594997:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575746.595058:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575746.595120:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575747.235057:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575747.618984:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575747.618989:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575747.618989:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575747.618992:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575747.619054:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788575747.619088:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575748.259000:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575748.643034:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575748.643034:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575748.643034:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575748.643044:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575748.643085:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575748.643144:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575749.282998:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575749.667005:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575749.667005:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575749.667050:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575749.667067:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575749.667830:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575749.667858:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575750.307002:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575750.690979:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575750.690980:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575750.690982:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575750.690985:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575750.691019:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575750.691060:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1788575751.331017:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788575751.331017:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788575751.331028:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788575751.331032:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575751.331042:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4096
00000100:00080000:2.0:1788575751.331052:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575751.331059:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575751.331098:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361288192/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575751.331121:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575751.331124:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575751.331125:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575751.331128:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4096
00000100:00080000:2.0:1788575751.331131:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575751.331135:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575751.331146:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575751.331160:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453361288320/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575751.331170:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575751.331173:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575751.331175:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575751.331179:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4096
00000100:00080000:2.0:1788575751.331183:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788575751.331186:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361288192:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788575751.331191:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575751.331200:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575751.331212:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453361288448/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575751.331219:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575751.331222:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575751.331224:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575751.331226:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4096
00000100:00080000:2.0:1788575751.331229:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575751.331231:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575751.331235:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575751.331241:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453361288576/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575751.331255:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575751.331259:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575751.331261:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575751.331265:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4096
00000100:00080000:2.0:1788575751.331269:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575751.331273:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575751.331278:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575751.331295:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453361288704/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575751.331304:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575751.331308:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575751.331310:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575751.331314:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4096
00000100:00080000:2.0:1788575751.331317:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788575751.331321:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361288320:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788575751.331323:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575751.331330:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575751.331346:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361288832/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575751.331355:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575751.331358:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575751.331360:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575751.331364:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4096
00000100:00080000:2.0:1788575751.331368:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788575751.331370:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361288448:192.168.202.140@tcp:8:kworker.0
00000100:00080000:2.0:1788575751.331377:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575751.331384:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575751.331400:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361288960/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575751.331406:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361288576:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575751.331440:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361288704:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575751.331463:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361288832:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575751.331491:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361288960:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575751.714993:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575751.714993:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575751.715004:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575751.715136:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575751.715162:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575751.715342:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575752.354999:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575752.739020:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575752.739020:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575752.739020:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575752.739020:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575752.739071:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575752.739120:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575753.379023:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575753.763008:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575753.763008:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575753.763008:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575753.763026:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575753.763051:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575753.763101:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000400:00000100:1.0:1788575754.403300:0:2335:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.140:988
00000100:00100000:3.0:1788575754.403300:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000400:00000100:1.0:1788575754.403360:0:2335:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.140@tcp at host 192.168.202.140 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:1.0:1788575754.403382:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788575754.403440:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788575754.403452:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788575754.403462:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788575754.403471:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788575754.403478:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788575754.403497:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:0.0:1788575754.403856:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575751/real 1788575754]  req@ffff8dc020495500 x1875453361288960/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575776 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575754.403923:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361288960/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575776 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575754.403945:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575754.403952:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575754.403956:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361288960:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575754.403967:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575751/real 1788575754]  req@ffff8dc020494380 x1875453361288448/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575776 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575754.403980:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453361288448/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575776 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575754.403990:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575754.403993:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575754.403997:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361288448:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575754.404005:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575751/real 1788575754]  req@ffff8dc020496d80 x1875453361288576/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575776 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575754.404018:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453361288576/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575776 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575754.404027:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575754.404031:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575754.404034:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361288576:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575754.404042:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575751/real 1788575754]  req@ffff8dc020497480 x1875453361288704/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575776 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575754.404053:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453361288704/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575776 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575754.404061:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575754.404065:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575754.404069:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361288704:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575754.404076:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575751/real 1788575754]  req@ffff8dc020494700 x1875453361288832/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575776 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575754.404089:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361288832/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575776 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575754.404098:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575754.404102:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575754.404106:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361288832:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575754.404113:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575751/real 1788575754]  req@ffff8dc020495180 x1875453361288192/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575776 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575754.404126:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361288192/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575776 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575754.404134:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575754.404138:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575754.404142:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361288192:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788575754.404149:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575751/real 1788575754]  req@ffff8dc020497100 x1875453361288320/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575776 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575754.404159:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453361288320/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575776 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575754.404194:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575754.404198:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575754.404202:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361288320:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575754.787000:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575754.787000:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575754.787000:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575754.787007:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575754.787043:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575754.787093:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575755.426959:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575755.810972:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575755.810973:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575755.810973:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575755.810973:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575755.811004:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575755.811075:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575756.450973:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575756.451021:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575756.451028:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575756.451032:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575756.451041:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4102
00000100:00080000:1.0:1788575756.451051:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575756.451058:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575756.451102:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361289088/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575756.451140:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575756.451144:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575756.451145:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575756.451150:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4102
00000100:00080000:1.0:1788575756.451153:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575756.451157:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575756.451167:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575756.451180:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361289216/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575756.451189:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575756.451192:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575756.451194:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575756.451197:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4102
00000100:00080000:1.0:1788575756.451200:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575756.451204:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575756.451209:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575756.451218:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361289344/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575756.451228:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575756.451231:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575756.451233:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575756.451236:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4102
00000100:00080000:1.0:1788575756.451240:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575756.451243:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575756.451248:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575756.451258:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361289472/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575756.451266:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575756.451269:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575756.451271:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575756.451275:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4102
00000100:00080000:1.0:1788575756.451278:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575756.451281:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575756.451285:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575756.451295:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361289600/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575756.451303:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575756.451307:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575756.451308:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575756.451312:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4102
00000100:00080000:1.0:1788575756.451315:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575756.451319:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575756.451323:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575756.451332:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361289728/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575756.451347:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575756.451350:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575756.451351:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575756.451355:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4102
00000100:00080000:1.0:1788575756.451358:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575756.451361:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575756.451365:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575756.451374:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361289856/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575756.451475:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361289088:192.168.202.140@tcp:250:kworker.0
00000800:00000100:0.0:1788575756.451576:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575756.451623:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575756/real 1788575756]  req@ffff8dc005dc1180 x1875453361289088/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575781 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575756.451644:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361289088/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575781 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575756.451654:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575756.451658:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575756.451662:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361289088:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788575756.451669:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361289216:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575756.451692:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575756.451703:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575756/real 1788575756]  req@ffff8dc005dc3b80 x1875453361289216/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575781 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575756.451714:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361289216/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575781 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575756.451727:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575756.451730:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575756.451734:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361289216:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575756.451739:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361289344:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575756.451759:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575756.451769:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575756/real 1788575756]  req@ffff8dc005dc0700 x1875453361289344/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575781 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575756.451779:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361289344/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575781 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575756.451788:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575756.451791:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575756.451794:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361289344:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575756.451800:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361289472:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575756.451815:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575756.451824:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575756/real 1788575756]  req@ffff8dc005dc1c00 x1875453361289472/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575781 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575756.451834:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361289472/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575781 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575756.451843:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575756.451846:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575756.451850:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361289472:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575756.451856:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361289600:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575756.451917:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575756.451935:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575756/real 1788575756]  req@ffff8dc005dc0a80 x1875453361289600/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575781 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575756.451948:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361289600/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575781 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575756.451956:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575756.451959:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575756.451962:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361289600:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575756.451970:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361289728:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575756.451992:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575756.452002:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575756/real 1788575756]  req@ffff8dc005dc1500 x1875453361289728/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575781 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575756.452014:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361289728/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575781 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575756.452022:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575756.452026:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575756.452028:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361289728:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575756.452034:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361289856:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575756.452053:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575756.452063:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575756/real 1788575756]  req@ffff8dc005dc3800 x1875453361289856/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575781 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575756.452073:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361289856/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575781 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575756.452081:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575756.452084:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575756.452087:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361289856:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575756.834979:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575756.834979:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575756.834979:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575756.834981:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575756.835021:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575756.835060:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575757.474956:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575757.858934:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575757.858951:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575757.858951:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575757.858970:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575757.858978:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575757.858985:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575758.498971:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575758.882965:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575758.882965:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575758.882969:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575758.882993:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575758.882998:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575758.883000:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575759.522966:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575759.906951:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575759.906951:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575759.906975:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575759.906980:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575759.906981:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575759.906981:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575760.546994:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575760.930988:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575760.930998:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575760.930999:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575760.931007:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575760.931041:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575760.931046:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00080000:1.0:1788575761.570972:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788575761.570976:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575761.570982:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575761.570987:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575761.570998:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4107
00000100:00080000:1.0:1788575761.571008:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575761.571015:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575761.571050:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361289984/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575761.571076:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575761.571079:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575761.571081:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575761.571085:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4107
00000100:00080000:1.0:1788575761.571088:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575761.571092:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575761.571102:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575761.571119:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361289984:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788575761.571119:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361290112/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575761.571147:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575761.571150:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575761.571152:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575761.571155:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4107
00000100:00080000:1.0:1788575761.571159:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575761.571163:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575761.571168:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575761.571181:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361290240/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1788575761.571189:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788575761.571195:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575761.571199:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575761.571201:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575761.571205:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4107
00000100:00080000:1.0:1788575761.571209:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575761.571213:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575761.571218:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575761.571234:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575761/real 1788575761]  req@ffff8dc005dc2d80 x1875453361289984/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575786 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575761.571241:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361290368/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575761.571258:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575761.571260:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575761.571262:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575761.571266:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4107
00000100:00100000:0.0:1788575761.571269:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361289984/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575786 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575761.571270:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575761.571274:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575761.571278:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575761.571286:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361290496/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575761.571293:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575761.571293:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575761.571300:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575761.571301:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575761.571304:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788575761.571306:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4107
00000100:00080000:1.0:1788575761.571311:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788575761.571314:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361289984:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788575761.571317:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575761.571325:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575761.571336:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361290624/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575761.571345:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361290112:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788575761.571348:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575761.571353:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575761.571355:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575761.571360:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4107
00000100:00080000:1.0:1788575761.571369:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1788575761.571373:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788575761.571374:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575761.571381:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575761.571390:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361290752/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575761.571394:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575761/real 1788575761]  req@ffff8dc005dc3800 x1875453361290112/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575786 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575761.571411:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361290112/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575786 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575761.571420:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575761.571425:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575761.571428:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361290112:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575761.571433:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361290240:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575761.571449:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575761.571456:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575761/real 1788575761]  req@ffff8dc005dc1500 x1875453361290240/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575786 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575761.571463:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361290240/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575786 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575761.571471:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575761.571474:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575761.571477:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361290240:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575761.571483:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361290368:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575761.571501:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575761.571511:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575761/real 1788575761]  req@ffff8dc005dc0a80 x1875453361290368/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575786 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575761.571523:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361290368/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575786 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575761.571532:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575761.571534:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575761.571537:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361290368:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575761.571543:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361290496:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575761.571556:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575761.571562:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575761/real 1788575761]  req@ffff8dc005dc1c00 x1875453361290496/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575786 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575761.571569:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361290496/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575786 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575761.571575:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575761.571576:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575761.571578:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361290496:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575761.571589:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361290624:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575761.571599:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575761.571604:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575761/real 1788575761]  req@ffff8dc005dc0700 x1875453361290624/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575786 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575761.571610:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361290624/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575786 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575761.571619:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575761.571621:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575761.571624:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361290624:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575761.571629:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361290752:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575761.571644:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575761.571654:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575761/real 1788575761]  req@ffff8dc005dc3b80 x1875453361290752/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575786 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575761.571665:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361290752/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575786 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575761.571673:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575761.571675:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575761.571677:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361290752:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575761.954984:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575761.954991:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575761.954991:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575761.955016:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575761.955019:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575761.955045:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575762.594943:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575762.978979:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575762.978979:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575762.978979:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575762.979011:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575762.979028:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788575762.979035:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575763.618972:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575764.002945:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575764.002945:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575764.002948:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575764.002968:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575764.002970:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575764.002975:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575764.642927:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575765.026973:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575765.026973:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575765.026974:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575765.027002:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575765.027002:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575765.027011:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575765.666981:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575766.050983:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575766.050983:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575766.050983:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575766.051013:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575766.051016:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575766.051029:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575766.690968:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575766.690975:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:3.0:1788575766.690982:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575766.690986:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575766.690997:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4112
00000100:00080000:1.0:1788575766.691005:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575766.691011:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575766.691043:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361290880/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575766.691063:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575766.691066:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575766.691068:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575766.691071:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4112
00000100:00080000:1.0:1788575766.691075:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575766.691079:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575766.691087:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575766.691100:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361291008/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575766.691105:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361290880:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788575766.691108:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575766.691111:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575766.691113:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575766.691116:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4112
00000100:00080000:1.0:1788575766.691118:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575766.691121:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575766.691125:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575766.691134:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361291136/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575766.691141:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575766.691143:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575766.691145:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575766.691147:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4112
00000100:00080000:1.0:1788575766.691158:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575766.691161:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575766.691165:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788575766.691168:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575766.691173:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361291264/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575766.691185:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575766.691188:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575766.691189:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575766.691193:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4112
00000100:00080000:1.0:1788575766.691195:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575766.691198:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575766.691202:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575766.691203:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575766/real 1788575766]  req@ffff8dc005dc1180 x1875453361290880/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575791 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575766.691210:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361291392/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575766.691218:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361290880/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575791 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575766.691218:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575766.691221:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575766.691222:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575766.691226:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4112
00000100:00080000:0.0:1788575766.691228:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575766.691229:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575766.691232:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788575766.691232:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575766.691235:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575766.691236:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361290880:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788575766.691243:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361291520/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575766.691250:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575766.691252:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:0.0:1788575766.691253:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361291008:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788575766.691254:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575766.691257:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4112
00000100:00080000:1.0:1788575766.691260:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575766.691263:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575766.691266:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788575766.691272:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575766.691274:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361291648/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575766.691281:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575766/real 1788575766]  req@ffff8dc005dc3b80 x1875453361291008/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575791 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575766.691291:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361291008/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575791 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575766.691300:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575766.691303:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575766.691306:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361291008:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575766.691311:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361291136:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575766.691328:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575766.691336:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575766/real 1788575766]  req@ffff8dc005dc0700 x1875453361291136/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575791 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575766.691343:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361291136/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575791 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575766.691348:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575766.691350:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575766.691352:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361291136:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575766.691355:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361291264:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575766.691365:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575766.691370:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575766/real 1788575766]  req@ffff8dc005dc1c00 x1875453361291264/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575791 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575766.691376:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361291264/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575791 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575766.691381:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575766.691382:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575766.691384:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361291264:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575766.691387:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361291392:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575766.691395:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575766.691400:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575766/real 1788575766]  req@ffff8dc005dc0a80 x1875453361291392/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575791 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575766.691406:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361291392/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575791 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575766.691411:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575766.691412:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575766.691414:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361291392:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575766.691417:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361291520:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575766.691425:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575766.691429:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575766/real 1788575766]  req@ffff8dc005dc1500 x1875453361291520/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575791 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575766.691436:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361291520/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575791 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575766.691440:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575766.691442:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575766.691443:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361291520:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575766.691453:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361291648:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575766.691461:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575766.691466:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575766/real 1788575766]  req@ffff8dc005dc3800 x1875453361291648/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575791 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575766.691472:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361291648/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575791 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575766.691476:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575766.691478:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575766.691479:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361291648:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575767.074970:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575767.074970:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575767.074970:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575767.074996:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575767.074999:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575767.075016:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575767.714969:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575768.098964:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575768.098966:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575768.098966:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575768.098989:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575768.098995:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575768.098998:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575768.738971:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575769.122967:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575769.122977:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575769.123069:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575769.123084:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575769.123146:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575769.123148:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575769.762942:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575770.146953:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575770.146953:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575770.146954:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575770.146956:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575770.146981:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575770.147028:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575770.786968:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575771.170961:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575771.170964:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575771.171002:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575771.171005:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575771.171009:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575771.171067:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1788575771.810948:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788575771.810948:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575771.810959:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575771.810964:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575771.810972:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4117
00000100:00080000:1.0:1788575771.810982:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575771.810989:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575771.811035:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361291776/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575771.811060:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575771.811063:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575771.811065:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575771.811068:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4117
00000100:00080000:1.0:1788575771.811072:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575771.811075:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575771.811084:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575771.811097:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361291904/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575771.811107:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361291776:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788575771.811108:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575771.811116:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575771.811117:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575771.811121:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4117
00000100:00080000:1.0:1788575771.811124:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575771.811127:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575771.811132:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575771.811143:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361292032/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575771.811151:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575771.811154:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575771.811156:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575771.811159:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4117
00000100:00080000:1.0:1788575771.811172:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575771.811176:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575771.811180:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788575771.811181:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575771.811195:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361292160/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575771.811205:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575771.811208:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575771.811211:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575771.811215:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4117
00000100:00100000:0.0:1788575771.811220:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575771/real 1788575771]  req@ffff8dc005dc2d80 x1875453361291776/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575796 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575771.811221:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575771.811228:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575771.811235:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575771.811246:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361292288/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575771.811249:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361291776/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575796 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575771.811255:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575771.811260:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575771.811263:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575771.811268:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575771.811268:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4117
00000100:00080000:1.0:1788575771.811273:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575771.811276:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788575771.811279:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575771.811282:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575771.811289:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361291776:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788575771.811291:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361292416/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575771.811302:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575771.811305:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575771.811307:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788575771.811310:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361291904:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788575771.811314:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4117
00000100:00080000:1.0:1788575771.811320:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575771.811323:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575771.811328:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788575771.811334:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575771.811343:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361292544/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575771.811349:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575771/real 1788575771]  req@ffff8dc005dc3800 x1875453361291904/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575796 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575771.811364:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361291904/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575796 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575771.811372:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575771.811374:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575771.811376:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361291904:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575771.811381:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361292032:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575771.811393:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575771.811399:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575771/real 1788575771]  req@ffff8dc005dc1500 x1875453361292032/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575796 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575771.811412:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361292032/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575796 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575771.811418:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575771.811420:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575771.811422:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361292032:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575771.811426:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361292160:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575771.811439:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575771.811445:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575771/real 1788575771]  req@ffff8dc005dc0a80 x1875453361292160/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575796 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575771.811451:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361292160/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575796 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575771.811457:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575771.811458:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575771.811460:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361292160:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575771.811463:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361292288:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575771.811475:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575771.811481:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575771/real 1788575771]  req@ffff8dc005dc1c00 x1875453361292288/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575796 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575771.811487:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361292288/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575796 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575771.811498:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575771.811499:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575771.811503:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361292288:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575771.811508:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361292416:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575771.811522:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575771.811529:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575771/real 1788575771]  req@ffff8dc005dc0700 x1875453361292416/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575796 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575771.811536:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361292416/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575796 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575771.811541:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575771.811543:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575771.811545:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361292416:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575771.811556:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361292544:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575771.811573:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575771.811582:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575771/real 1788575771]  req@ffff8dc005dc3b80 x1875453361292544/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575796 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575771.811590:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361292544/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575796 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575771.811595:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575771.811597:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575771.811599:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361292544:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575772.194946:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575772.194946:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575772.194949:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575772.194951:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575772.194988:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575772.195011:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575772.834993:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575773.218958:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575773.218958:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575773.218958:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575773.218959:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575773.218984:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575773.219014:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575773.859001:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575774.242969:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575774.242969:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575774.242970:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575774.242970:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575774.243002:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575774.243038:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575774.883000:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575775.266973:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575775.267649:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575775.269910:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575775.270218:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575775.270235:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575775.270250:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575775.906997:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575776.291033:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575776.291033:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575776.291034:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575776.291059:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575776.291098:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788575776.291152:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575776.930935:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575776.930940:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575776.930947:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575776.930952:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575776.930962:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4122
00000100:00080000:1.0:1788575776.930972:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575776.930979:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575776.931017:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361292672/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575776.931040:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575776.931043:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575776.931045:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575776.931047:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4122
00000100:00080000:1.0:1788575776.931050:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575776.931052:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575776.931062:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575776.931072:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361292800/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575776.931082:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361292672:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788575776.931082:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575776.931087:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575776.931090:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575776.931094:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4122
00000100:00080000:1.0:1788575776.931096:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575776.931098:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575776.931101:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575776.931108:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361292928/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575776.931113:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575776.931116:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575776.931117:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575776.931120:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4122
00000100:00080000:1.0:1788575776.931123:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575776.931127:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575776.931132:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575776.931145:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361293056/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575776.931154:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575776.931158:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575776.931160:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575776.931165:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4122
00000800:00000100:0.0:1788575776.931168:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788575776.931172:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575776.931179:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575776.931184:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575776.931197:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361293184/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575776.931207:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575776.931211:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:0.0:1788575776.931213:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575776/real 1788575776]  req@ffff8dc005dc1180 x1875453361292672/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575801 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575776.931214:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575776.931225:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4122
00000100:00080000:1.0:1788575776.931230:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788575776.931234:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361292672/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575801 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575776.931237:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575776.931247:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1788575776.931248:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575776.931254:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575776.931258:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361292672:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788575776.931266:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361293312/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575776.931277:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575776.931279:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575776.931281:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575776.931284:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4122
00000100:00100000:0.0:1788575776.931287:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361292800:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788575776.931287:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575776.931295:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575776.931299:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788575776.931308:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575776.931322:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361293440/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575776.931323:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575776/real 1788575776]  req@ffff8dc005dc3b80 x1875453361292800/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575801 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575776.931364:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361292800/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575801 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575776.931376:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575776.931380:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575776.931396:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361292800:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575776.931403:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361292928:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575776.931454:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575776.931467:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575776/real 1788575776]  req@ffff8dc005dc0700 x1875453361292928/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575801 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575776.931476:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361292928/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575801 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575776.931482:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575776.931484:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575776.931486:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361292928:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575776.931491:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361293056:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575776.931505:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575776.931511:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575776/real 1788575776]  req@ffff8dc005dc1c00 x1875453361293056/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575801 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575776.931520:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361293056/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575801 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575776.931528:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575776.931531:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575776.931534:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361293056:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575776.931540:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361293184:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575776.931559:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575776.931570:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575776/real 1788575776]  req@ffff8dc005dc0a80 x1875453361293184/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575801 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575776.931577:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361293184/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575801 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575776.931583:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575776.931585:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575776.931587:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361293184:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575776.931591:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361293312:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575776.931603:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575776.931608:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575776/real 1788575776]  req@ffff8dc005dc1500 x1875453361293312/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575801 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575776.931615:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361293312/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575801 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575776.931620:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575776.931621:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575776.931623:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361293312:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575776.931635:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361293440:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575776.931644:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575776.931650:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575776/real 1788575776]  req@ffff8dc005dc3800 x1875453361293440/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575801 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575776.931660:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361293440/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575801 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575776.931665:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575776.931666:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575776.931668:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361293440:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575777.314952:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575777.314952:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575777.314952:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575777.314953:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575777.314991:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575777.315009:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575777.954964:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575778.338971:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575778.338971:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575778.338971:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575778.338975:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575778.339005:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788575778.339074:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575778.978914:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575779.362970:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575779.362970:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575779.362970:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575779.362970:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575779.362998:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575779.363030:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575780.003002:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575780.386985:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575780.386992:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575780.387012:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788575780.387093:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575780.387170:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575780.387185:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575781.027128:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575781.410979:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575781.410979:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575781.410980:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575781.410980:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575781.411012:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575781.411043:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1788575782.050967:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575782.050975:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788575782.050978:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575782.050986:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4127
00000100:00080000:3.0:1788575782.050993:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575782.050999:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575782.051027:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e680 x1875453361293568/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575782.051050:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575782.051053:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575782.051054:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575782.051056:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4127
00000100:00080000:3.0:1788575782.051058:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575782.051060:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575782.051067:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575782.051075:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d180 x1875453361293696/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575782.051082:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575782.051085:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575782.051086:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788575782.051090:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361293568:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788575782.051091:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4127
00000100:00080000:3.0:1788575782.051095:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575782.051099:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575782.051102:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575782.051110:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f480 x1875453361293824/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575782.051116:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575782.051118:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575782.051119:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575782.051121:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4127
00000100:00080000:3.0:1788575782.051124:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575782.051126:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575782.051129:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575782.051135:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c380 x1875453361293952/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575782.051140:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575782.051143:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575782.051144:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575782.051146:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4127
00000800:00000100:0.0:1788575782.051156:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788575782.051159:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575782.051166:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575782.051170:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575782.051196:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d500 x1875453361294080/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575782.051206:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575782.051209:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575782.051211:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575782.051216:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4127
00000100:00100000:0.0:1788575782.051217:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575782/real 1788575782]  req@ffff8dc00644e680 x1875453361293568/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575807 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575782.051220:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575782.051227:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575782.051235:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575782.051246:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453361293568/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575807 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575782.051250:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ea00 x1875453361294208/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575782.051269:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575782.051279:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788575782.051283:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788575782.051288:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361293568:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788575782.051288:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575782.051291:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575782.051297:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4127
00000100:00080000:3.0:1788575782.051301:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575782.051303:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575782.051307:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575782.051315:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ca80 x1875453361294336/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575782.051319:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361293696:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575782.051342:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000800:00000100:0.0:1788575782.051351:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575782.051368:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575782/real 1788575782]  req@ffff8dc00644d180 x1875453361293696/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575807 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575782.051381:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453361293696/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575807 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575782.051390:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575782.051394:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575782.051396:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361293696:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575782.051400:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361293824:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575782.051416:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575782.051423:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575782/real 1788575782]  req@ffff8dc00644f480 x1875453361293824/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575807 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575782.051430:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453361293824/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575807 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575782.051435:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575782.051437:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575782.051439:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361293824:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575782.051450:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361293952:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575782.051461:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575782.051468:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575782/real 1788575782]  req@ffff8dc00644c380 x1875453361293952/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575807 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575782.051474:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453361293952/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575807 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575782.051486:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575782.051487:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575782.051489:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361293952:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575782.051493:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361294080:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575782.051504:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575782.051510:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575782/real 1788575782]  req@ffff8dc00644d500 x1875453361294080/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575807 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575782.051516:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d500 x1875453361294080/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575807 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575782.051521:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575782.051529:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575782.051531:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361294080:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575782.051534:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361294208:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575782.051544:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575782.051550:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575782/real 1788575782]  req@ffff8dc00644ea00 x1875453361294208/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575807 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575782.051556:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ea00 x1875453361294208/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575807 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575782.051561:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575782.051563:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575782.051564:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361294208:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575782.051577:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361294336:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575782.051592:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575782.051602:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575782/real 1788575782]  req@ffff8dc00644ca80 x1875453361294336/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575807 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575782.051613:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ca80 x1875453361294336/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575807 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575782.051621:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575782.051624:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575782.051626:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361294336:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575782.434960:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575782.434960:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575782.434963:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575782.434965:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575782.434994:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788575782.435061:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575783.074974:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575783.458972:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575783.458972:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575783.458976:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575783.458998:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575783.459002:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575783.459004:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575784.098981:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575784.482973:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575784.482973:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575784.482977:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575784.483001:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575784.483006:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788575784.483032:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575785.122960:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575785.506983:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575785.506994:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575785.507003:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575785.507014:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575785.507119:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575785.507136:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575786.146978:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575786.530968:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575786.530968:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575786.530970:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575786.530993:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575786.530999:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575786.531025:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1788575787.170996:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788575787.171000:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575787.171005:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575787.171010:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575787.171018:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4132
00000100:00080000:1.0:1788575787.171026:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575787.171041:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575787.171076:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361294464/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575787.171094:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575787.171097:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575787.171098:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575787.171101:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4132
00000100:00080000:1.0:1788575787.171103:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575787.171105:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575787.171112:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575787.171126:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361294592/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575787.171135:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575787.171138:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575787.171141:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575787.171146:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4132
00000100:00100000:0.0:1788575787.171147:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361294464:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788575787.171150:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575787.171158:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575787.171164:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575787.171177:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361294720/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575787.171187:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575787.171190:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575787.171192:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575787.171196:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4132
00000100:00080000:1.0:1788575787.171201:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575787.171205:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575787.171209:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788575787.171211:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575787.171226:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361294848/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575787.171236:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575787.171239:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575787.171241:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575787.171245:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4132
00000100:00080000:1.0:1788575787.171249:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575787.171253:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575787.171259:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575787.171264:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575787/real 1788575787]  req@ffff8dc005dc2d80 x1875453361294464/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575812 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575787.171274:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361294976/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575787.171284:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788575787.171286:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361294464/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575812 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575787.171288:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575787.171293:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575787.171301:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4132
00000100:00080000:0.0:1788575787.171306:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575787.171306:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575787.171314:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788575787.171315:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575787.171324:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361294464:192.168.202.140@tcp:250:kworker.0
00000008:00100000:1.0:1788575787.171324:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575787.171336:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361294592:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788575787.171341:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361295104/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575787.171351:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575787.171355:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575787.171357:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575787.171362:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4132
00000800:00000100:0.0:1788575787.171365:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788575787.171368:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575787.171373:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575787.171379:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575787.171382:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575787/real 1788575787]  req@ffff8dc005dc3800 x1875453361294592/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575812 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575787.171393:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361295232/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575787.171400:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361294592/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575812 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575787.171416:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575787.171420:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575787.171424:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361294592:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575787.171447:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361294720:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575787.171465:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575787.171475:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575787/real 1788575787]  req@ffff8dc005dc1500 x1875453361294720/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575812 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575787.171492:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361294720/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575812 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575787.171501:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575787.171504:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575787.171507:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361294720:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575787.171512:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361294848:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575787.171528:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575787.171536:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575787/real 1788575787]  req@ffff8dc005dc0a80 x1875453361294848/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575812 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575787.171547:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361294848/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575812 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575787.171556:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575787.171559:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575787.171562:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361294848:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575787.171568:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361294976:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575787.171584:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575787.171594:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575787/real 1788575787]  req@ffff8dc005dc1c00 x1875453361294976/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575812 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575787.171604:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361294976/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575812 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575787.171619:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575787.171622:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575787.171625:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361294976:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575787.171630:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361295104:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575787.171646:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575787.171654:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575787/real 1788575787]  req@ffff8dc005dc0700 x1875453361295104/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575812 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575787.171664:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361295104/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575812 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575787.171672:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575787.171675:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575787.171679:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361295104:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575787.171684:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361295232:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575787.171698:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575787.171707:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575787/real 1788575787]  req@ffff8dc005dc3b80 x1875453361295232/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575812 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575787.171730:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361295232/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575812 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575787.171739:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575787.171741:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575787.171745:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361295232:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575787.554942:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575787.554944:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575787.554944:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575787.554961:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575787.554983:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575787.555015:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575788.194988:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575788.578967:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575788.578967:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575788.578967:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575788.578967:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575788.579005:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575788.579044:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575789.218920:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575789.602935:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575789.602941:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575789.602944:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575789.603007:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575789.603037:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575789.603041:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575790.243004:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575790.626980:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575790.626980:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575790.626992:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575790.627005:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575790.627011:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788575790.627030:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575791.266954:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575791.650949:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575791.650955:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575791.650966:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575791.650984:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788575791.651006:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575791.651008:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575792.290986:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575792.290996:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575792.291003:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788575792.291008:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575792.291017:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4137
00000100:00080000:0.0:1788575792.291026:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575792.291034:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575792.291071:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361295360/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575792.291098:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575792.291106:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575792.291107:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575792.291110:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4137
00000100:00080000:0.0:1788575792.291113:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575792.291117:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575792.291124:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575792.291136:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361295488/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575792.291136:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361295360:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788575792.291152:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575792.291155:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575792.291157:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575792.291164:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4137
00000100:00080000:0.0:1788575792.291167:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575792.291171:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575792.291176:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575792.291188:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361295616/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788575792.291191:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788575792.291206:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575792.291208:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575792.291209:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575792.291212:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4137
00000100:00080000:0.0:1788575792.291216:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575792.291220:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575792.291225:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575792.291228:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575792/real 1788575792]  req@ffff8dc006713800 x1875453361295360/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575817 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575792.291239:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453361295744/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575792.291249:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788575792.291250:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361295360/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575817 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575792.291257:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575792.291260:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575792.291264:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575792.291266:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4137
00000100:00080000:3.0:1788575792.291269:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788575792.291272:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788575792.291274:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361295360:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788575792.291279:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575792.291284:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575792.291296:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361295488:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575792.291297:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361295872/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575792.291310:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575792.291312:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575792.291313:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1788575792.291316:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788575792.291319:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4137
00000100:00080000:0.0:1788575792.291323:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575792.291326:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575792.291328:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575792/real 1788575792]  req@ffff8dc006713480 x1875453361295488/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575817 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1788575792.291331:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575792.291341:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361295488/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575817 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575792.291345:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361296000/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575792.291359:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575792.291360:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575792.291365:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575792.291366:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788575792.291367:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575792.291373:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4137
00000100:00100000:3.0:1788575792.291373:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361295488:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788575792.291377:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788575792.291384:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361295616:192.168.202.140@tcp:8:kworker.0
00000100:00080000:0.0:1788575792.291389:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575792.291397:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575792.291410:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361296128/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788575792.291418:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575792.291431:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575792/real 1788575792]  req@ffff8dc006711c00 x1875453361295616/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575817 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575792.291441:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361295616/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575817 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575792.291449:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575792.291452:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575792.291455:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361295616:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575792.291461:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361295744:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575792.291481:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575792.291491:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575792/real 1788575792]  req@ffff8dc006710380 x1875453361295744/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575817 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575792.291502:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453361295744/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575817 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575792.291511:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575792.291514:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575792.291517:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361295744:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575792.291531:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361295872:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575792.291547:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575792.291554:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575792/real 1788575792]  req@ffff8dc006712300 x1875453361295872/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575817 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575792.291565:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361295872/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575817 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575792.291570:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575792.291572:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575792.291574:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361295872:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575792.291577:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361296000:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575792.291586:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575792.291591:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575792/real 1788575792]  req@ffff8dc006712680 x1875453361296000/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575817 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575792.291597:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361296000/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575817 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575792.291601:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575792.291603:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575792.291604:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361296000:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575792.291607:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361296128:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575792.291615:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575792.291620:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575792/real 1788575792]  req@ffff8dc006713800 x1875453361296128/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575817 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575792.291626:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361296128/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575817 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575792.291642:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575792.291644:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575792.291646:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361296128:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575792.674978:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575792.674978:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575792.674982:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575792.674995:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575792.675010:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788575792.675074:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575793.314964:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575793.698966:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575793.698966:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575793.698966:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575793.698969:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575793.698994:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575793.699058:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575794.338978:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575794.722965:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575794.722966:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575794.722966:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575794.722969:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575794.722997:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575794.723053:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575795.362982:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575795.746961:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575795.746961:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575795.746961:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575795.746965:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575795.746993:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575795.747057:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575796.386972:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575796.770936:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575796.770941:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575796.770945:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575796.770961:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575796.770982:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788575796.771016:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575797.410957:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575797.410979:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575797.410985:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575797.410989:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575797.410998:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4143
00000100:00080000:1.0:1788575797.411007:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575797.411013:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575797.411048:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361296256/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575797.411080:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575797.411083:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575797.411084:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575797.411087:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4143
00000100:00080000:1.0:1788575797.411090:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575797.411092:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575797.411100:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575797.411111:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361296384/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575797.411117:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575797.411120:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575797.411121:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575797.411125:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4143
00000100:00080000:1.0:1788575797.411127:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575797.411129:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575797.411130:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361296256:192.168.202.140@tcp:250:kworker.0
00000008:00100000:1.0:1788575797.411132:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575797.411142:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361296512/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575797.411147:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575797.411149:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575797.411150:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575797.411152:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4143
00000100:00080000:1.0:1788575797.411154:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575797.411156:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575797.411159:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575797.411166:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361296640/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575797.411172:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575797.411174:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575797.411175:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575797.411177:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4143
00000100:00080000:1.0:1788575797.411182:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575797.411184:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575797.411187:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788575797.411191:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575797.411200:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361296768/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575797.411207:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575797.411209:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575797.411210:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575797.411213:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4143
00000100:00080000:1.0:1788575797.411215:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575797.411219:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575797.411224:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575797.411224:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575797/real 1788575797]  req@ffff8dc005dc1180 x1875453361296256/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575822 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575797.411239:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361296896/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575797.411244:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361296256/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575822 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575797.411259:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575797.411263:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575797.411264:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575797.411265:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575797.411269:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4143
00000100:00080000:1.0:1788575797.411273:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575797.411274:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788575797.411278:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575797.411283:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361296256:192.168.202.140@tcp:250:kworker.0
00000008:00100000:1.0:1788575797.411284:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575797.411296:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361297024/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575797.411311:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361296384:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575797.411342:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575797.411351:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575797/real 1788575797]  req@ffff8dc005dc3b80 x1875453361296384/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575822 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575797.411360:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361296384/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575822 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575797.411370:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575797.411373:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575797.411376:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361296384:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575797.411382:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361296512:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575797.411402:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575797.411413:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575797/real 1788575797]  req@ffff8dc005dc0700 x1875453361296512/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575822 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575797.411420:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361296512/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575822 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575797.411436:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575797.411439:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575797.411445:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361296512:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575797.411451:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361296640:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575797.411471:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575797.411482:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575797/real 1788575797]  req@ffff8dc005dc1c00 x1875453361296640/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575822 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575797.411499:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361296640/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575822 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575797.411507:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575797.411510:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575797.411513:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361296640:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575797.411519:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361296768:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575797.411538:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575797.411548:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575797/real 1788575797]  req@ffff8dc005dc0a80 x1875453361296768/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575822 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575797.411555:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361296768/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575822 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575797.411561:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575797.411563:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575797.411564:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361296768:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575797.411568:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361296896:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575797.411579:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575797.411585:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575797/real 1788575797]  req@ffff8dc005dc1500 x1875453361296896/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575822 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575797.411596:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361296896/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575822 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575797.411600:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575797.411602:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575797.411603:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361296896:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575797.411606:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361297024:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575797.411615:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575797.411620:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575797/real 1788575797]  req@ffff8dc005dc3800 x1875453361297024/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575822 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575797.411626:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361297024/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575822 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575797.411630:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575797.411631:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575797.411633:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361297024:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575797.794973:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575797.794973:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575797.794973:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788575797.795035:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575797.795093:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575797.795107:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575798.434942:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575798.818925:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575798.818933:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575798.818945:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575798.818963:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575798.818972:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575798.818975:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575799.458959:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575799.842961:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575799.842961:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575799.842962:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788575799.842991:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575799.842992:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575799.842994:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575800.482963:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575800.866965:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575800.866965:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575800.866982:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575800.866996:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575800.866997:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575800.866998:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575801.506946:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575801.890976:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575801.890977:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575801.890977:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575801.891006:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575801.891018:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788575801.891027:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575802.530976:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575802.530981:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575802.530988:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788575802.530992:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575802.531001:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4148
00000100:00080000:0.0:1788575802.531010:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575802.531018:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575802.531050:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361297152/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575802.531072:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575802.531076:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575802.531077:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575802.531081:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4148
00000100:00080000:0.0:1788575802.531084:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575802.531087:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575802.531096:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575802.531110:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361297280/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575802.531114:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361297152:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788575802.531126:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575802.531130:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575802.531132:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575802.531136:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4148
00000100:00080000:0.0:1788575802.531140:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575802.531143:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575802.531148:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575802.531160:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361297408/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575802.531170:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575802.531173:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575802.531175:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575802.531178:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4148
00000100:00080000:0.0:1788575802.531182:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1788575802.531187:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788575802.531189:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575802.531195:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575802.531206:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361297536/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575802.531216:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575802.531219:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575802.531221:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575802.531226:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4148
00000100:00080000:0.0:1788575802.531230:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788575802.531234:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575802/real 1788575802]  req@ffff8dc006712a00 x1875453361297152/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575827 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575802.531237:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575802.531246:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575802.531259:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361297152/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575827 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575802.531261:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361297664/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575802.531290:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575802.531292:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575802.531299:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575802.531299:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788575802.531304:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788575802.531306:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361297152:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788575802.531311:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4148
00000100:00080000:0.0:1788575802.531317:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575802.531322:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575802.531327:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575802.531333:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361297280:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575802.531340:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361297792/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575802.531352:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575802.531355:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575802.531357:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1788575802.531362:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788575802.531365:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4148
00000100:00080000:0.0:1788575802.531372:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575802.531376:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575802.531381:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575802.531390:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575802/real 1788575802]  req@ffff8dc006713100 x1875453361297280/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575827 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575802.531394:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361297920/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575802.531422:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361297280/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575827 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575802.531434:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575802.531438:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575802.531442:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361297280:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575802.531451:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361297408:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575802.531472:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575802.531483:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575802/real 1788575802]  req@ffff8dc006713b80 x1875453361297408/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575827 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575802.531500:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361297408/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575827 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575802.531508:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575802.531511:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575802.531514:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361297408:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575802.531519:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361297536:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575802.531537:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575802.531546:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575802/real 1788575802]  req@ffff8dc006711880 x1875453361297536/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575827 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575802.531556:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361297536/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575827 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575802.531564:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575802.531567:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575802.531570:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361297536:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575802.531575:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361297664:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575802.531591:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575802.531601:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575802/real 1788575802]  req@ffff8dc006711500 x1875453361297664/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575827 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575802.531623:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361297664/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575827 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575802.531637:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575802.531640:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575802.531643:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361297664:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575802.531659:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361297792:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575802.531678:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575802.531689:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575802/real 1788575802]  req@ffff8dc006710e00 x1875453361297792/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575827 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575802.531699:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361297792/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575827 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575802.531707:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575802.531709:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575802.531712:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361297792:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575802.531718:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361297920:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575802.531736:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575802.531746:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575802/real 1788575802]  req@ffff8dc006712a00 x1875453361297920/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575827 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575802.531756:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361297920/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575827 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575802.531763:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575802.531766:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575802.531769:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361297920:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575802.914976:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575802.914994:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575802.914997:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575802.915009:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575802.915019:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575802.915038:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575803.554973:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575803.938947:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575803.938972:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575803.939032:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575803.939037:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575803.939037:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788575803.939154:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575804.578972:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575804.962960:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575804.962961:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575804.962961:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575804.962984:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575804.962991:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575804.963027:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575805.602975:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575805.986981:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575805.986984:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575805.987027:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575805.987496:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575805.987531:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575805.987532:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575806.626959:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575807.010971:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575807.010972:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575807.010972:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575807.010972:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575807.011006:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575807.011035:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575807.650975:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575807.650993:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575807.651000:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575807.651004:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575807.651014:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4153
00000100:00080000:1.0:1788575807.651024:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575807.651031:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575807.651067:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361298048/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575807.651095:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575807.651099:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575807.651101:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575807.651105:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4153
00000100:00080000:1.0:1788575807.651109:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575807.651122:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575807.651135:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361298048:192.168.202.140@tcp:250:kworker.0
00000008:00100000:1.0:1788575807.651136:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575807.651157:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361298176/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575807.651169:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575807.651172:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575807.651174:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575807.651179:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4153
00000100:00080000:1.0:1788575807.651183:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575807.651188:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575807.651193:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788575807.651202:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575807.651207:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361298304/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575807.651217:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575807.651221:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575807.651223:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575807.651228:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4153
00000100:00080000:1.0:1788575807.651232:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575807.651237:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575807.651243:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575807.651249:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575807/real 1788575807]  req@ffff8dc005dc2d80 x1875453361298048/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575832 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575807.651257:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361298432/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575807.651275:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575807.651279:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575807.651281:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575807.651286:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4153
00000100:00080000:1.0:1788575807.651290:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575807.651294:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575807.651299:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575807.651310:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361298560/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575807.651318:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575807.651321:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575807.651323:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575807.651327:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4153
00000100:00080000:1.0:1788575807.651331:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575807.651335:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575807.651341:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575807.651347:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361298048/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575832 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575807.651354:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361298688/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575807.651359:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575807.651366:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788575807.651367:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788575807.651371:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361298048:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788575807.651374:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575807.651378:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575807.651383:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4153
00000100:00080000:1.0:1788575807.651386:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575807.651390:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575807.651393:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361298176:192.168.202.140@tcp:38:kworker.0
00000008:00100000:1.0:1788575807.651397:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575807.651413:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361298816/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788575807.651419:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575807.651432:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575807/real 1788575807]  req@ffff8dc005dc3800 x1875453361298176/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575832 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575807.651442:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361298176/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575832 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575807.651546:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575807.651548:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575807.651551:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361298176:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575807.651557:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361298304:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575807.651584:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575807.651635:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575807/real 1788575807]  req@ffff8dc005dc1500 x1875453361298304/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575832 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575807.651644:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361298304/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575832 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575807.651649:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575807.651651:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575807.651653:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361298304:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575807.651657:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361298432:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575807.651670:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575807.651676:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575807/real 1788575807]  req@ffff8dc005dc0a80 x1875453361298432/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575832 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575807.651682:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361298432/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575832 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575807.651687:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575807.651689:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575807.651691:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361298432:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575807.651694:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361298560:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575807.651703:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575807.651708:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575807/real 1788575807]  req@ffff8dc005dc1c00 x1875453361298560/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575832 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575807.651713:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361298560/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575832 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575807.651719:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575807.651720:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575807.651722:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361298560:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575807.651725:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361298688:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575807.651734:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575807.651738:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575807/real 1788575807]  req@ffff8dc005dc0700 x1875453361298688/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575832 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575807.651744:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361298688/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575832 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575807.651748:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575807.651750:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575807.651752:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361298688:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575807.651764:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361298816:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575807.651773:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575807.651778:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575807/real 1788575807]  req@ffff8dc005dc3b80 x1875453361298816/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575832 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575807.651784:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361298816/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575832 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575807.651789:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575807.651790:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575807.651792:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361298816:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575808.034966:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575808.034970:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575808.034972:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575808.034973:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575808.034997:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575808.035045:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575808.674982:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575809.058962:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575809.058963:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575809.058964:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575809.058964:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575809.058986:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575809.059040:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575809.698980:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575810.082967:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575810.082967:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575810.082986:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575810.083012:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575810.083013:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575810.083077:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575810.722950:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575811.106956:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575811.106975:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575811.107051:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575811.107244:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575811.107264:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575811.107290:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575811.746911:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575812.130989:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575812.130989:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575812.130989:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575812.131060:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575812.131081:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575812.131091:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575812.770978:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788575812.770986:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575812.770992:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788575812.770997:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575812.771006:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4158
00000100:00080000:2.0:1788575812.771015:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575812.771022:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575812.771064:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453361298944/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575812.771088:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575812.771092:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575812.771094:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575812.771098:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4158
00000100:00080000:2.0:1788575812.771102:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575812.771105:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575812.771114:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575812.771133:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361298944:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788575812.771138:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453361299072/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575812.771151:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575812.771154:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575812.771156:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575812.771160:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4158
00000100:00080000:2.0:1788575812.771164:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575812.771168:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575812.771174:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575812.771186:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453361299200/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575812.771195:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575812.771199:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575812.771201:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575812.771205:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4158
00000100:00080000:2.0:1788575812.771209:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1788575812.771214:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788575812.771217:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575812.771224:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575812.771236:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361299328/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575812.771244:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575812.771247:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575812.771249:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575812.771253:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4158
00000100:00080000:2.0:1788575812.771256:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788575812.771269:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575812/real 1788575812]  req@ffff8dc020496a00 x1875453361298944/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575837 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575812.771270:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575812.771278:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575812.771295:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453361298944/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575837 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575812.771298:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361299456/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575812.771336:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575812.771340:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575812.771344:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575812.771347:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575812.771349:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4158
00000100:00080000:3.0:1788575812.771354:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788575812.771355:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788575812.771362:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361298944:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788575812.771363:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575812.771371:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575812.771386:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453361299584/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575812.771392:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361299072:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788575812.771402:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575812.771407:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575812.771409:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575812.771413:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4158
00000100:00080000:2.0:1788575812.771419:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575812.771423:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575812.771427:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788575812.771432:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575812.771442:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361299712/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575812.771453:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575812/real 1788575812]  req@ffff8dc020494a80 x1875453361299072/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575837 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575812.771469:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453361299072/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575837 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575812.771479:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575812.771483:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575812.771486:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361299072:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575812.771492:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361299200:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575812.771514:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575812.771525:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575812/real 1788575812]  req@ffff8dc020494e00 x1875453361299200/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575837 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575812.771542:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453361299200/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575837 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575812.771550:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575812.771552:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575812.771556:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361299200:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575812.771561:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361299328:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575812.771580:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575812.771590:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575812/real 1788575812]  req@ffff8dc020495880 x1875453361299328/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575837 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575812.771601:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361299328/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575837 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575812.771609:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575812.771613:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575812.771616:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361299328:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575812.771621:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361299456:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575812.771640:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575812.771649:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575812/real 1788575812]  req@ffff8dc020494000 x1875453361299456/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575837 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575812.771660:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361299456/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575837 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575812.771674:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575812.771677:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575812.771680:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361299456:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575812.771695:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361299584:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575812.771712:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575812.771720:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575812/real 1788575812]  req@ffff8dc020497100 x1875453361299584/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575837 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575812.771731:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453361299584/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575837 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575812.771739:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575812.771741:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575812.771744:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361299584:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575812.771749:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361299712:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575812.771762:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575812.771769:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575812/real 1788575812]  req@ffff8dc020495180 x1875453361299712/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575837 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575812.771775:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361299712/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575837 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575812.771780:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575812.771781:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575812.771784:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361299712:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575813.154955:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575813.154955:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575813.154960:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575813.154971:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575813.154995:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575813.155010:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575813.794977:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575814.178953:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575814.178953:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788575814.179004:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575814.179066:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575814.179083:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575814.179109:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575814.818984:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575815.202962:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575815.202962:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575815.202997:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575815.204402:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575815.204412:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575815.204418:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575815.842991:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575816.226971:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575816.226971:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575816.226972:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575816.226972:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575816.227002:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788575816.227067:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575816.866993:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575817.250975:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575817.250976:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575817.250985:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575817.251005:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575817.251008:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575817.251040:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575817.890988:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575817.891012:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575817.891018:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788575817.891023:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575817.891032:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4163
00000100:00080000:0.0:1788575817.891041:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575817.891048:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575817.891081:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361299840/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575817.891105:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575817.891108:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575817.891110:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575817.891120:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4163
00000100:00080000:0.0:1788575817.891124:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575817.891128:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575817.891133:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361299840:192.168.202.140@tcp:250:kworker.0
00000008:00100000:0.0:1788575817.891139:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575817.891155:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361299968/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575817.891166:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575817.891169:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575817.891172:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575817.891187:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4163
00000100:00080000:0.0:1788575817.891193:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575817.891197:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575817.891202:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575817.891214:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361300096/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575817.891229:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788575817.891233:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361299968:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788575817.891234:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575817.891237:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575817.891247:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4163
00000100:00080000:0.0:1788575817.891258:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575817.891262:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575817.891267:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575817.891273:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361300096:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575817.891281:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453361300224/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575817.891292:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575817.891296:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:3.0:1788575817.891297:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361300224:192.168.202.140@tcp:8:kworker.0
00000100:00080000:0.0:1788575817.891298:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575817.891305:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4163
00000100:00080000:0.0:1788575817.891309:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575817.891313:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575817.891317:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575817.891328:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361300352/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575817.891341:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575817.891344:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575817.891346:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575817.891351:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4163
00000100:00100000:3.0:1788575817.891352:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361300352:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788575817.891355:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575817.891363:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575817.891368:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575817.891379:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361300480/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575817.891388:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575817.891391:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575817.891395:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788575817.891395:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361300480:192.168.202.140@tcp:8:kworker.0
00000100:00080000:0.0:1788575817.891402:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4163
00000100:00080000:0.0:1788575817.891405:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575817.891409:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575817.891413:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575817.891425:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361300608/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575817.891460:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361300608:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575818.274941:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575818.274941:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575818.274943:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575818.274943:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575818.274972:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788575818.275022:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575818.914974:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575819.298965:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575819.298966:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575819.298966:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575819.298968:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575819.298999:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788575819.299027:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575819.938971:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575820.322961:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575820.322961:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575820.322961:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575820.322962:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575820.322992:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788575820.323036:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575820.962963:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000400:00000100:2.0:1788575820.963151:0:2337:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.140:988
00000400:00000100:2.0:1788575820.963189:0:2337:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.140@tcp at host 192.168.202.140 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:2.0:1788575820.963204:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:2.0:1788575820.963254:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:2.0:1788575820.963264:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:2.0:1788575820.963272:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:2.0:1788575820.963280:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:2.0:1788575820.963287:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:2.0:1788575820.963294:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:3.0:1788575820.963364:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575817/real 1788575820]  req@ffff8dc006712a00 x1875453361300608/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575842 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575820.963387:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361300608/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575842 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575820.963398:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575820.963403:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575820.963408:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361300608:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575820.963416:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575817/real 1788575820]  req@ffff8dc006713480 x1875453361300480/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575842 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575820.963428:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361300480/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575842 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575820.963436:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575820.963440:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575820.963443:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361300480:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575820.963450:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575817/real 1788575820]  req@ffff8dc006711c00 x1875453361300352/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575842 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575820.963462:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361300352/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575842 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575820.963470:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575820.963474:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575820.963477:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361300352:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575820.963484:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575817/real 1788575820]  req@ffff8dc006710380 x1875453361300224/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575842 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575820.963496:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453361300224/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575842 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575820.963504:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575820.963508:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575820.963511:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361300224:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575820.963518:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575817/real 1788575820]  req@ffff8dc006712300 x1875453361300096/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575842 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575820.963531:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361300096/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575842 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575820.963539:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575820.963543:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575820.963546:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361300096:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575820.963552:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575817/real 1788575820]  req@ffff8dc006712680 x1875453361299968/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575842 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575820.963563:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361299968/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575842 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575820.963573:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575820.963577:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575820.963580:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361299968:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575820.963587:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575817/real 1788575820]  req@ffff8dc006713800 x1875453361299840/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575842 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575820.963599:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361299840/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575842 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575820.963607:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575820.963610:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575820.963613:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361299840:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788575821.346979:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575821.346981:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575821.346987:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575821.347062:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575821.347072:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788575821.347152:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575821.986977:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575822.370958:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575822.370958:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575822.370960:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575822.370990:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575822.370992:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788575822.371000:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575823.010949:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575823.010972:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575823.010978:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788575823.010982:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575823.010990:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4168
00000100:00080000:0.0:1788575823.010998:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575823.011003:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575823.011027:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361300736/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575823.011070:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575823.011073:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575823.011074:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575823.011077:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4168
00000100:00080000:0.0:1788575823.011079:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575823.011082:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575823.011090:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575823.011105:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361300864/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575823.011128:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788575823.011130:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361300736:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788575823.011132:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575823.011135:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575823.011141:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4168
00000100:00080000:0.0:1788575823.011145:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575823.011148:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575823.011154:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575823.011167:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361300992/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575823.011195:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1788575823.011200:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788575823.011201:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575823.011205:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575823.011210:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4168
00000100:00080000:0.0:1788575823.011214:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575823.011217:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575823.011222:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575823.011233:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361301120/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575823.011245:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575823.011249:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575823.011251:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788575823.011255:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575823/real 1788575823]  req@ffff8dc006710e00 x1875453361300736/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575848 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575823.011256:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4168
00000100:00080000:0.0:1788575823.011263:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575823.011270:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575823.011276:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575823.011284:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361300736/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575848 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575823.011289:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361301248/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575823.011299:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575823.011303:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575823.011306:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788575823.011309:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575823.011313:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788575823.011314:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361300736:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788575823.011319:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4168
00000100:00080000:0.0:1788575823.011325:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575823.011331:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575823.011335:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575823.011348:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361301376/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575823.011348:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361300864:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788575823.011364:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575823.011367:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575823.011369:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575823.011372:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4168
00000100:00080000:0.0:1788575823.011384:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1788575823.011385:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788575823.011390:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575823.011395:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575823.011405:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575823/real 1788575823]  req@ffff8dc006711500 x1875453361300864/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575848 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575823.011409:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361301504/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575823.011435:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361300864/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575848 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575823.011453:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575823.011457:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575823.011460:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361300864:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575823.011467:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361300992:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575823.011489:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575823.011500:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575823/real 1788575823]  req@ffff8dc006711880 x1875453361300992/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575848 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575823.011511:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361300992/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575848 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575823.011519:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575823.011522:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575823.011526:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361300992:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575823.011531:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361301120:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575823.011549:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575823.011560:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575823/real 1788575823]  req@ffff8dc006713b80 x1875453361301120/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575848 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575823.011571:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361301120/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575848 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575823.011580:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575823.011583:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575823.011587:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361301120:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575823.011592:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361301248:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575823.011611:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575823.011629:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575823/real 1788575823]  req@ffff8dc006713100 x1875453361301248/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575848 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575823.011640:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361301248/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575848 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575823.011648:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575823.011651:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575823.011655:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361301248:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575823.011672:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361301376:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575823.011691:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575823.011764:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575823/real 1788575823]  req@ffff8dc006710e00 x1875453361301376/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575848 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575823.011779:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361301376/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575848 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575823.011786:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575823.011789:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575823.011793:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361301376:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575823.011798:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361301504:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575823.011817:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575823.011830:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575823/real 1788575823]  req@ffff8dc006713800 x1875453361301504/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575848 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575823.011839:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361301504/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575848 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575823.011845:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575823.011848:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575823.011851:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361301504:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575823.394980:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575823.394982:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575823.395192:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575823.395265:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788575823.395883:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575823.395894:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575824.034995:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575824.418961:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575824.418961:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575824.418965:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575824.418987:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575824.418987:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575824.419005:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575825.058948:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575825.442946:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575825.442952:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575825.442955:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575825.443001:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575825.443004:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575825.443014:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575826.082983:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575826.466983:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575826.466983:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575826.466994:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575826.467014:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575826.467029:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575826.467029:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575827.107014:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575827.490984:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575827.490984:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575827.490985:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575827.491035:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575827.491045:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575827.491113:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575828.130973:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575828.130991:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575828.130995:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575828.130999:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575828.131007:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4173
00000100:00080000:1.0:1788575828.131016:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575828.131024:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575828.131059:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361301632/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575828.131077:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575828.131079:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575828.131080:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575828.131083:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4173
00000100:00080000:1.0:1788575828.131086:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575828.131091:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575828.131101:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575828.131107:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361301632:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788575828.131118:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361301760/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575828.131128:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575828.131131:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575828.131133:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575828.131138:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4173
00000100:00080000:1.0:1788575828.131141:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575828.131145:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575828.131149:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575828.131158:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361301888/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575828.131164:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575828.131166:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575828.131169:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1788575828.131170:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788575828.131175:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4173
00000100:00080000:1.0:1788575828.131178:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575828.131180:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575828.131183:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575828.131190:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361302016/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575828.131196:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575828.131198:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575828.131199:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575828.131202:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4173
00000100:00080000:1.0:1788575828.131204:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575828.131208:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575828.131209:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575828/real 1788575828]  req@ffff8dc005dc1180 x1875453361301632/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575853 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1788575828.131211:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575828.131220:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361302144/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575828.131228:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575828.131230:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575828.131232:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575828.131237:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4173
00000100:00100000:3.0:1788575828.131237:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361301632/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575853 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575828.131242:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575828.131246:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575828.131252:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788575828.131260:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1788575828.131262:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361302272/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575828.131266:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575828.131272:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361301632:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788575828.131275:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575828.131279:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575828.131280:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575828.131284:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4173
00000100:00080000:1.0:1788575828.131285:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575828.131287:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575828.131290:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575828.131295:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361302400/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575828.131302:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361301760:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575828.131330:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575828.131343:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575828/real 1788575828]  req@ffff8dc005dc3b80 x1875453361301760/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575853 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575828.131355:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361301760/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575853 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575828.131364:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575828.131367:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575828.131370:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361301760:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575828.131375:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361301888:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575828.131397:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575828.131405:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575828/real 1788575828]  req@ffff8dc005dc0700 x1875453361301888/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575853 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575828.131412:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361301888/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575853 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575828.131417:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575828.131419:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575828.131421:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361301888:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575828.131425:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361302016:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575828.131434:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575828.131439:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575828/real 1788575828]  req@ffff8dc005dc1c00 x1875453361302016/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575853 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575828.131446:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361302016/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575853 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575828.131451:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575828.131452:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575828.131454:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361302016:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575828.131457:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361302144:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575828.131466:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575828.131471:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575828/real 1788575828]  req@ffff8dc005dc0a80 x1875453361302144/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575853 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575828.131477:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361302144/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575853 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575828.131482:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575828.131483:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575828.131484:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361302144:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575828.131487:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361302272:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575828.131495:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575828.131503:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575828/real 1788575828]  req@ffff8dc005dc1500 x1875453361302272/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575853 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575828.131513:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361302272/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575853 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575828.131520:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575828.131523:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575828.131526:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361302272:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575828.131543:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361302400:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575828.131559:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575828.131566:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575828/real 1788575828]  req@ffff8dc005dc3800 x1875453361302400/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575853 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575828.131572:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361302400/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575853 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575828.131577:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575828.131579:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575828.131581:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361302400:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575828.514966:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575828.514986:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575828.514997:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575828.514999:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575828.515009:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575828.515068:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575829.154973:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575829.538983:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575829.538983:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575829.539008:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575829.539103:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575829.539131:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575829.539901:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575830.178944:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575830.562956:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575830.562957:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575830.563034:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575830.563143:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575830.563154:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575830.563225:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575831.202972:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575831.586955:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575831.586955:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575831.586955:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575831.586956:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575831.586986:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575831.587025:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575832.226967:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575832.610967:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575832.610967:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575832.610967:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575832.610992:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575832.610995:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788575832.611012:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575833.250991:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575833.251016:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575833.251023:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788575833.251028:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575833.251037:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4178
00000100:00080000:0.0:1788575833.251046:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575833.251053:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575833.251090:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361302528/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575833.251114:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575833.251117:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575833.251119:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575833.251123:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4178
00000100:00080000:0.0:1788575833.251127:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575833.251132:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575833.251142:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575833.251149:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361302528:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788575833.251165:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361302656/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575833.251178:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575833.251181:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575833.251182:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575833.251185:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4178
00000100:00080000:0.0:1788575833.251189:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575833.251192:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575833.251196:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575833.251208:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453361302784/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788575833.251213:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788575833.251223:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575833.251227:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575833.251229:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575833.251245:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4178
00000100:00080000:0.0:1788575833.251249:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575833.251252:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575833.251257:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575833.251272:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361302912/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575833.251272:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575833/real 1788575833]  req@ffff8dc006712680 x1875453361302528/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575858 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575833.251299:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575833.251303:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575833.251305:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788575833.251306:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361302528/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575858 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575833.251311:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4178
00000100:00080000:0.0:1788575833.251317:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575833.251320:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575833.251321:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:3.0:1788575833.251328:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000008:00100000:0.0:1788575833.251329:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575833.251332:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361302528:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788575833.251341:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361303040/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575833.251353:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361302656:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788575833.251354:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575833.251360:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575833.251362:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575833.251367:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4178
00000100:00080000:0.0:1788575833.251371:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575833.251375:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575833.251380:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788575833.251385:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575833.251396:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361303168/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575833.251404:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575833/real 1788575833]  req@ffff8dc006712300 x1875453361302656/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575858 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575833.251409:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575833.251415:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575833.251417:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575833.251423:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4178
00000100:00080000:0.0:1788575833.251427:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788575833.251430:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361302656/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575858 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575833.251431:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575833.251437:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575833.251446:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361303296/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575833.251459:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575833.251465:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575833.251470:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361302656:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575833.251478:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361302784:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575833.251501:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575833.251513:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575833/real 1788575833]  req@ffff8dc006710380 x1875453361302784/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575858 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575833.251524:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453361302784/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575858 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575833.251533:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575833.251536:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575833.251539:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361302784:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575833.251543:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361302912:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575833.251557:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575833.251564:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575833/real 1788575833]  req@ffff8dc006711c00 x1875453361302912/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575858 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575833.251570:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361302912/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575858 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575833.251575:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575833.251577:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575833.251579:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361302912:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575833.251588:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361303040:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575833.251598:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575833.251603:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575833/real 1788575833]  req@ffff8dc006713480 x1875453361303040/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575858 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575833.251613:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361303040/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575858 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575833.251619:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575833.251620:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575833.251622:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361303040:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575833.251625:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361303168:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575833.251633:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575833.251638:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575833/real 1788575833]  req@ffff8dc006712a00 x1875453361303168/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575858 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575833.251645:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361303168/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575858 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575833.251649:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575833.251650:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575833.251652:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361303168:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575833.251655:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361303296:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575833.251663:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575833.251667:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575833/real 1788575833]  req@ffff8dc006712680 x1875453361303296/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575858 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575833.251673:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361303296/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575858 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575833.251682:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575833.251683:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575833.251696:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361303296:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575833.634959:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575833.634964:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575833.634968:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575833.634968:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575833.634988:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575833.635029:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575834.274995:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575834.658968:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575834.658968:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575834.658969:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575834.658997:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575834.659013:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575834.659020:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575835.298969:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575835.683011:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575835.683013:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575835.683049:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575835.683156:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575835.683168:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575835.683185:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575836.323005:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575836.706992:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575836.706992:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575836.706992:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575836.707084:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575836.707084:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575836.707120:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575837.347050:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575837.730969:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575837.730978:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575837.731002:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575837.731004:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788575837.731017:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575837.731033:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575838.370981:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788575838.370986:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575838.370997:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788575838.371003:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575838.371015:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4184
00000100:00080000:0.0:1788575838.371026:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575838.371034:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575838.371079:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361303424/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575838.371109:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575838.371113:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575838.371115:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575838.371119:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4184
00000100:00080000:0.0:1788575838.371124:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575838.371130:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575838.371142:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575838.371149:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361303424:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788575838.371157:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361303552/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575838.371168:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575838.371172:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575838.371174:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575838.371178:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4184
00000100:00080000:0.0:1788575838.371182:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575838.371187:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575838.371193:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575838.371208:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361303680/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575838.371215:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575838.371218:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575838.371219:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575838.371231:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4184
00000800:00000100:3.0:1788575838.371231:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788575838.371236:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575838.371241:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575838.371245:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575838.371254:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361303808/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575838.371260:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575838.371263:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575838.371264:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575838.371266:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4184
00000100:00080000:0.0:1788575838.371268:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575838.371270:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575838.371273:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575838.371281:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361303936/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575838.371288:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575838/real 1788575838]  req@ffff8dc006713800 x1875453361303424/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575863 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575838.371289:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575838.371296:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575838.371299:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575838.371305:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4184
00000100:00080000:0.0:1788575838.371309:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575838.371311:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575838.371315:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575838.371321:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361303424/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575863 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575838.371327:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361304064/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575838.371341:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575838.371344:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575838.371349:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788575838.371351:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575838.371355:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788575838.371356:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361303424:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788575838.371362:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4184
00000100:00080000:0.0:1788575838.371366:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575838.371369:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575838.371373:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575838.371382:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361304192/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575838.371399:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361303552:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575838.371428:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575838.371442:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575838/real 1788575838]  req@ffff8dc006710e00 x1875453361303552/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575863 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575838.371470:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361303552/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575863 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575838.371481:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575838.371485:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575838.371488:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361303552:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575838.371494:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361303680:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575838.371515:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575838.371526:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575838/real 1788575838]  req@ffff8dc006713100 x1875453361303680/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575863 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575838.371537:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361303680/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575863 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575838.371545:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575838.371549:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575838.371552:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361303680:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575838.371557:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361303808:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575838.371575:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575838.371585:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575838/real 1788575838]  req@ffff8dc006713b80 x1875453361303808/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575863 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575838.371622:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361303808/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575863 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575838.371631:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575838.371634:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575838.371637:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361303808:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575838.371642:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361303936:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575838.371670:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575838.371681:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575838/real 1788575838]  req@ffff8dc006711880 x1875453361303936/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575863 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575838.371692:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361303936/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575863 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575838.371701:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575838.371705:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575838.371708:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361303936:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575838.371713:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361304064:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575838.371730:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575838.371740:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575838/real 1788575838]  req@ffff8dc006711500 x1875453361304064/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575863 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575838.371750:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361304064/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575863 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575838.371771:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575838.371774:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575838.371776:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361304064:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575838.371793:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361304192:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575838.371811:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575838.371821:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575838/real 1788575838]  req@ffff8dc006713800 x1875453361304192/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575863 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575838.371830:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361304192/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575863 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575838.371837:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575838.371840:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575838.371843:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361304192:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575838.755006:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575838.755006:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575838.755006:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575838.755142:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575838.755170:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575838.755180:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575839.395031:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575839.779013:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575839.779013:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575839.779088:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575839.779089:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575839.779197:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575839.779224:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575840.418985:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575840.802986:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575840.803018:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575840.803025:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575840.803061:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575840.803159:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575840.803191:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575841.442975:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575841.826983:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575841.826984:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575841.827081:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575841.827110:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575841.827132:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575841.827308:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575842.467000:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575842.851034:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575842.851093:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575842.851145:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575842.851665:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575842.851696:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575842.851736:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575843.491316:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575843.492548:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575843.492554:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575843.492557:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575843.492566:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4189
00000100:00080000:1.0:1788575843.492576:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575843.492583:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575843.492616:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361304320/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575843.492638:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575843.492642:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575843.492644:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575843.492648:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4189
00000100:00080000:1.0:1788575843.492652:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575843.492656:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575843.492666:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575843.492669:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361304320:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788575843.492682:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361304448/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575843.492693:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575843.492695:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575843.492697:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575843.492700:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4189
00000100:00080000:1.0:1788575843.492703:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575843.492708:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575843.492713:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575843.492726:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361304576/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575843.492735:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575843.492739:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000800:00000100:3.0:1788575843.492742:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788575843.492743:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575843.492750:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4189
00000100:00080000:1.0:1788575843.492755:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575843.492759:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575843.492765:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575843.492787:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575843/real 1788575843]  req@ffff8dc005dc2d80 x1875453361304320/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575868 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575843.492792:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361304704/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575843.492812:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575843.492816:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575843.492818:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788575843.492821:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361304320/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575868 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575843.492825:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4189
00000100:00080000:1.0:1788575843.492832:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575843.492838:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:3.0:1788575843.492839:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:1.0:1788575843.492845:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788575843.492846:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575843.492854:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361304320:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788575843.492860:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361304832/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575843.492915:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361304448:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788575843.492917:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575843.492923:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575843.492925:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575843.492929:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4189
00000100:00080000:1.0:1788575843.492932:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575843.492935:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575843.492939:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788575843.492950:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575843.492951:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361304960/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575843.492960:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575843.492963:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575843.492965:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788575843.492970:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575843/real 1788575843]  req@ffff8dc005dc3800 x1875453361304448/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575868 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575843.492971:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4189
00000100:00080000:1.0:1788575843.492977:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575843.492985:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575843.492991:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575843.492995:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361304448/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575868 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575843.493006:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575843.493010:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575843.493016:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361305088/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575843.493016:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361304448:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575843.493037:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361304576:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575843.493061:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575843.493072:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575843/real 1788575843]  req@ffff8dc005dc1500 x1875453361304576/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575868 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575843.493084:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361304576/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575868 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575843.493092:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575843.493095:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575843.493098:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361304576:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575843.493104:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361304704:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575843.493129:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575843.493141:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575843/real 1788575843]  req@ffff8dc005dc0a80 x1875453361304704/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575868 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575843.493152:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361304704/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575868 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575843.493160:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575843.493163:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575843.493166:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361304704:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575843.493182:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361304832:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575843.493201:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575843.493212:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575843/real 1788575843]  req@ffff8dc005dc1c00 x1875453361304832/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575868 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575843.493233:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361304832/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575868 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575843.493241:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575843.493244:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575843.493247:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361304832:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575843.493252:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361304960:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575843.493272:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575843.493282:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575843/real 1788575843]  req@ffff8dc005dc0700 x1875453361304960/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575868 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575843.493299:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361304960/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575868 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575843.493306:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575843.493309:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575843.493312:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361304960:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575843.493317:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361305088:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575843.493344:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575843.493356:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575843/real 1788575843]  req@ffff8dc005dc3b80 x1875453361305088/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575868 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575843.493367:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361305088/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575868 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575843.493379:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575843.493382:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575843.493385:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361305088:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575843.874971:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575843.874980:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575843.875326:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575843.875419:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575843.875543:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575843.875564:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575844.514993:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575844.898990:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575844.899019:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575844.899071:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575844.899517:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575844.899545:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575844.901912:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575845.539023:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575845.922991:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575845.922991:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575845.923024:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575845.923095:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575845.926689:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575845.927279:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575846.563017:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575846.946967:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575846.946967:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575846.947017:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575846.947619:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575846.947643:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575846.947660:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575847.587163:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575847.970979:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575847.970979:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575847.971186:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575847.971341:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788575847.973056:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575847.973140:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575848.611014:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788575848.611014:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575848.611033:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788575848.611039:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575848.611050:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4194
00000100:00080000:3.0:1788575848.611062:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575848.611071:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575848.611120:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f800 x1875453361305216/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575848.611160:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575848.611164:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575848.611166:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575848.611170:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4194
00000100:00080000:3.0:1788575848.611173:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575848.611177:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575848.611195:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575848.611206:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361305216:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788575848.611212:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c000 x1875453361305344/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575848.611224:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575848.611227:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575848.611229:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575848.611247:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4194
00000100:00080000:3.0:1788575848.611251:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575848.611256:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575848.611262:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575848.611275:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644dc00 x1875453361305472/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575848.611285:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1788575848.611289:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788575848.611291:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575848.611295:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575848.611300:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4194
00000100:00080000:3.0:1788575848.611303:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575848.611308:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575848.611314:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575848.611328:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ce00 x1875453361305600/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575848.611337:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788575848.611345:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575848/real 1788575848]  req@ffff8dc00644f800 x1875453361305216/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575873 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575848.611364:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575848.611367:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575848.611373:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4194
00000100:00080000:3.0:1788575848.611380:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575848.611386:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575848.611393:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575848.611396:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f800 x1875453361305216/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575873 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575848.611410:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1788575848.611411:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ca80 x1875453361305728/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575848.611417:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575848.611426:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361305216:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788575848.611429:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575848.611434:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575848.611437:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575848.611442:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4194
00000100:00080000:3.0:1788575848.611446:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575848.611450:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575848.611455:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575848.611457:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361305344:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575848.611480:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ea00 x1875453361305856/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1788575848.611490:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788575848.611494:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575848.611499:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575848.611501:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575848.611506:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4194
00000100:00100000:0.0:1788575848.611508:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575848/real 1788575848]  req@ffff8dc00644c000 x1875453361305344/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575873 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575848.611510:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575848.611519:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575848.611526:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575848.611541:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c000 x1875453361305344/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575873 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575848.611545:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d500 x1875453361305984/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575848.611566:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575848.611571:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575848.611574:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361305344:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575848.611585:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361305472:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575848.611609:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575848.611621:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575848/real 1788575848]  req@ffff8dc00644dc00 x1875453361305472/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575873 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575848.611633:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644dc00 x1875453361305472/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575873 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575848.611641:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575848.611644:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575848.611647:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361305472:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575848.611652:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361305600:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575848.611671:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575848.611681:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575848/real 1788575848]  req@ffff8dc00644ce00 x1875453361305600/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575873 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575848.611691:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ce00 x1875453361305600/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575873 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575848.611704:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575848.611707:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575848.611710:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361305600:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575848.611715:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361305728:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575848.611733:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575848.611743:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575848/real 1788575848]  req@ffff8dc00644ca80 x1875453361305728/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575873 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575848.611752:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ca80 x1875453361305728/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575873 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575848.611760:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575848.611763:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575848.611765:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361305728:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575848.611783:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361305856:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575848.611801:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575848.611811:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575848/real 1788575848]  req@ffff8dc00644ea00 x1875453361305856/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575873 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575848.611829:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ea00 x1875453361305856/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575873 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575848.611836:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575848.611839:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575848.611842:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361305856:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575848.611848:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361305984:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575848.611884:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575848.611892:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575848/real 1788575848]  req@ffff8dc00644d500 x1875453361305984/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575873 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575848.611900:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d500 x1875453361305984/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575873 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575848.611905:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575848.611906:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575848.611908:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361305984:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575848.995008:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575848.995008:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575848.995144:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575848.995184:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575848.995222:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575848.995255:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575849.635119:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575850.019039:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575850.019045:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575850.019064:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575850.019077:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575850.019105:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788575850.019120:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575850.659007:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575851.042969:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575851.042969:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575851.042971:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575851.042998:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575851.043003:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575851.043016:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575851.682969:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575852.066975:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575852.066976:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575852.066979:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575852.067010:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575852.067019:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788575852.067036:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575852.707026:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575853.090947:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575853.090955:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575853.090979:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575853.091066:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575853.091114:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575853.091250:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00080000:2.0:1788575853.730969:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788575853.730974:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788575853.730985:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788575853.730993:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575853.731003:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4199
00000100:00080000:2.0:1788575853.731012:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575853.731019:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575853.731064:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361306112/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575853.731083:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575853.731085:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575853.731086:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575853.731089:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4199
00000100:00080000:2.0:1788575853.731092:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575853.731095:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575853.731104:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575853.731112:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453361306240/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575853.731115:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361306112:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788575853.731123:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575853.731126:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575853.731127:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575853.731130:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4199
00000100:00080000:2.0:1788575853.731131:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575853.731133:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575853.731136:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575853.731142:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453361306368/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575853.731148:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575853.731152:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575853.731153:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575853.731157:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4199
00000100:00080000:2.0:1788575853.731160:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575853.731163:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575853.731167:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575853.731178:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453361306496/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575853.731186:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575853.731189:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575853.731191:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1788575853.731196:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788575853.731198:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4199
00000100:00080000:2.0:1788575853.731204:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575853.731210:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575853.731222:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575853.731236:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361306624/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575853.731258:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788575853.731260:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575853/real 1788575853]  req@ffff8dc020494700 x1875453361306112/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575878 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575853.731260:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575853.731263:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575853.731268:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4199
00000100:00080000:2.0:1788575853.731272:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575853.731277:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575853.731283:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575853.731292:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361306112/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575878 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575853.731296:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361306752/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575853.731320:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575853.731321:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575853.731328:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575853.731331:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788575853.731331:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788575853.731339:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361306112:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788575853.731340:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4199
00000100:00080000:2.0:1788575853.731346:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575853.731352:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575853.731357:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575853.731366:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361306240:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575853.731371:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453361306880/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1788575853.731396:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575853.731411:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575853/real 1788575853]  req@ffff8dc020497480 x1875453361306240/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575878 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575853.731423:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453361306240/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575878 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575853.731433:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575853.731437:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575853.731439:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361306240:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575853.731443:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361306368:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575853.731458:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575853.731465:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575853/real 1788575853]  req@ffff8dc020496d80 x1875453361306368/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575878 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575853.731471:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453361306368/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575878 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575853.731485:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575853.731488:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575853.731491:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361306368:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575853.731497:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361306496:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575853.731514:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575853.731524:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575853/real 1788575853]  req@ffff8dc020494380 x1875453361306496/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575878 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575853.731531:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453361306496/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575878 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575853.731537:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575853.731539:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575853.731541:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361306496:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575853.731544:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361306624:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575853.731559:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575853.731568:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575853/real 1788575853]  req@ffff8dc020495500 x1875453361306624/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575878 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575853.731579:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361306624/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575878 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575853.731587:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575853.731591:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575853.731594:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361306624:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575853.731599:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361306752:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575853.731613:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575853.731619:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575853/real 1788575853]  req@ffff8dc020495180 x1875453361306752/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575878 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575853.731626:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361306752/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575878 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575853.731630:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575853.731632:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575853.731634:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361306752:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575853.731646:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361306880:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575853.731655:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575853.731660:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575853/real 1788575853]  req@ffff8dc020497100 x1875453361306880/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575878 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575853.731667:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453361306880/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575878 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575853.731671:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575853.731673:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575853.731674:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361306880:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575854.114993:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575854.114998:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575854.115077:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575854.115106:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575854.115123:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575854.115154:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575854.754979:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575855.138993:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575855.138993:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575855.139116:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575855.139165:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575855.139228:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788575855.139330:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575855.778986:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575856.162980:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575856.162980:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575856.163097:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575856.163164:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575856.163167:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575856.163327:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575856.802981:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575857.186976:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575857.186976:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575857.186976:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575857.187010:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575857.187014:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575857.187016:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575857.826947:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575858.211018:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575858.211031:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575858.211136:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575858.211159:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575858.211234:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788575858.211276:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575858.850986:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575858.850990:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575858.850997:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575858.851001:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575858.851009:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4204
00000100:00080000:1.0:1788575858.851017:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575858.851023:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575858.851053:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361307008/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575858.851084:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575858.851088:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575858.851091:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575858.851096:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4204
00000100:00080000:1.0:1788575858.851099:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575858.851105:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575858.851107:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361307008:192.168.202.140@tcp:250:kworker.0
00000008:00100000:1.0:1788575858.851116:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575858.851134:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361307136/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575858.851162:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575858.851165:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575858.851167:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575858.851172:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4204
00000100:00080000:1.0:1788575858.851175:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575858.851179:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:0.0:1788575858.851185:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:1.0:1788575858.851188:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575858.851204:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361307264/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575858.851217:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575858.851220:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575858.851222:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575858.851225:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4204
00000100:00080000:1.0:1788575858.851238:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575858.851242:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575858.851247:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575858.851258:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361307392/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575858.851266:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575858.851269:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575858.851271:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575858.851275:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4204
00000100:00080000:1.0:1788575858.851278:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575858.851281:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575858.851286:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575858.851297:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575858/real 1788575858]  req@ffff8dc005dc1180 x1875453361307008/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575883 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575858.851299:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361307520/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575858.851324:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788575858.851330:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361307008/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575883 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575858.851341:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575858.851345:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575858.851348:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575858.851352:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4204
00000100:00080000:0.0:1788575858.851355:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788575858.851359:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788575858.851361:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361307008:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788575858.851367:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575858.851371:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575858.851385:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361307648/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575858.851395:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788575858.851397:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361307136:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788575858.851399:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575858.851403:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575858.851408:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4204
00000100:00080000:1.0:1788575858.851413:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575858.851416:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575858.851421:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788575858.851429:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575858.851434:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361307776/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575858.851445:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575858/real 1788575858]  req@ffff8dc005dc3b80 x1875453361307136/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575883 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575858.851460:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361307136/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575883 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575858.851470:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575858.851474:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575858.851477:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361307136:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575858.851483:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361307264:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575858.851504:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575858.851514:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575858/real 1788575858]  req@ffff8dc005dc0700 x1875453361307264/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575883 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575858.851521:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361307264/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575883 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575858.851527:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575858.851528:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575858.851530:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361307264:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575858.851534:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361307392:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575858.851546:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575858.851552:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575858/real 1788575858]  req@ffff8dc005dc1c00 x1875453361307392/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575883 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575858.851558:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361307392/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575883 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575858.851563:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575858.851565:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575858.851567:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361307392:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575858.851570:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361307520:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575858.851579:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575858.851584:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575858/real 1788575858]  req@ffff8dc005dc0a80 x1875453361307520/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575883 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575858.851590:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361307520/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575883 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575858.851595:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575858.851597:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575858.851598:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361307520:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575858.851609:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361307648:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575858.851618:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575858.851623:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575858/real 1788575858]  req@ffff8dc005dc1500 x1875453361307648/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575883 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575858.851629:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361307648/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575883 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575858.851633:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575858.851635:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575858.851636:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361307648:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575858.851640:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361307776:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575858.851654:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575858.851664:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575858/real 1788575858]  req@ffff8dc005dc3800 x1875453361307776/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575883 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575858.851675:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361307776/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575883 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575858.851682:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575858.851685:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575858.851688:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361307776:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575859.234972:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575859.234972:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575859.234972:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788575859.235054:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575859.235115:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575859.235163:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575859.874988:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575860.258984:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575860.259143:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788575860.260338:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575860.260345:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575860.260352:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575860.260359:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575860.899028:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575861.282964:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575861.282965:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575861.283048:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575861.286217:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575861.286217:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575861.286560:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575861.926570:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575862.307018:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575862.307031:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575862.307084:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788575862.307158:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575862.307178:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575862.307192:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575862.947015:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575863.330985:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575863.331032:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575863.331066:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575863.331069:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575863.332231:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575863.332305:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575863.971030:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788575863.971110:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575863.971117:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788575863.971122:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575863.971133:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4209
00000100:00080000:2.0:1788575863.971146:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575863.971155:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575863.971208:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361307904/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575863.971249:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575863.971253:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575863.971255:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575863.971259:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4209
00000100:00080000:2.0:1788575863.971263:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575863.971268:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575863.971279:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575863.971292:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361308032/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575863.971300:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575863.971304:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575863.971305:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575863.971309:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4209
00000100:00080000:2.0:1788575863.971312:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575863.971316:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575863.971321:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575863.971330:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453361308160/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575863.971339:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575863.971342:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575863.971344:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575863.971347:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4209
00000100:00080000:2.0:1788575863.971351:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575863.971355:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575863.971359:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575863.971369:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453361308288/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575863.971377:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575863.971381:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575863.971382:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575863.971386:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4209
00000100:00080000:2.0:1788575863.971389:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575863.971393:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575863.971398:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575863.971407:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453361308416/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575863.971415:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575863.971418:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575863.971420:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575863.971423:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4209
00000100:00080000:2.0:1788575863.971426:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575863.971430:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575863.971434:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575863.971444:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453361308544/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575863.971457:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575863.971460:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575863.971461:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575863.971465:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4209
00000100:00080000:2.0:1788575863.971468:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575863.971471:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575863.971476:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575863.971485:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361308672/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788575863.971567:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361307904:192.168.202.140@tcp:250:kworker.0
00000800:00000100:0.0:1788575863.971644:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575863.971699:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575863/real 1788575863]  req@ffff8dc020494000 x1875453361307904/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575888 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575863.971719:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361307904/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575888 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575863.971729:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575863.971734:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575863.971739:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361307904:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788575863.971746:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361308032:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575863.971768:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575863.971781:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575863/real 1788575863]  req@ffff8dc020495880 x1875453361308032/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575888 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575863.971792:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361308032/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575888 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575863.971802:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575863.971806:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575863.971808:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361308032:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575863.971814:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361308160:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575863.971833:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575863.971844:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575863/real 1788575863]  req@ffff8dc020494e00 x1875453361308160/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575888 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575863.971855:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453361308160/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575888 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575863.971864:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575863.971887:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575863.971891:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361308160:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575863.971896:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361308288:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575863.971916:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575863.971927:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575863/real 1788575863]  req@ffff8dc020494a80 x1875453361308288/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575888 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575863.971944:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453361308288/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575888 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575863.971953:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575863.971955:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575863.971958:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361308288:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575863.971964:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361308416:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788575863.971983:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575863.971993:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575863/real 1788575863]  req@ffff8dc020496a00 x1875453361308416/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575888 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575863.972005:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453361308416/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575888 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575863.972013:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575863.972016:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575863.972019:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361308416:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575863.972025:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361308544:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575863.972056:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575863.972066:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575863/real 1788575863]  req@ffff8dc020497100 x1875453361308544/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575888 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575863.972077:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453361308544/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575888 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575863.972085:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575863.972088:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575863.972091:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361308544:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575863.972096:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361308672:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788575863.972113:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575863.972122:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575863/real 1788575863]  req@ffff8dc020495180 x1875453361308672/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575888 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575863.972133:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361308672/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575888 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575863.972140:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575863.972143:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788575863.972146:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361308672:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575864.355017:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575864.355017:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575864.355036:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788575864.356430:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575864.356440:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575864.356490:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575864.995077:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575865.378960:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575865.378965:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575865.379034:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575865.379098:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575865.379100:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575865.379206:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575866.018988:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575866.402975:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575866.402975:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575866.402990:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575866.403015:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575866.403035:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788575866.403052:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575867.043066:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575867.427735:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575867.428267:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575867.428294:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575867.428377:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575867.428399:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575867.428401:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575868.067044:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575868.451006:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575868.451006:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575868.451043:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575868.451062:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575868.451066:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788575868.451091:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575869.092055:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575869.092060:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575869.092067:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788575869.092071:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575869.092081:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4214
00000100:00080000:0.0:1788575869.092092:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575869.092100:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575869.092138:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361308800/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575869.092170:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575869.092174:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575869.092175:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575869.092179:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4214
00000100:00080000:0.0:1788575869.092183:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575869.092187:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575869.092197:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575869.092222:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361308800:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788575869.092225:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361308928/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575869.092238:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575869.092241:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575869.092243:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575869.092247:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4214
00000100:00080000:0.0:1788575869.092251:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575869.092255:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575869.092260:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575869.092272:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361309056/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575869.092282:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575869.092288:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000800:00000100:3.0:1788575869.092288:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788575869.092294:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575869.092300:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4214
00000100:00080000:0.0:1788575869.092304:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575869.092309:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575869.092314:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575869.092327:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361309184/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575869.092334:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575869/real 1788575869]  req@ffff8dc006712680 x1875453361308800/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575894 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575869.092339:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575869.092347:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575869.092350:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575869.092356:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4214
00000100:00080000:0.0:1788575869.092359:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575869.092365:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575869.092365:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361308800/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575894 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1788575869.092372:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788575869.092385:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1788575869.092388:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453361309312/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575869.092392:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575869.092401:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361308800:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788575869.092405:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575869.092409:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575869.092411:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575869.092417:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4214
00000100:00080000:0.0:1788575869.092420:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575869.092424:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575869.092429:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361308928:192.168.202.140@tcp:38:kworker.0
00000008:00100000:0.0:1788575869.092430:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575869.092447:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361309440/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575869.092457:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1788575869.092462:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788575869.092464:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575869.092467:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575869.092472:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4214
00000100:00080000:0.0:1788575869.092476:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788575869.092481:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575869/real 1788575869]  req@ffff8dc006712a00 x1875453361308928/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575894 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575869.092482:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575869.092489:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575869.092503:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361308928/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575894 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575869.092508:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361309568/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575869.092522:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575869.092529:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575869.092534:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361308928:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575869.092542:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361309056:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575869.092563:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575869.092574:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575869/real 1788575869]  req@ffff8dc006713480 x1875453361309056/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575894 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575869.092585:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361309056/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575894 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575869.092594:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575869.092597:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575869.092600:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361309056:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575869.092606:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361309184:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575869.092626:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575869.092638:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575869/real 1788575869]  req@ffff8dc006711c00 x1875453361309184/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575894 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575869.092649:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361309184/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575894 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575869.092658:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575869.092660:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575869.092663:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361309184:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575869.092669:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361309312:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575869.092688:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575869.092699:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575869/real 1788575869]  req@ffff8dc006710380 x1875453361309312/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575894 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575869.092710:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453361309312/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575894 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575869.092718:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575869.092721:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575869.092724:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361309312:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575869.092742:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361309440:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575869.092764:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575869.092775:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575869/real 1788575869]  req@ffff8dc006712300 x1875453361309440/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575894 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575869.092792:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361309440/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575894 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575869.092799:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575869.092802:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575869.092805:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361309440:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575869.092811:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361309568:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575869.092830:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575869.092840:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575869/real 1788575869]  req@ffff8dc006712680 x1875453361309568/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575894 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575869.092850:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361309568/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575894 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575869.092858:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575869.092861:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575869.092864:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361309568:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575869.475002:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575869.475008:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575869.475042:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788575869.475088:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575869.475168:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575869.475187:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575870.115109:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575870.498979:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575870.498980:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575870.499001:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575870.499005:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575870.499106:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575870.499643:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575871.139008:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575871.522986:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575871.522986:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575871.522986:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575871.523017:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575871.523018:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575871.523021:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575872.162976:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575872.546965:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575872.546965:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575872.546971:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575872.546995:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575872.546996:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575872.546998:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575873.186979:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575873.570968:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575873.570968:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575873.570968:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575873.570998:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575873.571014:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788575873.571024:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575874.210985:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575874.211089:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575874.211095:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788575874.211098:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575874.211107:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4219
00000100:00080000:0.0:1788575874.211117:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575874.211123:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575874.211157:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361309696/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575874.211186:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575874.211190:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575874.211191:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575874.211194:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4219
00000100:00080000:0.0:1788575874.211197:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575874.211201:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575874.211210:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575874.211222:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361309696:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788575874.211225:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361309824/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575874.211239:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575874.211242:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575874.211243:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575874.211246:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4219
00000100:00080000:0.0:1788575874.211250:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575874.211254:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575874.211259:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575874.211270:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361309952/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575874.211278:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575874.211281:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575874.211283:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575874.211286:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4219
00000100:00080000:0.0:1788575874.211290:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1788575874.211295:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788575874.211297:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575874.211303:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575874.211314:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361310080/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575874.211322:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575874.211325:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575874.211327:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575874.211332:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4219
00000100:00080000:0.0:1788575874.211335:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788575874.211340:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575874/real 1788575874]  req@ffff8dc006713800 x1875453361309696/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575899 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575874.211341:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575874.211348:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575874.211361:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361310208/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575874.211370:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788575874.211374:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361309696/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575899 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575874.211375:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575874.211379:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575874.211387:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4219
00000100:00080000:0.0:1788575874.211392:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575874.211392:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575874.211399:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:3.0:1788575874.211401:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575874.211407:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361309696:192.168.202.140@tcp:250:kworker.0
00000008:00100000:0.0:1788575874.211419:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575874.211430:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361309824:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575874.211435:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361310336/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575874.211453:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575874.211456:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575874.211459:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1788575874.211460:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788575874.211466:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4219
00000100:00080000:0.0:1788575874.211472:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575874.211479:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575874.211480:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575874/real 1788575874]  req@ffff8dc006711500 x1875453361309824/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575899 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1788575874.211484:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575874.211501:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361310464/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575874.211501:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361309824/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575899 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575874.211529:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575874.211533:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575874.211543:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361309824:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575874.211550:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361309952:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575874.211569:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575874.211580:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575874/real 1788575874]  req@ffff8dc006711880 x1875453361309952/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575899 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575874.211591:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361309952/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575899 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575874.211605:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575874.211609:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575874.211611:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361309952:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575874.211615:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361310080:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575874.211628:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575874.211635:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575874/real 1788575874]  req@ffff8dc006713b80 x1875453361310080/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575899 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575874.211641:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361310080/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575899 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575874.211649:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575874.211651:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575874.211652:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361310080:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575874.211656:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361310208:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575874.211667:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575874.211672:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575874/real 1788575874]  req@ffff8dc006713100 x1875453361310208/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575899 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575874.211678:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361310208/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575899 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575874.211683:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575874.211684:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575874.211687:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361310208:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575874.211697:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361310336:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575874.211707:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575874.211712:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575874/real 1788575874]  req@ffff8dc006710e00 x1875453361310336/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575899 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575874.211718:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361310336/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575899 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575874.211723:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575874.211725:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575874.211726:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361310336:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575874.211729:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361310464:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575874.211737:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575874.211742:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575874/real 1788575874]  req@ffff8dc006713800 x1875453361310464/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575899 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575874.211748:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361310464/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575899 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575874.211752:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575874.211754:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575874.211755:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361310464:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575874.594948:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575874.594948:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575874.594991:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575874.595082:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575874.595084:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575874.595102:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575875.234944:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575875.618978:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575875.618978:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575875.619610:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575875.619887:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575875.619891:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575875.619900:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575876.259003:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575876.643025:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575876.643029:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788575876.643085:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575876.643202:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575876.643207:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575876.643395:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575877.282973:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575877.666971:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575877.666971:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575877.667004:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575877.667079:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575877.667092:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575877.667092:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575878.306995:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575878.690983:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575878.690989:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788575878.691016:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575878.691125:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575878.691141:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575878.691184:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575879.330943:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575879.330953:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:2.0:1788575879.330957:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575879.330958:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575879.330970:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4224
00000100:00080000:0.0:1788575879.330980:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575879.330988:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575879.331030:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361310592/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575879.331055:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575879.331059:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575879.331061:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575879.331065:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4224
00000100:00080000:0.0:1788575879.331069:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575879.331073:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575879.331082:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575879.331093:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361310592:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788575879.331096:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361310720/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575879.331110:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575879.331113:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575879.331115:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575879.331119:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4224
00000100:00080000:0.0:1788575879.331123:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575879.331127:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575879.331131:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575879.331141:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453361310848/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575879.331150:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575879.331153:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575879.331155:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1788575879.331161:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788575879.331164:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4224
00000100:00080000:0.0:1788575879.331169:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575879.331173:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575879.331178:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575879.331188:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361310976/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575879.331197:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575879.331200:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575879.331205:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1788575879.331205:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575879/real 1788575879]  req@ffff8dc006712680 x1875453361310592/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575904 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575879.331210:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4224
00000100:00080000:0.0:1788575879.331215:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575879.331221:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575879.331228:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575879.331239:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361311104/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788575879.331244:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361310592/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575904 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575879.331252:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575879.331260:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575879.331262:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575879.331264:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575879.331268:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4224
00000100:00080000:0.0:1788575879.331272:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575879.331272:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788575879.331280:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575879.331280:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361310592:192.168.202.140@tcp:250:kworker.0
00000008:00100000:0.0:1788575879.331287:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575879.331303:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361311232/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788575879.331307:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361310720:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788575879.331321:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575879.331325:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575879.331326:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575879.331331:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4224
00000100:00080000:0.0:1788575879.331335:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575879.331340:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:1.0:1788575879.331340:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:0.0:1788575879.331348:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575879.331359:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361311360/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788575879.331360:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575879/real 1788575879]  req@ffff8dc006712300 x1875453361310720/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575904 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575879.331389:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361310720/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575904 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575879.331401:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575879.331404:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575879.331408:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361310720:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788575879.331415:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361310848:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788575879.331433:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575879.331446:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575879/real 1788575879]  req@ffff8dc006710380 x1875453361310848/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575904 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575879.331457:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453361310848/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575904 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575879.331470:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575879.331472:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575879.331475:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361310848:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575879.331481:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361310976:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788575879.331497:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575879.331506:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575879/real 1788575879]  req@ffff8dc006711c00 x1875453361310976/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575904 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575879.331515:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361310976/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575904 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575879.331523:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575879.331525:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575879.331528:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361310976:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575879.331534:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361311104:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788575879.331549:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575879.331558:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575879/real 1788575879]  req@ffff8dc006713480 x1875453361311104/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575904 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575879.331567:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361311104/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575904 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575879.331575:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575879.331578:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575879.331581:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361311104:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788575879.331599:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361311232:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788575879.331617:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575879.331628:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575879/real 1788575879]  req@ffff8dc006712a00 x1875453361311232/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575904 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575879.331640:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361311232/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575904 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575879.331646:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575879.331650:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575879.331653:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361311232:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575879.331658:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361311360:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788575879.331679:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575879.331707:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575879/real 1788575879]  req@ffff8dc006712680 x1875453361311360/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575904 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575879.331733:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361311360/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575904 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575879.331741:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575879.331744:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575879.331747:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361311360:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575879.714973:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575879.714994:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575879.715079:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575879.715093:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575879.715213:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575879.715240:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575880.355148:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575880.739053:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575880.739158:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575880.739244:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788575880.739296:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575880.741823:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575880.741827:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575881.379068:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575881.763011:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575881.763011:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575881.763048:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575881.763051:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575881.763109:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575881.763116:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575882.402958:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575882.787009:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575882.787011:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575882.787056:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575882.787068:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575882.787123:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575882.787240:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575883.427004:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575883.811014:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575883.811014:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575883.811433:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575883.811454:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575883.811471:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575883.811571:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1788575884.450960:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788575884.450968:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575884.450972:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788575884.450985:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575884.451001:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4230
00000100:00080000:0.0:1788575884.451013:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575884.451023:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575884.451072:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361311488/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575884.451104:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575884.451108:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575884.451111:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575884.451115:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4230
00000100:00080000:0.0:1788575884.451119:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575884.451124:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575884.451137:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575884.451146:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361311488:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788575884.451153:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361311616/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575884.451165:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575884.451169:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575884.451171:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575884.451175:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4230
00000100:00080000:0.0:1788575884.451179:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575884.451183:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575884.451189:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575884.451205:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361311744/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575884.451214:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575884.451218:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575884.451220:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575884.451225:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4230
00000100:00080000:0.0:1788575884.451229:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575884.451232:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575884.451238:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575884.451250:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361311872/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575884.451259:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575884.451262:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575884.451265:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575884.451282:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4230
00000100:00100000:1.0:1788575884.451283:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361311616:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788575884.451289:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575884.451296:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575884.451302:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575884.451317:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361312000/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575884.451328:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575884.451331:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575884.451334:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1788575884.451334:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361311744:192.168.202.140@tcp:8:kworker.0
00000100:00080000:0.0:1788575884.451342:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4230
00000100:00080000:0.0:1788575884.451347:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575884.451352:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575884.451357:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575884.451367:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361312128/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575884.451374:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575884.451376:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575884.451378:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575884.451383:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4230
00000100:00100000:1.0:1788575884.451383:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361311872:192.168.202.140@tcp:8:kworker.0
00000100:00080000:0.0:1788575884.451385:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575884.451390:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575884.451394:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575884.451404:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361312256/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788575884.451433:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361312000:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788575884.451460:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361312128:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575884.451487:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361312256:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575884.834965:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575884.834997:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575884.835076:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788575884.835076:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575884.835748:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575884.835749:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575885.475015:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575885.859036:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575885.859037:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575885.859037:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575885.859075:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575885.859090:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575885.859096:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575886.498999:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575886.882963:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575886.882966:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575886.882967:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575886.882996:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575886.882997:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788575886.883028:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575887.522969:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000400:00000100:3.0:1788575887.523119:0:2336:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.140:988
00000400:00000100:3.0:1788575887.523154:0:2336:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.140@tcp at host 192.168.202.140 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:3.0:1788575887.523170:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788575887.523216:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788575887.523225:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788575887.523234:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788575887.523242:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788575887.523249:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788575887.523257:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:1.0:1788575887.523427:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575884/real 1788575887]  req@ffff8dc006711880 x1875453361312000/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575909 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575887.523449:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361312000/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575909 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575887.523462:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575887.523467:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575887.523476:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361312000:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788575887.523484:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575884/real 1788575887]  req@ffff8dc006711500 x1875453361312128/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575909 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575887.523495:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361312128/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575909 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575887.523503:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575887.523506:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575887.523509:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361312128:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575887.523516:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575884/real 1788575887]  req@ffff8dc006712680 x1875453361312256/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575909 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575887.523526:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361312256/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575909 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575887.523533:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575887.523536:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575887.523539:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361312256:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575887.523545:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575884/real 1788575887]  req@ffff8dc006710e00 x1875453361311616/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575909 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575887.523591:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361311616/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575909 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575887.523601:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575887.523604:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575887.523607:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361311616:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788575887.523614:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575884/real 1788575887]  req@ffff8dc006713100 x1875453361311744/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575909 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575887.523630:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361311744/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575909 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575887.523637:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575887.523640:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575887.523643:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361311744:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575887.523648:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575884/real 1788575887]  req@ffff8dc006713b80 x1875453361311872/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575909 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575887.523658:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361311872/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575909 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575887.523665:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575887.523668:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575887.523671:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361311872:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575887.523680:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575884/real 1788575887]  req@ffff8dc006713800 x1875453361311488/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575909 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575887.523690:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361311488/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575909 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575887.523697:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575887.523701:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575887.523704:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361311488:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788575887.906969:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575887.906969:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575887.906976:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575887.906991:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575887.907001:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575887.907011:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575888.546982:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575888.930982:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575888.931006:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788575888.931618:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575888.931629:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575888.931693:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575888.931768:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575889.570972:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788575889.570972:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575889.570981:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575889.570985:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575889.570993:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4235
00000100:00080000:1.0:1788575889.571001:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575889.571009:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575889.571041:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361312384/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575889.571065:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575889.571068:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575889.571070:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575889.571073:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4235
00000100:00080000:1.0:1788575889.571075:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575889.571079:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575889.571096:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575889.571101:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361312384:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788575889.571114:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361312512/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575889.571124:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575889.571127:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575889.571129:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575889.571134:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4235
00000100:00080000:1.0:1788575889.571138:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575889.571142:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575889.571147:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575889.571158:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361312640/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575889.571167:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575889.571170:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575889.571172:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1788575889.571177:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788575889.571179:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4235
00000100:00080000:1.0:1788575889.571184:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575889.571188:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575889.571193:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575889.571205:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361312768/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575889.571214:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575889.571219:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:3.0:1788575889.571220:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575889/real 1788575889]  req@ffff8dc005dc2d80 x1875453361312384/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575914 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575889.571236:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788575889.571238:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361312384/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575914 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575889.571243:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4235
00000100:00080000:1.0:1788575889.571249:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575889.571255:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:3.0:1788575889.571256:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:1.0:1788575889.571261:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788575889.571264:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575889.571270:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361312384:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788575889.571278:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361312896/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575889.571286:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575889.571288:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575889.571290:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575889.571293:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4235
00000100:00100000:3.0:1788575889.571297:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361312512:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788575889.571298:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575889.571303:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575889.571309:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575889.571322:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361313024/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575889.571333:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1788575889.571333:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788575889.571340:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575889.571342:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575889.571346:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4235
00000100:00080000:1.0:1788575889.571350:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788575889.571354:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575889/real 1788575889]  req@ffff8dc005dc3800 x1875453361312512/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575914 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575889.571357:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575889.571364:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575889.571374:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361312512/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575914 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575889.571379:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361313152/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575889.571396:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575889.571408:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575889.571413:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361312512:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575889.571420:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361312640:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575889.571441:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575889.571452:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575889/real 1788575889]  req@ffff8dc005dc1500 x1875453361312640/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575914 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575889.571463:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361312640/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575914 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575889.571470:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575889.571473:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575889.571476:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361312640:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575889.571482:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361312768:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575889.571500:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575889.571541:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575889/real 1788575889]  req@ffff8dc005dc0a80 x1875453361312768/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575914 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575889.571553:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361312768/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575914 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575889.571560:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575889.571563:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575889.571565:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361312768:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575889.571571:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361312896:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575889.571588:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575889.571598:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575889/real 1788575889]  req@ffff8dc005dc1c00 x1875453361312896/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575914 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575889.571609:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361312896/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575914 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575889.571617:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575889.571619:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575889.571621:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361312896:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575889.571724:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361313024:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575889.571745:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575889.571755:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575889/real 1788575889]  req@ffff8dc005dc0700 x1875453361313024/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575914 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575889.571764:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361313024/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575914 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575889.571776:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575889.571779:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575889.571782:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361313024:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575889.571787:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361313152:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575889.571804:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575889.571815:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575889/real 1788575889]  req@ffff8dc005dc3b80 x1875453361313152/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575914 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575889.571824:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361313152/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575914 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575889.571838:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575889.571840:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575889.571843:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361313152:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575889.954962:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575889.954962:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575889.954962:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575889.954962:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575889.955003:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575889.955036:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575890.594984:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575890.978953:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575890.978957:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575890.978979:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575890.979001:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575890.979001:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788575890.979032:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575891.619069:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575892.002941:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575892.002941:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575892.002946:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575892.002971:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575892.002980:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575892.002995:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575892.642962:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575893.026971:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575893.026971:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575893.026972:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575893.027003:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575893.027008:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575893.027020:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575893.666983:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575894.050969:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575894.050969:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575894.050971:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575894.050997:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575894.051000:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575894.051008:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575894.690954:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575894.690959:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575894.690964:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575894.690967:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575894.690980:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4240
00000100:00080000:1.0:1788575894.690989:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575894.690994:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575894.691029:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361313280/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575894.691053:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575894.691055:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575894.691056:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575894.691059:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4240
00000100:00080000:1.0:1788575894.691061:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575894.691063:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575894.691070:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575894.691090:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361313408/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575894.691096:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575894.691099:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575894.691100:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575894.691103:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4240
00000100:00080000:1.0:1788575894.691105:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575894.691110:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575894.691110:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361313280:192.168.202.140@tcp:250:kworker.0
00000008:00100000:1.0:1788575894.691115:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575894.691123:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361313536/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575894.691137:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575894.691140:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575894.691141:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575894.691143:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4240
00000100:00080000:1.0:1788575894.691146:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575894.691149:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575894.691153:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788575894.691172:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575894.691176:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361313664/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575894.691186:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788575894.691204:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575894/real 1788575894]  req@ffff8dc005dc1180 x1875453361313280/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575919 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575894.691205:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575894.691209:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575894.691216:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4240
00000100:00080000:1.0:1788575894.691230:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788575894.691231:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361313280/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575919 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575894.691236:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575894.691243:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788575894.691245:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575894.691249:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575894.691252:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361313280:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788575894.691257:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361313408:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788575894.691262:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361313792/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575894.691273:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1788575894.691276:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575894.691285:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575894/real 1788575894]  req@ffff8dc005dc3b80 x1875453361313408/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575919 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575894.691286:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575894.691289:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575894.691296:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4240
00000100:00080000:1.0:1788575894.691299:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575894.691301:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575894.691303:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575894.691308:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361313408/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575919 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575894.691316:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575894.691319:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575894.691321:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361313920/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575894.691325:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361313408:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788575894.691344:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575894.691347:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575894.691348:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788575894.691349:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361313536:192.168.202.140@tcp:8:kworker.0
00000100:00080000:1.0:1788575894.691354:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4240
00000100:00080000:1.0:1788575894.691369:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1788575894.691370:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788575894.691376:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575894.691382:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575894.691386:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575894/real 1788575894]  req@ffff8dc005dc0700 x1875453361313536/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575919 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575894.691400:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361313536/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575919 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575894.691439:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575894.691443:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575894.691446:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361313536:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575894.691453:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361313664:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575894.691458:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361314048/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788575894.691477:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575894.691488:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575894/real 1788575894]  req@ffff8dc005dc1c00 x1875453361313664/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575919 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575894.691495:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361313664/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575919 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575894.691501:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575894.691502:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575894.691504:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361313664:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575894.691508:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361313792:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575894.691521:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575894.691530:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575894/real 1788575894]  req@ffff8dc005dc0a80 x1875453361313792/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575919 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575894.691541:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361313792/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575919 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575894.691549:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575894.691552:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575894.691565:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361313792:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575894.691571:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361313920:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575894.691590:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575894.691600:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575894/real 1788575894]  req@ffff8dc005dc1500 x1875453361313920/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575919 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575894.691612:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361313920/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575919 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575894.691620:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575894.691623:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575894.691626:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361313920:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575894.691641:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361314048:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575894.691666:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575894.691676:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575894/real 1788575894]  req@ffff8dc005dc3800 x1875453361314048/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575919 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575894.691687:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361314048/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575919 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575894.691694:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575894.691697:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575894.691701:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361314048:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575895.074980:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575895.074996:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575895.075010:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575895.075113:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575895.075120:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575895.075127:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575895.714971:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575896.098980:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575896.098980:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575896.098980:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575896.099054:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575896.099144:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575896.099165:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575896.738985:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575897.122984:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575897.122984:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575897.123016:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575897.123116:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575897.123129:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575897.123237:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575897.763023:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575898.146970:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575898.146970:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575898.149421:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575898.149424:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575898.149438:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575898.149476:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575898.786978:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575899.171002:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575899.171002:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575899.171040:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575899.171051:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575899.171052:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575899.171062:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575899.810997:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575899.811041:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575899.811048:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575899.811052:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575899.811061:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4245
00000100:00080000:1.0:1788575899.811071:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575899.811078:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575899.811115:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361314176/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575899.811145:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575899.811149:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575899.811151:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575899.811154:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4245
00000100:00080000:1.0:1788575899.811157:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575899.811161:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575899.811171:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575899.811187:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361314304/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575899.811198:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788575899.811203:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361314176:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788575899.811204:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575899.811208:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575899.811215:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4245
00000100:00080000:1.0:1788575899.811218:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575899.811222:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575899.811228:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575899.811241:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361314432/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575899.811251:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575899.811254:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575899.811256:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575899.811260:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4245
00000100:00080000:1.0:1788575899.811264:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575899.811268:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:3.0:1788575899.811273:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:1.0:1788575899.811274:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575899.811288:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361314560/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575899.811316:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575899.811319:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575899.811321:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575899.811326:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4245
00000100:00080000:1.0:1788575899.811330:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788575899.811335:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575899/real 1788575899]  req@ffff8dc005dc2d80 x1875453361314176/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575924 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575899.811338:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575899.811346:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575899.811363:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361314176/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575924 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575899.811364:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361314688/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575899.811387:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575899.811388:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575899.811394:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788575899.811395:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575899.811400:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788575899.811402:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361314176:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788575899.811407:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4245
00000100:00080000:1.0:1788575899.811413:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575899.811417:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575899.811422:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575899.811433:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361314304:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788575899.811434:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361314816/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575899.811449:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575899.811453:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575899.811455:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575899.811459:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4245
00000800:00000100:3.0:1788575899.811464:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788575899.811466:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575899.811473:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575899.811478:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575899.811482:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575899/real 1788575899]  req@ffff8dc005dc3800 x1875453361314304/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575924 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575899.811494:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361314944/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575899.811498:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361314304/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575924 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575899.811522:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575899.811526:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575899.811530:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361314304:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575899.811538:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361314432:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575899.811555:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575899.811565:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575899/real 1788575899]  req@ffff8dc005dc1500 x1875453361314432/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575924 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575899.811576:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361314432/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575924 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575899.811586:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575899.811589:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575899.811592:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361314432:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575899.811599:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361314560:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575899.811616:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575899.811626:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575899/real 1788575899]  req@ffff8dc005dc0a80 x1875453361314560/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575924 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575899.811637:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361314560/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575924 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575899.811645:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575899.811648:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575899.811651:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361314560:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575899.811657:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361314688:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575899.811671:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575899.811679:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575899/real 1788575899]  req@ffff8dc005dc1c00 x1875453361314688/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575924 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575899.811690:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361314688/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575924 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575899.811722:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575899.811725:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575899.811728:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361314688:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575899.811745:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361314816:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575899.811765:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575899.811776:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575899/real 1788575899]  req@ffff8dc005dc0700 x1875453361314816/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575924 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575899.811787:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361314816/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575924 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575899.811803:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575899.811806:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575899.811809:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361314816:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575899.811814:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361314944:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575899.811830:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575899.811846:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575899/real 1788575899]  req@ffff8dc005dc3b80 x1875453361314944/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575924 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575899.811857:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361314944/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575924 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575899.811895:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575899.811904:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575899.811907:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361314944:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575900.194974:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575900.195020:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575900.195045:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575900.198639:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575900.198648:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575900.198686:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575900.835071:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575901.218982:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575901.218989:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575901.218990:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575901.219100:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575901.222608:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575901.223024:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575901.859354:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575902.242957:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575902.242957:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575902.243683:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575902.244154:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575902.244235:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575902.244493:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575902.882997:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575903.267011:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575903.267011:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575903.267038:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575903.267109:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575903.267513:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575903.267568:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575903.908405:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575904.291175:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575904.291334:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575904.291348:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575904.291390:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575904.291440:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575904.291443:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575904.930984:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575904.930996:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575904.931000:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1788575904.931024:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575904.931375:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4250
00000100:00080000:1.0:1788575904.931386:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575904.931395:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575904.931433:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361315072/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575904.931466:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575904.931470:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575904.931471:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575904.931475:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4250
00000100:00080000:1.0:1788575904.931479:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575904.931483:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575904.931493:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575904.931508:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361315200/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575904.931518:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575904.931521:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575904.931522:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575904.931526:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4250
00000100:00080000:1.0:1788575904.931529:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575904.931533:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575904.931538:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575904.931549:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361315328/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575904.931558:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575904.931561:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575904.931563:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575904.931566:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4250
00000100:00080000:1.0:1788575904.931569:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575904.931573:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575904.931577:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575904.931588:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361315456/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575904.931605:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575904.931608:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575904.931610:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575904.931613:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4250
00000100:00080000:1.0:1788575904.931616:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575904.931620:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575904.931624:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575904.931635:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361315584/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575904.931643:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575904.931646:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575904.931647:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575904.931651:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4250
00000100:00080000:1.0:1788575904.931655:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575904.931657:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575904.931662:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575904.931672:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361315712/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575904.931679:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575904.931681:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575904.931683:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575904.931700:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4250
00000100:00080000:1.0:1788575904.931703:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575904.931707:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575904.931712:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575904.931721:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361315840/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575904.931903:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361315072:192.168.202.140@tcp:250:kworker.0
00000800:00000100:3.0:1788575904.931960:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575904.931997:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575904/real 1788575904]  req@ffff8dc005dc1180 x1875453361315072/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575929 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575904.932014:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361315072/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575929 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575904.932024:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575904.932028:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575904.932031:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361315072:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788575904.932038:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361315200:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575904.932059:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575904.932071:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575904/real 1788575904]  req@ffff8dc005dc3b80 x1875453361315200/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575929 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575904.932083:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361315200/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575929 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575904.932092:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575904.932095:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575904.932098:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361315200:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575904.932105:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361315328:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575904.932123:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575904.932133:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575904/real 1788575904]  req@ffff8dc005dc0700 x1875453361315328/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575929 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575904.932143:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361315328/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575929 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575904.932151:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575904.932154:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575904.932157:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361315328:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575904.932163:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361315456:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575904.932180:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575904.932223:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575904/real 1788575904]  req@ffff8dc005dc1c00 x1875453361315456/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575929 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575904.932247:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361315456/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575929 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575904.932261:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575904.932265:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575904.932268:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361315456:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575904.932274:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361315584:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575904.932304:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575904.932315:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575904/real 1788575904]  req@ffff8dc005dc0a80 x1875453361315584/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575929 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575904.932326:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361315584/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575929 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575904.932334:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575904.932337:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575904.932340:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361315584:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575904.932357:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361315712:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575904.932376:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575904.932387:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575904/real 1788575904]  req@ffff8dc005dc1500 x1875453361315712/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575929 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575904.932398:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361315712/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575929 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575904.932405:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575904.932408:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575904.932412:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361315712:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575904.932418:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361315840:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575904.932436:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575904.932447:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575904/real 1788575904]  req@ffff8dc005dc3800 x1875453361315840/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575929 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575904.932457:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361315840/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575929 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575904.932464:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575904.932467:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575904.932470:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361315840:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575905.314992:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575905.315024:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575905.315236:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575905.315255:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575905.315271:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575905.315344:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575905.955026:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575906.339006:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575906.339189:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575906.339254:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575906.339274:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575906.342283:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575906.342340:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575906.979205:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575907.363075:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575907.363084:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575907.363212:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575907.363225:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575907.363335:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575907.364424:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575908.003472:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575908.387032:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575908.387061:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575908.387544:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575908.390229:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575908.391191:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575908.391286:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575909.027057:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575909.411020:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575909.411020:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575909.411059:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575909.411093:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575909.411130:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575909.411134:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1788575910.051050:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575910.051064:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575910.051070:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575910.051083:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4255
00000100:00080000:1.0:1788575910.051129:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575910.051140:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575910.051192:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361315968/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575910.051235:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575910.051239:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575910.051241:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575910.051246:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4255
00000100:00080000:1.0:1788575910.051250:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575910.051253:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575910.051267:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575910.051282:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361316096/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575910.051292:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575910.051296:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575910.051298:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575910.051302:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4255
00000100:00080000:1.0:1788575910.051305:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575910.051309:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575910.051315:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575910.051326:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361316224/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575910.051335:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575910.051338:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575910.051341:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575910.051344:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4255
00000100:00080000:1.0:1788575910.051347:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575910.051351:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575910.051356:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575910.051368:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361316352/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575910.051376:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575910.051379:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575910.051381:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575910.051385:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4255
00000100:00080000:1.0:1788575910.051389:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575910.051393:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575910.051398:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575910.051408:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361316480/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575910.051416:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575910.051420:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575910.051422:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575910.051426:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4255
00000100:00080000:1.0:1788575910.051429:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575910.051433:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575910.051437:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575910.051447:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361316608/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575910.051456:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575910.051459:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575910.051461:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575910.051465:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4255
00000100:00080000:1.0:1788575910.051468:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575910.051472:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575910.051476:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575910.051487:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361316736/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788575910.051605:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575910.051743:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361315968:192.168.202.140@tcp:250:kworker.0
00000800:00000100:3.0:1788575910.051824:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575910.051905:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575910/real 1788575910]  req@ffff8dc005dc2d80 x1875453361315968/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575935 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575910.051925:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361315968/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575935 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575910.051937:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575910.051942:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575910.051946:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361315968:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788575910.051953:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361316096:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575910.051975:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575910.051986:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575910/real 1788575910]  req@ffff8dc005dc3800 x1875453361316096/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575935 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575910.051998:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361316096/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575935 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575910.052009:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575910.052011:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575910.052015:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361316096:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575910.052021:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361316224:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575910.052038:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575910.052047:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575910/real 1788575910]  req@ffff8dc005dc1500 x1875453361316224/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575935 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575910.052058:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361316224/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575935 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575910.052067:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575910.052070:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575910.052073:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361316224:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575910.052078:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361316352:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575910.052094:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575910.052115:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575910/real 1788575910]  req@ffff8dc005dc0a80 x1875453361316352/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575935 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575910.052126:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361316352/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575935 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575910.052135:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575910.052138:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575910.052140:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361316352:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575910.052146:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361316480:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575910.052165:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575910.052176:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575910/real 1788575910]  req@ffff8dc005dc1c00 x1875453361316480/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575935 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575910.052187:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361316480/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575935 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575910.052196:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575910.052199:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575910.052202:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361316480:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575910.052208:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361316608:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575910.052226:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575910.052237:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575910/real 1788575910]  req@ffff8dc005dc0700 x1875453361316608/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575935 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575910.052254:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361316608/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575935 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575910.052262:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575910.052264:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575910.052268:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361316608:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575910.052273:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361316736:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575910.052288:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575910.052296:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575910/real 1788575910]  req@ffff8dc005dc3b80 x1875453361316736/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575935 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575910.052307:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361316736/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575935 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575910.052315:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575910.052318:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575910.052320:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361316736:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575910.435016:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575910.435016:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575910.435055:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575910.435185:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575910.435201:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575910.435553:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575911.075215:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575911.459014:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575911.459014:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575911.459014:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575911.459117:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575911.459154:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575911.459165:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575912.099065:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575912.482984:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575912.482984:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575912.483015:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575912.483026:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575912.483067:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575912.483071:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575913.122965:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575913.506996:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575913.506998:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575913.507045:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575913.507098:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575913.507322:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575913.507386:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575914.147251:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575914.530980:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575914.530980:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575914.531018:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575914.531067:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575914.531087:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575914.531301:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00080000:1.0:1788575915.171004:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575915.171015:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575915.171019:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575915.171029:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4260
00000100:00080000:1.0:1788575915.171038:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575915.171045:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575915.171092:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361316864/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575915.171121:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575915.171125:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575915.171127:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575915.171131:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4260
00000100:00080000:1.0:1788575915.171135:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575915.171139:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575915.171585:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575915.171602:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361316992/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575915.171611:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575915.171614:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575915.171615:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575915.171619:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4260
00000100:00080000:1.0:1788575915.171622:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575915.171626:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575915.171631:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575915.171639:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361317120/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575915.171647:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575915.171649:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575915.171651:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575915.171654:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4260
00000100:00080000:1.0:1788575915.171656:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575915.171660:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575915.171664:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575915.171672:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361317248/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575915.171682:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575915.171685:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575915.171688:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788575915.171690:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361316864:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788575915.171695:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4260
00000100:00080000:1.0:1788575915.171701:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575915.171706:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575915.171712:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575915.171715:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575915.171726:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361317376/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575915.171736:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575915.171739:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575915.171741:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575915.171746:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4260
00000100:00080000:1.0:1788575915.171749:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575915.171755:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:3.0:1788575915.171757:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:1.0:1788575915.171763:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575915.171776:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361317504/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575915.171787:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575915.171790:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575915.171792:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575915.171796:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4260
00000100:00080000:1.0:1788575915.171799:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788575915.171801:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575915/real 1788575915]  req@ffff8dc005dc1180 x1875453361316864/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575940 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575915.171805:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575915.171813:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575915.171826:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361316864/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575940 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575915.171829:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361317632/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575915.171850:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575915.171857:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575915.171862:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361316864:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788575915.171892:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361316992:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575915.171920:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575915.171934:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575915/real 1788575915]  req@ffff8dc005dc3b80 x1875453361316992/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575940 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575915.171947:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361316992/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575940 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575915.171958:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575915.171962:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575915.171966:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361316992:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575915.171971:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361317120:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575915.171994:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575915.172004:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575915/real 1788575915]  req@ffff8dc005dc0700 x1875453361317120/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575940 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575915.172015:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361317120/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575940 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575915.172023:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575915.172027:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575915.172030:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361317120:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575915.172069:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361317248:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575915.172091:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575915.172103:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575915/real 1788575915]  req@ffff8dc005dc1c00 x1875453361317248/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575940 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575915.172113:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361317248/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575940 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575915.172120:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575915.172122:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575915.172125:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361317248:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575915.172130:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361317376:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575915.172206:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575915.172220:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575915/real 1788575915]  req@ffff8dc005dc0a80 x1875453361317376/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575940 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575915.172232:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361317376/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575940 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575915.172246:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575915.172250:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575915.172254:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361317376:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575915.172262:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361317504:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575915.172285:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575915.172297:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575915/real 1788575915]  req@ffff8dc005dc1500 x1875453361317504/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575940 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575915.172307:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361317504/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575940 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575915.172315:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575915.172317:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575915.172320:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361317504:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575915.172326:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361317632:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575915.172345:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575915.172356:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575915/real 1788575915]  req@ffff8dc005dc3800 x1875453361317632/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575940 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575915.172368:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361317632/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575940 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575915.172375:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575915.172378:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575915.172382:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361317632:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575915.554938:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575915.554981:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575915.555032:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575915.555106:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575915.555244:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575915.555824:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575916.194966:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575916.578967:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575916.578973:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575916.578999:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575916.579016:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575916.579106:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575916.579204:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575917.219000:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575917.602992:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575917.603051:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575917.603137:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575917.603149:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575917.603165:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575917.603810:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575918.243041:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575918.627047:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575918.627058:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575918.627095:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788575918.627125:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575918.627203:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575918.627212:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575919.266984:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575919.650974:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575919.650998:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575919.651001:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575919.651086:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575919.651114:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575919.651140:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00080000:0.0:1788575920.291028:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1788575920.291031:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575920.291042:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788575920.291048:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575920.291062:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4265
00000100:00080000:0.0:1788575920.291076:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575920.291085:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575920.291131:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361317760/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575920.291156:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575920.291160:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575920.291161:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575920.291164:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4265
00000100:00080000:0.0:1788575920.291167:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575920.291169:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575920.291178:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575920.291188:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361317888/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575920.291195:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575920.291197:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575920.291198:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575920.291201:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4265
00000100:00080000:0.0:1788575920.291203:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575920.291205:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575920.291210:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575920.291218:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361318016/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575920.291221:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361317760:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788575920.291224:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575920.291228:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575920.291231:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575920.291233:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4265
00000100:00080000:0.0:1788575920.291235:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575920.291238:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575920.291241:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575920.291246:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453361318144/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575920.291250:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575920.291252:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575920.291253:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575920.291255:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4265
00000100:00080000:0.0:1788575920.291257:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575920.291259:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575920.291262:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575920.291269:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361318272/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575920.291274:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575920.291277:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575920.291279:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575920.291282:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4265
00000100:00080000:0.0:1788575920.291285:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575920.291288:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575920.291293:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575920.291305:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361318400/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575920.291314:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1788575920.291320:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788575920.291326:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575920.291329:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575920.291333:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4265
00000100:00080000:0.0:1788575920.291337:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575920.291341:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575920.291345:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575920.291354:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361318528/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575920.291373:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575920/real 1788575920]  req@ffff8dc006712a00 x1875453361317760/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575945 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575920.291389:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361317760/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575945 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575920.291397:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575920.291400:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575920.291403:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361317760:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788575920.291408:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361317888:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575920.291426:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575920.291433:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575920/real 1788575920]  req@ffff8dc006713480 x1875453361317888/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575945 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575920.291441:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361317888/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575945 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575920.291448:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575920.291450:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575920.291452:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361317888:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575920.291474:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361318016:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575920.291485:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575920.291490:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575920/real 1788575920]  req@ffff8dc006711c00 x1875453361318016/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575945 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575920.291497:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361318016/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575945 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575920.291503:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575920.291505:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575920.291507:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361318016:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575920.291510:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361318144:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575920.291519:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575920.291524:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575920/real 1788575920]  req@ffff8dc006710380 x1875453361318144/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575945 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575920.291530:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453361318144/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575945 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575920.291535:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575920.291537:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575920.291539:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361318144:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575920.291542:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361318272:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575920.291551:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575920.291557:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575920/real 1788575920]  req@ffff8dc006712300 x1875453361318272/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575945 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575920.291563:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361318272/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575945 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575920.291568:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575920.291570:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575920.291571:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361318272:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575920.291581:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361318400:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575920.291592:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575920.291598:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575920/real 1788575920]  req@ffff8dc006713800 x1875453361318400/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575945 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575920.291605:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361318400/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575945 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575920.291610:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575920.291612:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575920.291614:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361318400:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575920.291617:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361318528:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575920.291633:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575920.291639:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575920/real 1788575920]  req@ffff8dc006713b80 x1875453361318528/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575945 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575920.291646:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361318528/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575945 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575920.291651:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575920.291653:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575920.291655:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361318528:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575920.675009:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575920.675009:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788575920.675114:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575920.675125:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575920.675143:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575920.675149:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575921.314977:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575921.698973:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575921.698979:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575921.699020:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575921.699102:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575921.699115:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575921.699130:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575922.338973:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575922.722967:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575922.722969:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575922.722969:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575922.723006:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575922.723007:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575922.723019:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575923.363017:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575923.747040:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575923.747041:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575923.747059:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575923.747068:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575923.747087:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575923.747114:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575924.387012:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575924.770990:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575924.770990:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575924.771039:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575924.771042:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575924.771502:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788575924.771895:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1788575925.410996:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788575925.411001:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788575925.411010:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788575925.411016:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575925.411026:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4271
00000100:00080000:3.0:1788575925.411036:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575925.411043:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575925.411079:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c380 x1875453361318656/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575925.411128:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575925.411140:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575925.411142:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575925.411146:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4271
00000100:00080000:3.0:1788575925.411150:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575925.411154:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575925.411165:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575925.411177:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f480 x1875453361318784/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575925.411188:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575925.411192:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575925.411194:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575925.411198:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4271
00000100:00080000:3.0:1788575925.411201:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575925.411206:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575925.411210:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575925.411221:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d180 x1875453361318912/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575925.411230:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575925.411233:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575925.411235:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575925.411238:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4271
00000100:00080000:3.0:1788575925.411241:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575925.411244:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575925.411249:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575925.411259:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e680 x1875453361319040/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575925.411268:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575925.411270:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575925.411273:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575925.411277:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4271
00000100:00080000:3.0:1788575925.411280:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575925.411284:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575925.411288:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575925.411296:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c700 x1875453361319168/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575925.411301:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575925.411303:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575925.411304:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575925.411306:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4271
00000100:00080000:3.0:1788575925.411308:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575925.411310:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575925.411312:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575925.411317:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e300 x1875453361319296/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575925.411322:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575925.411324:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575925.411325:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575925.411326:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4271
00000100:00080000:3.0:1788575925.411328:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575925.411330:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575925.411332:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575925.411337:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d880 x1875453361319424/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788575925.411444:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361318656:192.168.202.140@tcp:250:kworker.0
00000800:00000100:1.0:1788575925.411508:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575925.411546:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575925/real 1788575925]  req@ffff8dc00644c380 x1875453361318656/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575950 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575925.411563:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453361318656/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575950 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575925.411573:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575925.411577:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575925.411581:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361318656:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788575925.411587:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361318784:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788575925.411610:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575925.411622:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575925/real 1788575925]  req@ffff8dc00644f480 x1875453361318784/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575950 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575925.411646:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453361318784/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575950 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575925.411653:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575925.411655:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575925.411657:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361318784:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788575925.411663:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361318912:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788575925.411683:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575925.411694:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575925/real 1788575925]  req@ffff8dc00644d180 x1875453361318912/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575950 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575925.411705:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453361318912/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575950 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575925.411714:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575925.411717:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575925.411720:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361318912:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575925.411726:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361319040:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788575925.411743:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575925.411753:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575925/real 1788575925]  req@ffff8dc00644e680 x1875453361319040/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575950 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575925.411761:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453361319040/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575950 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575925.411775:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575925.411778:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575925.411781:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361319040:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575925.411786:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361319168:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788575925.411803:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575925.411814:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575925/real 1788575925]  req@ffff8dc00644c700 x1875453361319168/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575950 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575925.411825:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453361319168/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575950 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575925.411838:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575925.411841:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575925.411843:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361319168:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788575925.411848:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361319296:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788575925.411891:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575925.411903:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575925/real 1788575925]  req@ffff8dc00644e300 x1875453361319296/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575950 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575925.411914:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453361319296/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575950 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575925.411922:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575925.411925:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575925.411928:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361319296:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575925.411932:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361319424:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788575925.411946:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575925.411968:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575925/real 1788575925]  req@ffff8dc00644d880 x1875453361319424/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575950 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575925.411981:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d880 x1875453361319424/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575950 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575925.411989:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575925.411991:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575925.411995:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361319424:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575925.795045:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575925.795045:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575925.795070:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575925.795090:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575925.795126:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575925.795137:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575926.434996:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575926.818932:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575926.818939:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575926.818959:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575926.818978:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575926.818986:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575926.819011:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575927.459147:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575927.842997:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575927.842997:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575927.843004:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575927.843024:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575927.843030:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575927.843044:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575928.483151:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575928.866951:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575928.866951:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575928.866957:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575928.866960:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575928.866982:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575928.867022:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575929.506990:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575929.890982:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575929.890985:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575929.890985:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575929.890987:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575929.891014:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575929.891058:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575930.530976:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788575930.530981:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575930.530986:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788575930.530990:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575930.530999:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4276
00000100:00080000:2.0:1788575930.531009:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575930.531016:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575930.531047:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361319552/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575930.531066:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575930.531070:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575930.531071:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575930.531075:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4276
00000100:00080000:2.0:1788575930.531078:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575930.531082:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575930.531091:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575930.531096:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361319552:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788575930.531103:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453361319680/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575930.531111:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575930.531114:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575930.531115:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575930.531118:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4276
00000100:00080000:2.0:1788575930.531121:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575930.531124:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575930.531128:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575930.531137:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453361319808/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575930.531144:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575930.531147:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575930.531148:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575930.531151:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4276
00000100:00080000:2.0:1788575930.531153:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575930.531156:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575930.531160:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1788575930.531161:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575930.531168:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453361319936/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575930.531174:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575930.531177:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575930.531178:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575930.531182:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4276
00000100:00080000:2.0:1788575930.531184:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575930.531187:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575930.531191:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575930.531200:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575930/real 1788575930]  req@ffff8dc020495500 x1875453361319552/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575955 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575930.531200:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361320064/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575930.531209:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575930.531211:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575930.531213:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1788575930.531216:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361319552/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575955 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575930.531225:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4276
00000100:00080000:1.0:1788575930.531226:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575930.531227:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575930.531229:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788575930.531230:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575930.531233:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361319552:192.168.202.140@tcp:250:kworker.0
00000008:00100000:2.0:1788575930.531234:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575930.531243:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361320192/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575930.531250:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788575930.531253:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361319680:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788575930.531253:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575930.531255:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575930.531258:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4276
00000100:00080000:2.0:1788575930.531260:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575930.531263:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575930.531267:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1788575930.531272:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575930.531276:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453361320320/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788575930.531282:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575930/real 1788575930]  req@ffff8dc020494380 x1875453361319680/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575955 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575930.531293:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453361319680/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575955 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575930.531303:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575930.531306:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575930.531309:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361319680:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788575930.531315:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361319808:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788575930.531332:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575930.531339:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575930/real 1788575930]  req@ffff8dc020496d80 x1875453361319808/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575955 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575930.531346:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453361319808/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575955 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575930.531351:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575930.531353:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575930.531355:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361319808:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575930.531358:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361319936:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788575930.531368:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575930.531373:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575930/real 1788575930]  req@ffff8dc020497480 x1875453361319936/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575955 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575930.531379:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453361319936/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575955 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575930.531384:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575930.531385:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575930.531387:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361319936:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575930.531390:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361320064:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788575930.531400:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575930.531405:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575930/real 1788575930]  req@ffff8dc020494700 x1875453361320064/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575955 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575930.531412:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361320064/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575955 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575930.531420:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575930.531422:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575930.531425:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361320064:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788575930.531431:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361320192:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788575930.531449:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575930.531460:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575930/real 1788575930]  req@ffff8dc020495180 x1875453361320192/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575955 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575930.531470:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361320192/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575955 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575930.531478:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575930.531481:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575930.531484:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361320192:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575930.531501:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361320320:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788575930.531529:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575930.531541:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575930/real 1788575930]  req@ffff8dc020497100 x1875453361320320/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575955 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575930.531553:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453361320320/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575955 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575930.531558:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575930.531560:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575930.531562:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361320320:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575930.914974:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575930.914974:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575930.914974:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575930.914975:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575930.915001:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575930.915061:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575931.554977:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575931.938992:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575931.938992:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575931.938992:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575931.938994:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575931.939028:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788575931.939068:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575932.578991:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575932.962960:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575932.962969:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575932.963111:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575932.963227:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575932.963238:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575932.963436:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575933.603011:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575933.986994:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575933.986994:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575933.986998:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575933.987023:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575933.987034:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575933.987045:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575934.627063:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575935.010970:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575935.010977:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575935.011069:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575935.011165:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788575935.011185:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575935.011225:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00080000:2.0:1788575935.650977:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788575935.650984:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788575935.650989:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788575935.650994:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575935.651004:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4281
00000100:00080000:2.0:1788575935.651014:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575935.651023:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575935.651060:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453361320448/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575935.651085:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575935.651089:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575935.651091:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575935.651095:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4281
00000100:00080000:2.0:1788575935.651099:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575935.651103:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575935.651113:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575935.651129:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453361320576/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788575935.651131:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361320448:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788575935.651147:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575935.651150:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575935.651152:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575935.651156:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4281
00000100:00080000:2.0:1788575935.651160:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575935.651164:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575935.651170:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575935.651183:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453361320704/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575935.651193:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1788575935.651198:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788575935.651199:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575935.651204:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575935.651209:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4281
00000100:00080000:2.0:1788575935.651214:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575935.651218:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575935.651224:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575935.651240:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575935/real 1788575935]  req@ffff8dc020496a00 x1875453361320448/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575960 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575935.651240:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361320832/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575935.651271:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575935.651275:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575935.651277:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1788575935.651279:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453361320448/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575960 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575935.651284:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4281
00000100:00080000:2.0:1788575935.651292:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575935.651296:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575935.651299:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:1.0:1788575935.651304:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000008:00100000:2.0:1788575935.651306:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575935.651311:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361320448:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788575935.651324:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361320960/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788575935.651335:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361320576:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788575935.651351:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575935.651355:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000800:00000100:1.0:1788575935.651359:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788575935.651360:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575935.651367:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4281
00000100:00080000:2.0:1788575935.651371:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788575935.651376:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575935/real 1788575935]  req@ffff8dc020494a80 x1875453361320576/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575960 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575935.651377:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575935.651385:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575935.651399:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453361320576/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575960 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788575935.651403:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453361321088/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575935.651424:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788575935.651424:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575935.651431:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575935.651432:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788575935.651434:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1788575935.651438:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361320576:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788575935.651440:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4281
00000100:00080000:2.0:1788575935.651447:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788575935.651450:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361320704:192.168.202.140@tcp:8:kworker.0
00000100:00080000:2.0:1788575935.651454:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575935.651460:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575935.651474:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453361321216/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788575935.651481:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575935.651498:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575935/real 1788575935]  req@ffff8dc020494e00 x1875453361320704/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575960 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575935.651511:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453361320704/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575960 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575935.651521:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575935.651524:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575935.651527:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361320704:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575935.651532:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361320832:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788575935.651563:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575935.651573:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575935/real 1788575935]  req@ffff8dc020495880 x1875453361320832/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575960 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575935.651598:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361320832/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575960 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575935.651606:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575935.651610:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575935.651613:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361320832:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575935.651628:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361320960:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788575935.651647:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575935.651657:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575935/real 1788575935]  req@ffff8dc020494000 x1875453361320960/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575960 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575935.651668:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361320960/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575960 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575935.651676:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575935.651679:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575935.651682:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361320960:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788575935.651688:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361321088:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788575935.651706:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575935.651716:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575935/real 1788575935]  req@ffff8dc020496a00 x1875453361321088/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575960 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575935.651734:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453361321088/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575960 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575935.651742:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575935.651745:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575935.651748:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361321088:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575935.651753:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361321216:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788575935.651771:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575935.651782:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575935/real 1788575935]  req@ffff8dc020497100 x1875453361321216/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575960 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575935.651792:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453361321216/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575960 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575935.651800:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575935.651802:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575935.651805:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361321216:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575936.034974:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575936.034974:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575936.034975:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575936.035006:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575936.035012:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575936.035049:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575936.675008:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575937.059040:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575937.059055:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575937.059413:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575937.059460:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575937.061956:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575937.061979:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575937.698992:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575938.082991:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575938.083035:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575938.083105:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575938.083196:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575938.085914:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575938.085918:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575938.722971:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575939.106981:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575939.106981:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575939.106981:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575939.107187:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788575939.107213:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575939.107248:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575939.746989:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575940.131030:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575940.131030:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575940.131118:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575940.131761:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575940.131777:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575940.131919:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575940.770983:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575940.771002:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575940.771013:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575940.771018:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575940.771031:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4286
00000100:00080000:1.0:1788575940.771043:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575940.771051:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575940.771101:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361321344/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575940.771141:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575940.771145:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575940.771147:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575940.771151:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4286
00000100:00080000:1.0:1788575940.771155:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575940.771159:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575940.771172:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575940.771189:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361321472/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575940.771200:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361321344:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788575940.771207:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575940.771214:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575940.771216:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575940.771221:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4286
00000100:00080000:1.0:1788575940.771225:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575940.771230:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575940.771236:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575940.771249:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361321600/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575940.771265:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575940.771269:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575940.771271:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1788575940.771278:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788575940.771282:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4286
00000100:00080000:1.0:1788575940.771289:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575940.771295:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575940.771301:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575940.771313:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361321728/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575940.771324:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575940.771328:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575940.771331:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788575940.771335:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575940/real 1788575940]  req@ffff8dc005dc2d80 x1875453361321344/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575965 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575940.771339:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4286
00000100:00080000:1.0:1788575940.771347:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575940.771357:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575940.771365:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575940.771374:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361321344/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575965 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575940.771382:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361321856/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575940.771391:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575940.771397:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575940.771400:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575940.771405:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575940.771411:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788575940.771416:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4286
00000100:00080000:1.0:1788575940.771424:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788575940.771424:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361321344:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788575940.771435:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575940.771442:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575940.771456:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361321984/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575940.771460:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361321472:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788575940.771475:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575940.771480:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575940.771482:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575940.771487:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4286
00000100:00080000:1.0:1788575940.771492:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575940.771497:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575940.771503:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788575940.771505:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575940.771518:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361322112/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575940.771539:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575940/real 1788575940]  req@ffff8dc005dc3800 x1875453361321472/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575965 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575940.771554:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361321472/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575965 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575940.771561:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575940.771563:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575940.771566:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361321472:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575940.771571:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361321600:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575940.771587:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575940.771594:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575940/real 1788575940]  req@ffff8dc005dc1500 x1875453361321600/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575965 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575940.771601:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361321600/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575965 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575940.771606:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575940.771608:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575940.771610:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361321600:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575940.771613:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361321728:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575940.771624:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575940.771629:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575940/real 1788575940]  req@ffff8dc005dc0a80 x1875453361321728/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575965 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575940.771635:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361321728/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575965 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575940.771640:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575940.771642:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575940.771644:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361321728:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575940.771647:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361321856:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575940.771656:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575940.771662:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575940/real 1788575940]  req@ffff8dc005dc1c00 x1875453361321856/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575965 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575940.771668:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361321856/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575965 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575940.771673:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575940.771675:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575940.771676:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361321856:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575940.771687:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361321984:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575940.771714:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575940.771724:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575940/real 1788575940]  req@ffff8dc005dc0700 x1875453361321984/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575965 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575940.771741:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361321984/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575965 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575940.771747:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575940.771749:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575940.771751:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361321984:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575940.771755:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361322112:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575940.771768:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575940.771774:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575940/real 1788575940]  req@ffff8dc005dc3b80 x1875453361322112/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575965 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575940.771780:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361322112/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575965 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575940.771785:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575940.771787:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575940.771788:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361322112:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575941.155001:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575941.155031:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575941.155032:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575941.155046:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575941.155052:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575941.155084:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575941.794984:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575942.178992:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575942.178992:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575942.178994:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575942.179002:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575942.179039:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575942.179058:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575942.819013:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575943.202999:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575943.203000:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575943.203000:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575943.203028:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788575943.203045:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575943.203050:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575943.843004:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575944.226987:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575944.226987:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575944.226990:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788575944.227078:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575944.227105:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575944.227114:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575944.867002:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575945.250988:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575945.250994:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788575945.251032:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575945.251049:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575945.251052:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575945.251079:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575945.891012:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575945.891031:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575945.891036:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788575945.891039:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575945.891046:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4291
00000100:00080000:0.0:1788575945.891054:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575945.891067:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575945.891102:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361322240/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575945.891129:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575945.891132:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575945.891134:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575945.891136:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4291
00000100:00080000:0.0:1788575945.891140:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575945.891142:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575945.891150:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575945.891160:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361322368/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575945.891168:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361322240:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788575945.891172:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575945.891177:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575945.891179:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575945.891183:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4291
00000100:00080000:0.0:1788575945.891187:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575945.891191:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575945.891198:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575945.891210:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361322496/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575945.891218:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575945.891220:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575945.891221:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575945.891223:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4291
00000100:00080000:0.0:1788575945.891226:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1788575945.891228:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788575945.891231:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575945.891236:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575945.891244:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361322624/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575945.891254:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575945.891256:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575945.891257:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788575945.891265:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575945/real 1788575945]  req@ffff8dc006713100 x1875453361322240/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575970 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575945.891269:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4291
00000100:00080000:0.0:1788575945.891275:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575945.891282:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575945.891287:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575945.891292:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361322240/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575970 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575945.891301:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361322752/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575945.891306:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575945.891312:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788575945.891315:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788575945.891317:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361322240:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788575945.891320:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575945.891323:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575945.891327:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4291
00000100:00080000:0.0:1788575945.891330:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575945.891333:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575945.891337:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575945.891341:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361322368:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575945.891346:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361322880/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575945.891354:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575945.891356:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575945.891357:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575945.891360:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4291
00000800:00000100:3.0:1788575945.891364:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788575945.891366:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575945.891370:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575945.891374:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575945.891378:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575945/real 1788575945]  req@ffff8dc006710e00 x1875453361322368/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575970 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575945.891386:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361323008/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575945.891390:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361322368/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575970 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575945.891410:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575945.891414:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575945.891417:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361322368:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575945.891421:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361322496:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575945.891438:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575945.891448:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575945/real 1788575945]  req@ffff8dc006712680 x1875453361322496/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575970 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575945.891470:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361322496/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575970 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575945.891481:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575945.891483:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575945.891485:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361322496:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575945.891489:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361322624:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575945.891505:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575945.891515:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575945/real 1788575945]  req@ffff8dc006711500 x1875453361322624/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575970 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575945.891526:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361322624/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575970 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575945.891535:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575945.891537:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575945.891547:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361322624:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575945.891551:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361322752:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575945.891565:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575945.891571:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575945/real 1788575945]  req@ffff8dc006711880 x1875453361322752/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575970 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575945.891578:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361322752/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575970 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575945.891583:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575945.891585:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575945.891588:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361322752:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575945.891599:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361322880:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575945.891608:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575945.891613:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575945/real 1788575945]  req@ffff8dc006713100 x1875453361322880/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575970 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575945.891620:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361322880/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575970 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575945.891624:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575945.891626:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575945.891627:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361322880:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575945.891630:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361323008:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575945.891638:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575945.891643:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575945/real 1788575945]  req@ffff8dc006713b80 x1875453361323008/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575970 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575945.891648:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361323008/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575970 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575945.891653:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575945.891654:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575945.891656:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361323008:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575946.274956:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575946.274959:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575946.274979:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575946.275046:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575946.275106:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575946.275214:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575946.914998:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575947.298971:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575947.298971:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575947.298984:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788575947.299051:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575947.299123:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575947.299134:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575947.938984:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575948.322978:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575948.322978:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575948.323011:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575948.323013:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575948.323041:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575948.323057:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575948.962994:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575949.346994:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575949.346995:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575949.346999:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575949.347032:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575949.347032:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788575949.347058:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575949.986995:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575950.371016:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575950.371017:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575950.371029:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575950.371062:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575950.371067:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575950.371083:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575951.010969:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788575951.011191:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575951.011196:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788575951.011200:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575951.011207:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4296
00000100:00080000:2.0:1788575951.011214:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575951.011220:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575951.011253:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361323136/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575951.011290:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575951.011294:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575951.011296:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575951.011300:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4296
00000100:00080000:2.0:1788575951.011304:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575951.011307:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575951.011317:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575951.011329:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361323264/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575951.011338:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575951.011341:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575951.011343:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575951.011346:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4296
00000100:00080000:2.0:1788575951.011349:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575951.011352:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575951.011358:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575951.011368:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453361323392/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575951.011377:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575951.011380:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575951.011381:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575951.011384:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4296
00000100:00080000:2.0:1788575951.011388:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575951.011391:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575951.011394:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361323136:192.168.202.140@tcp:250:kworker.0
00000008:00100000:2.0:1788575951.011395:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575951.011403:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453361323520/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575951.011411:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575951.011413:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575951.011415:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575951.011418:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4296
00000100:00080000:2.0:1788575951.011421:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575951.011424:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575951.011427:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575951.011434:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453361323648/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575951.011441:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575951.011444:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575951.011445:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575951.011448:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4296
00000100:00080000:2.0:1788575951.011451:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575951.011454:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575951.011458:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575951.011468:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361323776/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575951.011489:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361323264:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788575951.011517:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575951.011520:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575951.011522:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788575951.011523:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361323392:192.168.202.140@tcp:8:kworker.0
00000100:00080000:2.0:1788575951.011525:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4296
00000100:00080000:2.0:1788575951.011529:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575951.011532:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575951.011537:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575951.011548:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453361323904/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575951.011548:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361323520:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575951.011567:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361323648:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575951.011586:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361323776:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575951.011608:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361323904:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575951.395046:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575951.395067:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575951.395092:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575951.395149:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575951.395163:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788575951.395168:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575952.035047:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575952.418976:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575952.418976:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575952.419044:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575952.419065:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575952.419066:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575952.419132:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575953.059053:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00010000:00010000:0.0:1788575953.443118:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575953.444082:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575953.444101:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575953.444193:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575953.444290:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575953.444336:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575954.083125:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000400:00000100:3.0:1788575954.083268:0:2334:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.140:988
00000400:00000100:3.0:1788575954.083321:0:2334:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.140@tcp at host 192.168.202.140 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:3.0:1788575954.083343:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788575954.083398:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788575954.083408:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788575954.083425:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788575954.083433:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788575954.083447:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788575954.083456:0:2334:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:1.0:1788575954.083534:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575951/real 1788575954]  req@ffff8dc020497100 x1875453361323904/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575976 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575954.083564:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453361323904/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575976 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575954.083577:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575954.083581:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575954.083586:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361323904:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575954.083599:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575951/real 1788575954]  req@ffff8dc020497480 x1875453361323392/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575976 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575954.083613:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453361323392/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575976 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575954.083627:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575954.083631:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575954.083634:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361323392:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575954.083641:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575951/real 1788575954]  req@ffff8dc020496d80 x1875453361323520/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575976 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575954.083661:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453361323520/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575976 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575954.083670:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575954.083678:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575954.083682:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361323520:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575954.083699:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575951/real 1788575954]  req@ffff8dc020494380 x1875453361323648/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575976 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575954.083717:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453361323648/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575976 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575954.083737:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575954.083745:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575954.083749:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361323648:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788575954.083755:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575951/real 1788575954]  req@ffff8dc020495500 x1875453361323776/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575976 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575954.083778:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361323776/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575976 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575954.083786:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575954.083789:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575954.083793:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361323776:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575954.083805:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575951/real 1788575954]  req@ffff8dc020495180 x1875453361323136/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575976 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575954.083819:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361323136/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575976 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575954.083832:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575954.083836:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575954.083839:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361323136:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788575954.083846:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575951/real 1788575954]  req@ffff8dc020494700 x1875453361323264/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575976 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575954.083904:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361323264/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575976 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575954.083921:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575954.083925:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575954.083928:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361323264:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575954.466943:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575954.467054:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575954.467119:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575954.467800:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575954.467814:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575954.467885:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575955.107427:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575955.490985:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575955.491117:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575955.491176:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575955.491827:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575955.491830:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575955.491832:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00080000:2.0:1788575956.131016:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575956.131027:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788575956.131031:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575956.131041:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4301
00000100:00080000:2.0:1788575956.131053:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575956.131060:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575956.131105:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453361324032/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575956.131151:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575956.131156:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575956.131158:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575956.131162:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4301
00000100:00080000:2.0:1788575956.131167:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575956.131171:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575956.131183:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575956.131197:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361324160/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575956.131206:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361324032:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788575956.131222:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575956.131227:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575956.131229:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575956.131234:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4301
00000100:00080000:2.0:1788575956.131238:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575956.131242:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575956.131257:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575956.131270:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361324288/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575956.131284:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575956.131289:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575956.131291:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1788575956.131294:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788575956.131298:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4301
00000100:00080000:2.0:1788575956.131307:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575956.131312:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575956.131318:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575956.131330:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453361324416/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575956.131339:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575956.131342:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575956.131345:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575956.131349:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4301
00000100:00080000:2.0:1788575956.131352:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575956.131356:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575956.131361:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575956.131373:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453361324544/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575956.131382:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575956.131386:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575956.131387:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575956.131392:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4301
00000100:00080000:2.0:1788575956.131395:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575956.131399:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575956.131404:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575956.131415:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361324672/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575956.131431:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575956.131435:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575956.131437:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575956.131440:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4301
00000100:00080000:2.0:1788575956.131443:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575956.131447:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575956.131452:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575956.131462:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361324800/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575956.131486:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575956/real 1788575956]  req@ffff8dc020496a00 x1875453361324032/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575981 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575956.131509:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453361324032/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575981 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575956.131521:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575956.131526:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575956.131530:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361324032:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788575956.131560:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361324160:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575956.131585:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575956.131599:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575956/real 1788575956]  req@ffff8dc020494000 x1875453361324160/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575981 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575956.131610:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361324160/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575981 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575956.131622:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575956.131625:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575956.131629:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361324160:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575956.131635:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361324288:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575956.131656:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575956.133032:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575956/real 1788575956]  req@ffff8dc020495880 x1875453361324288/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575981 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575956.133072:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361324288/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575981 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575956.133083:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575956.133086:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575956.133090:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361324288:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575956.133100:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361324416:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575956.133154:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575956.133174:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575956/real 1788575956]  req@ffff8dc020494e00 x1875453361324416/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575981 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575956.133186:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453361324416/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575981 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575956.133194:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575956.135126:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575956.135157:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361324416:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575956.135174:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361324544:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788575956.135186:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000800:00000100:3.0:1788575956.135247:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575956.135278:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575956/real 1788575956]  req@ffff8dc020494a80 x1875453361324544/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575981 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575956.135296:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453361324544/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575981 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575956.135308:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575956.135312:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575956.135315:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361324544:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575956.135322:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361324672:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575956.135343:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575956.135354:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575956/real 1788575956]  req@ffff8dc020494700 x1875453361324672/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575981 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575956.135365:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361324672/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575981 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575956.135372:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575956.135375:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575956.135378:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361324672:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575956.135385:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361324800:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575956.135423:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575956.135435:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575956/real 1788575956]  req@ffff8dc020495180 x1875453361324800/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575981 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575956.135446:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361324800/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575981 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575956.135453:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575956.135456:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575956.135460:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361324800:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575956.515039:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575956.515063:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575956.515075:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575956.515097:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575956.515139:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575956.515402:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575957.155425:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575957.539065:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575957.539065:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575957.539388:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575957.539596:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575957.539695:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788575957.539834:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575958.180156:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575958.563036:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575958.563036:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575958.563181:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575958.563186:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575958.563228:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575958.563299:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575959.203037:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575959.586985:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575959.587158:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575959.587234:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575959.587276:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575959.587308:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788575959.587723:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575960.227016:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575960.611001:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575960.611029:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575960.611038:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575960.611052:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575960.611507:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575960.611526:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00080000:3.0:1788575961.251041:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575961.251055:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788575961.251060:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575961.251077:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4306
00000100:00100000:1.0:1788575961.251083:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788575961.251091:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575961.251104:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575961.251152:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644fb80 x1875453361324928/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575961.251192:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575961.251196:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575961.251198:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575961.251202:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4306
00000100:00080000:3.0:1788575961.251206:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575961.251211:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575961.251223:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575961.251230:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361324928:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788575961.251243:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644df80 x1875453361325056/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575961.251258:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575961.251261:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575961.251264:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575961.251269:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4306
00000100:00080000:3.0:1788575961.251273:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575961.251278:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575961.251284:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575961.251297:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ed80 x1875453361325184/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788575961.251311:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788575961.251321:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575961.251326:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575961.251328:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575961.251335:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4306
00000100:00080000:3.0:1788575961.251340:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575961.251344:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575961.251349:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575961.251359:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f100 x1875453361325312/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788575961.251368:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575961/real 1788575961]  req@ffff8dc00644fb80 x1875453361324928/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575986 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575961.251370:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575961.251378:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575961.251382:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575961.251391:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4306
00000100:00080000:3.0:1788575961.251396:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575961.251405:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575961.251411:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575961.251418:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644fb80 x1875453361324928/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575986 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575961.251429:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1788575961.251429:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d880 x1875453361325440/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575961.251437:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575961.251452:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361324928:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788575961.251470:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575961.251474:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575961.251476:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575961.251480:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4306
00000100:00080000:3.0:1788575961.251485:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575961.251496:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575961.251497:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361325056:192.168.202.140@tcp:38:kworker.0
00000008:00100000:3.0:1788575961.251509:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1788575961.251530:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575961.251536:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e300 x1875453361325568/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788575961.251543:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575961/real 1788575961]  req@ffff8dc00644df80 x1875453361325056/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575986 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575961.251573:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788575961.251581:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644df80 x1875453361325056/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575986 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575961.251581:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575961.251588:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575961.251599:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4306
00000100:00080000:3.0:1788575961.251608:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575961.251612:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575961.251616:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:1.0:1788575961.251639:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000008:00100000:3.0:1788575961.251640:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575961.251651:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361325056:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575961.251658:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c700 x1875453361325696/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788575961.251666:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361325184:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788575961.251696:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575961.251706:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575961/real 1788575961]  req@ffff8dc00644ed80 x1875453361325184/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575986 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575961.251714:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ed80 x1875453361325184/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575986 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575961.251720:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575961.251722:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575961.251724:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361325184:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575961.251728:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361325312:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788575961.251740:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575961.251745:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575961/real 1788575961]  req@ffff8dc00644f100 x1875453361325312/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575986 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575961.251752:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f100 x1875453361325312/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575986 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575961.251761:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575961.251763:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575961.251765:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361325312:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575961.251769:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361325440:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788575961.251779:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575961.251784:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575961/real 1788575961]  req@ffff8dc00644d880 x1875453361325440/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575986 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575961.251790:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d880 x1875453361325440/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575986 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575961.251796:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575961.251797:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575961.251799:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361325440:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788575961.251814:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361325568:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788575961.251833:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575961.251844:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575961/real 1788575961]  req@ffff8dc00644e300 x1875453361325568/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575986 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575961.251855:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453361325568/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575986 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575961.251862:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575961.251889:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575961.251893:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361325568:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575961.251900:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361325696:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788575961.251918:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575961.251928:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575961/real 1788575961]  req@ffff8dc00644c700 x1875453361325696/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575986 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575961.252077:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453361325696/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575986 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575961.252083:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575961.252086:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575961.252089:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361325696:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575961.635015:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575961.635015:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575961.635110:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575961.635161:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575961.635196:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788575961.635801:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575962.274968:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575962.659029:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575962.659355:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575962.659381:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575962.659461:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575962.659536:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575962.659561:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575963.299007:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575963.682972:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575963.683005:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575963.683005:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575963.683178:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788575963.683192:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788575963.683285:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575964.323060:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575964.707015:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575964.707016:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575964.707016:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575964.707053:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575964.707056:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575964.707127:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575965.346988:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575965.730940:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575965.730956:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575965.730965:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575965.731037:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575965.731229:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575965.731287:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575966.370978:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575966.370991:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575966.370997:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788575966.371001:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575966.371011:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4312
00000100:00080000:0.0:1788575966.371019:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575966.371026:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575966.371060:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361325824/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575966.371085:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575966.371088:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575966.371090:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575966.371093:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4312
00000100:00080000:0.0:1788575966.371096:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575966.371100:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575966.371108:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575966.371122:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361325952/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788575966.371130:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361325824:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788575966.371143:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575966.371145:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575966.371147:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575966.371150:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4312
00000100:00080000:0.0:1788575966.371152:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575966.371154:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575966.371157:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575966.371165:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453361326080/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575966.371171:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575966.371173:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575966.371174:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575966.371176:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4312
00000100:00080000:0.0:1788575966.371194:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575966.371198:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575966.371202:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1788575966.371205:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788575966.371215:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361326208/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575966.371223:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575966.371226:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575966.371228:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575966.371232:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4312
00000100:00080000:0.0:1788575966.371237:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575966.371241:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575966.371247:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575966.371249:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575966/real 1788575966]  req@ffff8dc006713800 x1875453361325824/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575991 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575966.371260:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361326336/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575966.371272:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788575966.371272:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361325824/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575991 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575966.371281:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575966.371285:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575966.371292:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575966.371293:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4312
00000100:00080000:0.0:1788575966.371298:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575966.371302:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788575966.371304:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575966.371310:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575966.371312:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361325824:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788575966.371321:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361326464/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575966.371327:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575966.371330:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575966.371331:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575966.371333:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4312
00000100:00080000:0.0:1788575966.371334:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575966.371336:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575966.371340:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575966.371342:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361325952:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788575966.371351:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361326592/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788575966.371371:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575966.371396:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575966/real 1788575966]  req@ffff8dc006712300 x1875453361325952/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575991 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575966.371407:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361325952/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575991 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575966.371413:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575966.371415:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575966.371418:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361325952:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788575966.371422:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361326080:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788575966.371442:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575966.371453:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575966/real 1788575966]  req@ffff8dc006710380 x1875453361326080/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575991 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575966.371465:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453361326080/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575991 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575966.371477:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575966.371480:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575966.371483:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361326080:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575966.371488:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361326208:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788575966.371505:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575966.371514:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575966/real 1788575966]  req@ffff8dc006711c00 x1875453361326208/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575991 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575966.371524:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361326208/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575991 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575966.371541:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575966.371545:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575966.371548:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361326208:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575966.371553:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361326336:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788575966.371570:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575966.371592:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575966/real 1788575966]  req@ffff8dc006713480 x1875453361326336/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575991 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575966.371601:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361326336/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575991 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575966.371607:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575966.371608:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575966.371611:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361326336:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788575966.371615:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361326464:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788575966.371643:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575966.371653:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575966/real 1788575966]  req@ffff8dc006712a00 x1875453361326464/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575991 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575966.371664:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361326464/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575991 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575966.371671:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575966.371673:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575966.371677:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361326464:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575966.371695:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361326592:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788575966.371713:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575966.371724:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575966/real 1788575966]  req@ffff8dc006713800 x1875453361326592/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575991 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575966.371736:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361326592/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575991 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575966.371744:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575966.371748:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575966.371751:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361326592:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575966.755023:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575966.755136:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575966.755194:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575966.755551:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575966.756983:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575966.757013:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575967.395009:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575967.778960:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575967.778975:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575967.778984:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575967.779089:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575967.779160:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575967.779184:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575968.418989:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575968.802967:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575968.802967:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575968.802968:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575968.803055:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575968.803064:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575968.803106:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575969.442974:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575969.827060:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575969.827197:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575969.827209:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575969.827252:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788575969.827285:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575969.827296:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575970.466954:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575970.850986:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575970.850986:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575970.850994:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575970.851252:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575970.851255:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575970.851298:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575971.495029:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788575971.495578:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575971.495584:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788575971.495588:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575971.495598:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4317
00000100:00080000:2.0:1788575971.495608:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575971.495615:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575971.495650:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361326720/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575971.495683:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575971.495686:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575971.495688:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575971.495691:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4317
00000100:00080000:2.0:1788575971.495695:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575971.495699:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575971.495707:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575971.495720:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453361326848/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575971.495729:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575971.495732:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575971.495734:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575971.495737:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4317
00000100:00080000:2.0:1788575971.495740:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575971.495744:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575971.495748:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575971.495758:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453361326976/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575971.495766:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575971.495769:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575971.495771:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575971.495774:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4317
00000100:00080000:2.0:1788575971.495778:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575971.495782:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575971.495786:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575971.495794:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453361327104/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575971.495799:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575971.495801:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575971.495802:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575971.495804:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4317
00000100:00080000:2.0:1788575971.495806:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575971.495808:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575971.495810:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575971.495816:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453361327232/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575971.495821:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575971.495823:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575971.495824:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575971.495827:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4317
00000100:00080000:2.0:1788575971.495828:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575971.495830:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575971.495832:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575971.495837:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361327360/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575971.495842:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575971.495843:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575971.495844:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575971.495846:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4317
00000100:00080000:2.0:1788575971.495848:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575971.495850:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575971.495852:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575971.495857:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361327488/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788575971.495964:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361326720:192.168.202.140@tcp:250:kworker.0
00000800:00000100:1.0:1788575971.496023:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575971.496062:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575971/real 1788575971]  req@ffff8dc020495500 x1875453361326720/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575996 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575971.496079:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361326720/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788575996 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575971.496089:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575971.496093:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575971.496097:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361326720:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788575971.496104:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361326848:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788575971.496124:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575971.496136:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575971/real 1788575971]  req@ffff8dc020494380 x1875453361326848/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575996 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575971.496147:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453361326848/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575996 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575971.496156:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575971.496159:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575971.496163:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361326848:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788575971.496169:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361326976:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788575971.496189:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575971.496200:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575971/real 1788575971]  req@ffff8dc020496d80 x1875453361326976/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575996 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575971.496212:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453361326976/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575996 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575971.496220:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575971.496222:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575971.496226:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361326976:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575971.496232:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361327104:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788575971.496249:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575971.496258:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575971/real 1788575971]  req@ffff8dc020497480 x1875453361327104/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575996 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575971.496268:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453361327104/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575996 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575971.496276:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575971.496278:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575971.496282:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361327104:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575971.496287:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361327232:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788575971.496304:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575971.496314:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575971/real 1788575971]  req@ffff8dc020497100 x1875453361327232/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575996 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575971.496325:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453361327232/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788575996 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575971.496333:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575971.496335:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575971.496338:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361327232:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788575971.496342:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361327360:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788575971.496359:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575971.496369:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575971/real 1788575971]  req@ffff8dc020495180 x1875453361327360/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575996 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575971.496379:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361327360/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575996 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575971.496386:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575971.496389:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575971.496392:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361327360:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575971.496397:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361327488:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788575971.496414:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575971.496423:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575971/real 1788575971]  req@ffff8dc020494700 x1875453361327488/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575996 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575971.496433:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361327488/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788575996 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575971.496440:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575971.496443:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575971.496446:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361327488:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575971.874973:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575971.874974:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575971.874974:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575971.874977:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575971.875002:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788575971.875060:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575972.515016:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575972.898967:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575972.898972:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575972.899003:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575972.899091:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575972.899103:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575972.899104:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575973.538985:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575973.922977:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575973.922977:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575973.922977:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575973.922983:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575973.923005:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788575973.923063:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575974.562994:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575974.946980:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575974.946980:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575974.947018:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575974.947079:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575974.947094:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575974.947126:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575975.587222:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575975.970988:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575975.970989:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575975.971019:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575975.971133:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575975.971139:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575975.971151:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575976.610995:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788575976.611042:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575976.611048:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788575976.611052:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575976.611061:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4322
00000100:00080000:3.0:1788575976.611070:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575976.611076:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575976.611110:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e680 x1875453361327616/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575976.611139:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575976.611142:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575976.611145:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575976.611148:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4322
00000100:00080000:3.0:1788575976.611151:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575976.611155:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575976.611170:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575976.611181:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d180 x1875453361327744/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575976.611190:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575976.611193:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575976.611194:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575976.611197:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4322
00000100:00080000:3.0:1788575976.611200:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575976.611204:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575976.611208:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575976.611217:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f480 x1875453361327872/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575976.611224:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575976.611227:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575976.611229:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575976.611232:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4322
00000100:00080000:3.0:1788575976.611234:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575976.611237:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575976.611241:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575976.611249:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c380 x1875453361328000/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575976.611256:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575976.611259:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575976.611261:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575976.611264:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4322
00000100:00080000:3.0:1788575976.611267:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575976.611270:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575976.611287:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575976.611297:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d500 x1875453361328128/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575976.611306:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575976.611309:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575976.611311:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575976.611314:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4322
00000100:00080000:3.0:1788575976.611317:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575976.611320:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575976.611324:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575976.611333:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ea00 x1875453361328256/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575976.611341:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575976.611344:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575976.611345:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575976.611349:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4322
00000100:00080000:3.0:1788575976.611352:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575976.611355:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575976.611359:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575976.611368:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ca80 x1875453361328384/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788575976.611454:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361327616:192.168.202.140@tcp:250:kworker.0
00000800:00000100:1.0:1788575976.611512:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575976.611549:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575976/real 1788575976]  req@ffff8dc00644e680 x1875453361327616/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576001 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575976.611565:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453361327616/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576001 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575976.611574:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575976.611577:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575976.611581:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361327616:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788575976.611615:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361327744:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788575976.611637:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575976.611650:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575976/real 1788575976]  req@ffff8dc00644d180 x1875453361327744/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576001 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575976.611662:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453361327744/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576001 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575976.611671:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575976.611674:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575976.611678:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361327744:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788575976.611683:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361327872:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788575976.611703:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575976.611715:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575976/real 1788575976]  req@ffff8dc00644f480 x1875453361327872/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576001 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575976.611725:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453361327872/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576001 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575976.611733:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575976.611736:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575976.611739:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361327872:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575976.611745:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361328000:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788575976.611764:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575976.611784:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575976/real 1788575976]  req@ffff8dc00644c380 x1875453361328000/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576001 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575976.611796:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453361328000/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576001 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575976.611803:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575976.611806:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575976.611809:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361328000:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575976.611814:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361328128:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788575976.611834:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575976.611845:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575976/real 1788575976]  req@ffff8dc00644d500 x1875453361328128/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576001 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575976.611856:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d500 x1875453361328128/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576001 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575976.611890:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575976.611894:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575976.611897:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361328128:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788575976.611902:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361328256:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788575976.611923:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575976.611933:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575976/real 1788575976]  req@ffff8dc00644ea00 x1875453361328256/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576001 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575976.611943:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ea00 x1875453361328256/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576001 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575976.611956:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575976.611959:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575976.611961:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361328256:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575976.611967:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361328384:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788575976.611985:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575976.611995:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575976/real 1788575976]  req@ffff8dc00644ca80 x1875453361328384/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576001 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575976.612006:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ca80 x1875453361328384/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576001 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575976.612013:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575976.612016:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575976.612019:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361328384:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575976.994972:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575976.994974:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575976.994999:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575976.995085:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575976.995149:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575976.995235:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575977.634960:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575978.018958:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788575978.018961:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575978.018966:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575978.018971:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575978.019003:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575978.019031:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575978.658970:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575979.042962:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575979.042963:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575979.042964:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575979.042964:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575979.042993:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575979.043025:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575979.682973:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575980.067008:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575980.067008:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575980.067059:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575980.067355:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575980.067363:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575980.067388:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575980.707003:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575981.091016:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575981.091016:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575981.091054:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575981.091522:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575981.091538:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575981.091548:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575981.731002:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788575981.731009:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575981.731021:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788575981.731029:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575981.731039:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4327
00000100:00080000:0.0:1788575981.731050:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575981.731056:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788575981.731087:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361328512/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575981.731112:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575981.731115:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575981.731117:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575981.731120:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4327
00000100:00080000:0.0:1788575981.731124:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575981.731127:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575981.731137:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575981.731145:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361328512:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788575981.731149:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361328640/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575981.731157:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575981.731160:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788575981.731161:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575981.731164:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4327
00000100:00080000:0.0:1788575981.731167:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575981.731171:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575981.731175:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575981.731183:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361328768/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575981.731196:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575981.731199:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575981.731200:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575981.731213:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4327
00000100:00080000:0.0:1788575981.731216:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1788575981.731218:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788575981.731219:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575981.731227:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575981.731236:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361328896/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788575981.731243:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575981.731246:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788575981.731248:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575981.731251:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4327
00000100:00080000:0.0:1788575981.731254:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788575981.731256:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575981/real 1788575981]  req@ffff8dc006713b80 x1875453361328512/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576006 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575981.731257:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575981.731261:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575981.731269:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361329024/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788575981.731273:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361328512/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576006 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788575981.731283:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575981.731283:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788575981.731286:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575981.731287:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788575981.731288:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1788575981.731291:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361328512:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788575981.731292:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4327
00000100:00080000:0.0:1788575981.731295:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788575981.731298:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575981.731302:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788575981.731310:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361329152/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788575981.731311:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361328640:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788575981.731319:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788575981.731321:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788575981.731323:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788575981.731326:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4327
00000100:00080000:0.0:1788575981.731329:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1788575981.731330:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788575981.731332:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788575981.731336:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575981.731341:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575981/real 1788575981]  req@ffff8dc006713100 x1875453361328640/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576006 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788575981.731344:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361329280/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788575981.731353:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361328640/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576006 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575981.731362:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575981.731365:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575981.731368:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361328640:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788575981.731374:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361328768:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788575981.731399:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575981.731408:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575981/real 1788575981]  req@ffff8dc006711880 x1875453361328768/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576006 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575981.731421:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361328768/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576006 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575981.731429:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575981.731432:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575981.731435:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361328768:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575981.731440:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361328896:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788575981.731459:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575981.731477:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575981/real 1788575981]  req@ffff8dc006711500 x1875453361328896/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576006 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575981.731485:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361328896/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576006 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575981.731491:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575981.731494:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575981.731497:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361328896:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575981.731502:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361329024:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788575981.731521:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575981.731531:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575981/real 1788575981]  req@ffff8dc006712680 x1875453361329024/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576006 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575981.731542:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361329024/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576006 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575981.731552:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575981.731554:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575981.731556:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361329024:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788575981.731567:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361329152:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788575981.731580:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575981.731586:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575981/real 1788575981]  req@ffff8dc006710e00 x1875453361329152/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576006 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575981.731592:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361329152/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576006 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575981.731597:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575981.731598:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575981.731600:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361329152:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575981.731603:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361329280:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788575981.731611:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575981.731616:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575981/real 1788575981]  req@ffff8dc006713b80 x1875453361329280/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576006 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575981.731621:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361329280/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576006 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575981.731626:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575981.731627:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575981.731629:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361329280:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575982.114976:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575982.114977:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575982.114977:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575982.115017:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575982.115017:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575982.115099:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575982.755027:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575983.138941:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575983.138945:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575983.138962:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788575983.138969:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575983.138979:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575983.139019:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575983.778991:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575984.162986:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575984.162986:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575984.163012:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575984.163090:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575984.163114:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575984.163135:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575984.802992:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575985.186991:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575985.186991:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575985.186991:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575985.186992:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575985.187021:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575985.187057:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575985.827005:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575986.210976:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575986.210976:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575986.210976:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575986.210976:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575986.211009:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575986.211060:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1788575986.850998:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788575986.850999:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788575986.851009:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788575986.851015:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575986.851029:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4332
00000100:00080000:3.0:1788575986.851039:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575986.851046:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575986.851075:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ce00 x1875453361329408/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575986.851095:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575986.851098:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575986.851099:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575986.851102:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4332
00000100:00080000:3.0:1788575986.851104:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575986.851107:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575986.851115:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575986.851127:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644dc00 x1875453361329536/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788575986.851134:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361329408:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788575986.851140:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575986.851144:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575986.851147:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575986.851151:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4332
00000100:00080000:3.0:1788575986.851155:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575986.851159:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575986.851165:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575986.851177:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c000 x1875453361329664/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575986.851186:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575986.851190:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575986.851192:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575986.851197:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4332
00000100:00080000:3.0:1788575986.851201:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1788575986.851206:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788575986.851209:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575986.851215:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575986.851227:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f800 x1875453361329792/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575986.851237:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575986.851241:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788575986.851243:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575986.851246:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4332
00000100:00100000:1.0:1788575986.851251:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575986/real 1788575986]  req@ffff8dc00644ce00 x1875453361329408/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576011 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575986.851251:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575986.851257:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575986.851262:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575986.851276:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ca80 x1875453361329920/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788575986.851280:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ce00 x1875453361329408/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576011 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575986.851295:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575986.851299:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575986.851303:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361329408:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788575986.851325:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361329536:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788575986.851345:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788575986.851348:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788575986.851351:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1788575986.851353:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788575986.851356:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4332
00000100:00080000:3.0:1788575986.851361:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788575986.851365:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788575986.851371:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575986.851373:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575986/real 1788575986]  req@ffff8dc00644dc00 x1875453361329536/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576011 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575986.851385:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ea00 x1875453361330048/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575986.851403:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788575986.851407:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644dc00 x1875453361329536/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576011 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575986.851409:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788575986.851412:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788575986.851418:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4332
00000100:00080000:3.0:1788575986.851422:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575986.851429:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575986.851429:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:1.0:1788575986.851438:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000008:00100000:3.0:1788575986.851438:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575986.851446:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361329536:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575986.851453:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d500 x1875453361330176/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788575986.851456:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361329664:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788575986.851484:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575986.851497:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575986/real 1788575986]  req@ffff8dc00644c000 x1875453361329664/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576011 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575986.851509:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c000 x1875453361329664/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576011 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575986.851517:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575986.851520:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575986.851524:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361329664:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575986.851530:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361329792:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788575986.851551:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575986.851563:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575986/real 1788575986]  req@ffff8dc00644f800 x1875453361329792/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576011 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575986.851578:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f800 x1875453361329792/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576011 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575986.851594:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575986.851598:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575986.851602:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361329792:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575986.851682:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361329920:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788575986.851704:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575986.851716:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575986/real 1788575986]  req@ffff8dc00644ca80 x1875453361329920/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576011 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575986.851727:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ca80 x1875453361329920/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576011 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575986.851736:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575986.851739:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575986.851742:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361329920:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788575986.851748:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361330048:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788575986.851764:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575986.851773:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575986/real 1788575986]  req@ffff8dc00644ea00 x1875453361330048/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576011 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575986.851784:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ea00 x1875453361330048/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576011 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575986.851792:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575986.851794:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575986.851798:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361330048:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575986.851803:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361330176:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788575986.851818:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788575986.851827:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575986/real 1788575986]  req@ffff8dc00644d500 x1875453361330176/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576011 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788575986.851838:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d500 x1875453361330176/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576011 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575986.851845:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788575986.851848:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788575986.851851:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361330176:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788575987.234982:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575987.234989:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575987.235027:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575987.235103:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575987.235109:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575987.235155:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575987.874991:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575988.258983:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575988.258983:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575988.258983:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575988.258985:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575988.259008:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575988.259047:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575988.898985:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575989.282938:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575989.282938:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575989.282940:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575989.282940:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575989.282965:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575989.283017:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575989.922967:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575990.306960:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575990.306961:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788575990.306961:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575990.306968:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575990.306993:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575990.307043:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575990.947006:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575991.330975:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575991.330976:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575991.330976:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575991.330976:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575991.331007:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575991.331051:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575991.971012:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788575991.971123:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575991.971128:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788575991.971131:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575991.971144:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4337
00000100:00080000:1.0:1788575991.971151:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575991.971157:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788575991.971190:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361330304/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575991.971211:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575991.971213:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575991.971214:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575991.971217:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4337
00000100:00080000:1.0:1788575991.971219:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575991.971221:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575991.971228:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575991.971238:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361330432/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575991.971244:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575991.971247:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575991.971248:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575991.971250:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4337
00000100:00080000:1.0:1788575991.971252:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575991.971254:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575991.971258:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575991.971260:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361330304:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788575991.971266:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361330560/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575991.971272:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575991.971274:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575991.971275:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575991.971277:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4337
00000100:00080000:1.0:1788575991.971280:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575991.971282:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575991.971284:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575991.971291:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361330688/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575991.971296:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575991.971298:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788575991.971299:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575991.971302:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4337
00000100:00080000:1.0:1788575991.971304:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575991.971306:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575991.971308:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575991.971314:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361330816/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788575991.971323:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1788575991.971326:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788575991.971327:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788575991.971330:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575991.971334:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4337
00000100:00080000:1.0:1788575991.971337:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575991.971341:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788575991.971345:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575991.971358:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361330944/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788575991.971368:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575991/real 1788575991]  req@ffff8dc005dc1180 x1875453361330304/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576016 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788575991.971376:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788575991.971384:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788575991.971387:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788575991.971394:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4337
00000100:00080000:1.0:1788575991.971398:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788575991.971403:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788575991.971405:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361330304/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576016 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1788575991.971407:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788575991.971421:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361331072/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575991.971421:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575991.971430:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575991.971437:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361330304:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788575991.971445:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361330432:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575991.971469:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575991.971481:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575991/real 1788575991]  req@ffff8dc005dc3b80 x1875453361330432/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576016 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575991.971493:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361330432/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576016 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575991.971503:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575991.971506:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575991.971509:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361330432:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575991.971527:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361330560:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575991.971542:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575991.971557:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575991/real 1788575991]  req@ffff8dc005dc0700 x1875453361330560/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576016 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575991.971564:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361330560/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576016 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575991.971573:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575991.971575:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575991.971576:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361330560:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575991.971580:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361330688:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575991.971590:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575991.971595:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575991/real 1788575991]  req@ffff8dc005dc1c00 x1875453361330688/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576016 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575991.971601:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361330688/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576016 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575991.971606:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575991.971608:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575991.971609:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361330688:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575991.971613:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361330816:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575991.971622:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575991.971628:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575991/real 1788575991]  req@ffff8dc005dc0a80 x1875453361330816/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576016 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575991.971634:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361330816/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576016 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575991.971639:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575991.971640:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575991.971643:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361330816:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575991.971646:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361330944:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575991.971655:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575991.971660:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575991/real 1788575991]  req@ffff8dc005dc1500 x1875453361330944/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576016 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575991.971666:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361330944/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576016 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575991.971671:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575991.971672:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575991.971674:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361330944:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575991.971676:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361331072:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575991.971684:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575991.971689:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575991/real 1788575991]  req@ffff8dc005dc3800 x1875453361331072/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576016 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575991.971695:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361331072/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576016 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575991.971699:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575991.971701:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575991.971702:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361331072:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788575992.354986:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575992.354987:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575992.355015:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788575992.355124:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788575992.355136:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575992.358055:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575992.994983:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575993.378971:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575993.378971:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575993.378973:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788575993.378996:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575993.379001:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788575993.379004:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575994.018944:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575994.402989:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575994.403003:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575994.403011:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575994.403047:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788575994.403047:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575994.403103:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575995.042958:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575995.427031:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575995.427031:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575995.427032:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575995.427056:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575995.427077:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575995.427080:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788575996.067005:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575996.450975:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575996.450975:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788575996.450991:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575996.451005:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575996.451025:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575996.451052:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788575997.090942:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788575997.091076:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575997.091082:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788575997.091086:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575997.091096:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4342
00000100:00080000:2.0:1788575997.091106:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575997.091115:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788575997.091150:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453361331200/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575997.091178:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575997.091181:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575997.091183:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575997.091187:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4342
00000100:00080000:2.0:1788575997.091191:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575997.091197:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575997.091223:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575997.091238:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453361331328/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575997.091251:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788575997.091261:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361331200:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788575997.091262:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575997.091266:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575997.091278:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4342
00000100:00080000:2.0:1788575997.091282:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575997.091286:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575997.091293:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575997.091307:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361331456/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575997.091317:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575997.091320:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575997.091322:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575997.091327:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4342
00000100:00080000:2.0:1788575997.091342:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575997.091348:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575997.091353:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788575997.091365:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788575997.091371:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361331584/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575997.091385:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788575997.091389:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788575997.091391:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575997.091395:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4342
00000100:00080000:2.0:1788575997.091398:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575997.091403:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575997.091408:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575997.091421:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453361331712/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788575997.091432:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788575997.091439:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575997/real 1788575997]  req@ffff8dc020494a80 x1875453361331200/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576022 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575997.091456:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788575997.091459:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575997.091467:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4342
00000100:00100000:3.0:1788575997.091474:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453361331200/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576022 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788575997.091475:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575997.091486:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575997.091491:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788575997.091504:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361331840/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788575997.091507:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575997.091527:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788575997.091532:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788575997.091535:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361331200:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788575997.091539:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788575997.091544:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788575997.091550:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4342
00000100:00080000:2.0:1788575997.091555:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788575997.091560:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788575997.091565:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788575997.091576:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361331328:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788575997.091583:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361331968/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788575997.091612:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575997.091630:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575997/real 1788575997]  req@ffff8dc020494e00 x1875453361331328/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576022 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575997.091643:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453361331328/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576022 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575997.091654:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575997.091658:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575997.091662:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361331328:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575997.091669:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361331456:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575997.091694:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575997.091705:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575997/real 1788575997]  req@ffff8dc020495880 x1875453361331456/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576022 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575997.091724:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361331456/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576022 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575997.091737:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575997.091741:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575997.091744:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361331456:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575997.091751:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361331584:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575997.091772:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575997.091782:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575997/real 1788575997]  req@ffff8dc020494000 x1875453361331584/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576022 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575997.091794:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361331584/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576022 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575997.091803:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575997.091806:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575997.091810:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361331584:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575997.091816:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361331712:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788575997.091845:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575997.091857:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575997/real 1788575997]  req@ffff8dc020496a00 x1875453361331712/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576022 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575997.091904:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453361331712/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576022 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575997.091913:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575997.091916:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575997.091919:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361331712:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788575997.091926:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361331840:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575997.091954:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575997.091966:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575997/real 1788575997]  req@ffff8dc020494700 x1875453361331840/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576022 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575997.091978:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361331840/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576022 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575997.091986:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575997.091989:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575997.091993:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361331840:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788575997.092012:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361331968:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788575997.092035:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788575997.092045:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788575997/real 1788575997]  req@ffff8dc020495180 x1875453361331968/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576022 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788575997.092056:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361331968/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576022 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788575997.092068:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788575997.092072:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788575997.092075:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361331968:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788575997.474994:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788575997.475028:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788575997.475034:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788575997.475041:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575997.475078:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575997.475086:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575998.115036:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575998.499009:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788575998.499009:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575998.499012:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788575998.499076:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575998.500466:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575998.500544:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788575999.139019:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788575999.522982:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788575999.522983:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788575999.523000:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788575999.523014:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788575999.523029:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788575999.523036:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788576000.162998:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576000.547004:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788576000.547009:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788576000.547051:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788576000.547128:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788576000.547227:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788576000.547411:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576001.186993:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576001.570981:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788576001.570981:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788576001.571007:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788576001.571094:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576001.571116:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576001.571151:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788576002.210982:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788576002.210986:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576002.210994:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788576002.210998:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576002.211009:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4347
00000100:00080000:3.0:1788576002.211020:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576002.211026:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788576002.211062:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c380 x1875453361332096/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576002.211089:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576002.211093:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788576002.211094:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576002.211098:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4347
00000100:00080000:3.0:1788576002.211102:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576002.211107:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576002.211117:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788576002.211131:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361332096:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788576002.211132:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f480 x1875453361332224/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576002.211150:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576002.211153:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788576002.211155:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576002.211159:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4347
00000100:00080000:3.0:1788576002.211163:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576002.211167:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576002.211172:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576002.211184:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d180 x1875453361332352/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788576002.211191:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788576002.211198:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576002.211202:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788576002.211204:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576002.211209:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4347
00000100:00080000:3.0:1788576002.211213:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576002.211217:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576002.211223:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788576002.211226:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576002/real 1788576002]  req@ffff8dc00644c380 x1875453361332096/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576027 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576002.211237:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e680 x1875453361332480/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576002.211247:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788576002.211248:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453361332096/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576027 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576002.211254:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788576002.211259:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576002.211267:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4347
00000100:00080000:1.0:1788576002.211268:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576002.211272:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576002.211273:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788576002.211279:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361332096:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788576002.211281:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576002.211288:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576002.211300:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c700 x1875453361332608/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788576002.211301:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361332224:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788576002.211315:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576002.211319:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788576002.211321:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1788576002.211324:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788576002.211329:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4347
00000100:00080000:3.0:1788576002.211334:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788576002.211336:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576002/real 1788576002]  req@ffff8dc00644f480 x1875453361332224/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576027 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576002.211342:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788576002.211349:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453361332224/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576027 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1788576002.211350:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1788576002.211375:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788576002.211378:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788576002.211380:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361332224:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788576002.211387:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e300 x1875453361332736/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788576002.211388:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361332352:192.168.202.140@tcp:8:kworker.0
00000100:00080000:3.0:1788576002.211402:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576002.211406:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000800:00000100:1.0:1788576002.211409:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788576002.211410:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576002.211417:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4347
00000100:00100000:1.0:1788576002.211421:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576002/real 1788576002]  req@ffff8dc00644d180 x1875453361332352/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576027 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576002.211421:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576002.211429:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576002.211436:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576002.211452:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d880 x1875453361332864/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788576002.211454:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453361332352/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576027 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576002.211482:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788576002.211487:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788576002.211491:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361332352:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788576002.211499:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361332480:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788576002.211519:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788576002.211530:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576002/real 1788576002]  req@ffff8dc00644e680 x1875453361332480/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576027 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788576002.211541:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453361332480/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576027 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576002.211550:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788576002.211553:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788576002.211556:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361332480:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788576002.211569:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361332608:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788576002.211582:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788576002.211589:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576002/real 1788576002]  req@ffff8dc00644c700 x1875453361332608/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576027 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788576002.211595:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453361332608/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576027 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576002.211605:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788576002.211607:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788576002.211608:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361332608:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788576002.211612:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361332736:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788576002.211621:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788576002.211626:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576002/real 1788576002]  req@ffff8dc00644e300 x1875453361332736/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576027 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788576002.211632:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453361332736/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576027 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576002.211636:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788576002.211637:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788576002.211639:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361332736:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788576002.211642:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361332864:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788576002.211650:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788576002.211659:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576002/real 1788576002]  req@ffff8dc00644d880 x1875453361332864/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576027 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788576002.211669:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d880 x1875453361332864/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576027 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576002.211676:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788576002.211679:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788576002.211682:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361332864:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788576002.594995:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576002.595000:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788576002.595037:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788576002.595118:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788576002.595130:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788576002.595286:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576003.234990:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576003.619024:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576003.619024:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576003.619521:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788576003.619543:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788576003.619545:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788576003.620182:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576004.259008:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576004.643029:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788576004.643069:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788576004.643082:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788576004.643092:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788576004.643244:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576004.643311:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788576005.283001:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576005.667012:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788576005.667012:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788576005.667040:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788576005.667047:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576005.667048:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788576005.667064:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788576006.307012:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576006.691019:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576006.691019:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788576006.691058:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576006.691073:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788576006.691125:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788576006.691161:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576007.331031:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788576007.331065:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576007.331073:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788576007.331078:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576007.331089:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4352
00000100:00080000:2.0:1788576007.331104:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576007.331113:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788576007.331165:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453361332992/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788576007.331201:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576007.331204:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788576007.331206:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576007.331210:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4352
00000100:00080000:2.0:1788576007.331220:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576007.331229:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788576007.331238:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361332992:192.168.202.140@tcp:250:kworker.0
00000008:00100000:2.0:1788576007.331241:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788576007.331257:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453361333120/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788576007.331267:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576007.331271:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788576007.331273:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576007.331277:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4352
00000100:00080000:2.0:1788576007.331281:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576007.331285:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788576007.331291:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788576007.331303:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453361333248/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788576007.331312:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576007.331316:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788576007.331318:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576007.331323:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4352
00000800:00000100:1.0:1788576007.331328:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788576007.331330:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576007.331337:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788576007.331342:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788576007.331355:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453361333376/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788576007.331363:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576007.331367:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788576007.331369:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576007.331373:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4352
00000100:00080000:2.0:1788576007.331377:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576007.331381:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788576007.331387:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576007/real 1788576007]  req@ffff8dc020497100 x1875453361332992/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576032 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1788576007.331387:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788576007.331406:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361333504/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788576007.331411:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453361332992/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576032 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576007.331434:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576007.331435:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788576007.331442:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788576007.331445:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788576007.331446:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576007.331452:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4352
00000100:00080000:2.0:1788576007.331456:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788576007.331462:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361332992:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788576007.331463:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788576007.331472:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788576007.331487:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361333632/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788576007.331498:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788576007.331502:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361333120:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788576007.331504:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788576007.331507:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576007.331524:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4352
00000100:00080000:2.0:1788576007.331529:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576007.331533:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788576007.331538:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1788576007.331547:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788576007.331551:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361333760/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788576007.331565:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576007/real 1788576007]  req@ffff8dc020497480 x1875453361333120/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576032 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788576007.331587:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453361333120/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576032 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576007.331598:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788576007.331601:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788576007.331603:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361333120:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788576007.331608:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361333248:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788576007.331624:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788576007.331632:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576007/real 1788576007]  req@ffff8dc020496d80 x1875453361333248/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576032 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788576007.331640:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453361333248/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576032 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576007.331646:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788576007.331648:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788576007.331650:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361333248:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788576007.331661:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361333376:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788576007.331672:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788576007.331680:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576007/real 1788576007]  req@ffff8dc020494380 x1875453361333376/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576032 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788576007.331690:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453361333376/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576032 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576007.331704:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788576007.331708:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788576007.331711:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361333376:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788576007.331717:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361333504:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788576007.331736:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788576007.331748:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576007/real 1788576007]  req@ffff8dc020495500 x1875453361333504/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576032 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788576007.331759:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361333504/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576032 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576007.331769:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788576007.331772:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788576007.331775:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361333504:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788576007.331794:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361333632:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788576007.331815:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788576007.331826:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576007/real 1788576007]  req@ffff8dc020495180 x1875453361333632/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576032 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788576007.331838:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361333632/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576032 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576007.331844:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788576007.331846:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788576007.331849:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361333632:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788576007.331855:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361333760:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788576007.331896:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788576007.331908:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576007/real 1788576007]  req@ffff8dc020494700 x1875453361333760/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576032 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788576007.331918:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361333760/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576032 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576007.331925:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788576007.331928:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788576007.331931:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361333760:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788576007.715008:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576007.715009:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788576007.715009:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576007.715009:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788576007.715050:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788576007.715103:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576008.355018:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576008.739040:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576008.739041:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788576008.739234:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788576008.739317:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788576008.739635:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788576008.739649:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576009.379041:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00010000:00010000:3.0:1788576009.763107:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576009.763128:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788576009.765926:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576009.765926:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788576009.766128:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576009.766161:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788576010.403149:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576010.786994:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576010.786994:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788576010.787064:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788576010.787307:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576010.787698:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788576010.787766:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788576011.427022:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576011.810989:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788576011.811019:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788576011.811131:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788576011.811142:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788576011.811144:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576011.811199:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00080000:0.0:1788576012.451014:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788576012.451014:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788576012.451026:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788576012.451031:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788576012.451042:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4358
00000100:00080000:0.0:1788576012.451052:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788576012.451060:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788576012.451100:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361333888/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788576012.451128:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788576012.451132:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788576012.451134:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788576012.451138:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4358
00000100:00080000:0.0:1788576012.451141:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788576012.451146:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788576012.451157:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788576012.451171:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361333888:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788576012.451172:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361334016/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788576012.451187:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788576012.451190:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788576012.451192:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788576012.451195:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4358
00000100:00080000:0.0:1788576012.451199:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788576012.451203:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788576012.451209:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788576012.451221:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361334144/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788576012.451231:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788576012.451234:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000800:00000100:1.0:1788576012.451237:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788576012.451238:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788576012.451245:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4358
00000100:00080000:0.0:1788576012.451249:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788576012.451253:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788576012.451258:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788576012.451270:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361334272/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788576012.451279:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788576012.451281:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576012/real 1788576012]  req@ffff8dc006713800 x1875453361333888/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576037 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788576012.451284:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788576012.451288:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788576012.451296:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4358
00000100:00080000:0.0:1788576012.451300:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788576012.451303:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361333888/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576037 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788576012.451307:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788576012.451316:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1788576012.451319:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1788576012.451328:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453361334400/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788576012.451339:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788576012.451341:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788576012.451346:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788576012.451347:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1788576012.451349:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361333888:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788576012.451355:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4358
00000100:00080000:0.0:1788576012.451359:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788576012.451363:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788576012.451368:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788576012.451380:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361334016:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788576012.451381:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361334528/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788576012.451396:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788576012.451399:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788576012.451401:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788576012.451406:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4358
00000800:00000100:1.0:1788576012.451411:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788576012.451421:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788576012.451426:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576012/real 1788576012]  req@ffff8dc006712a00 x1875453361334016/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576037 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788576012.451427:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788576012.451435:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788576012.451443:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361334016/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576037 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788576012.451450:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361334656/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788576012.451454:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788576012.451462:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788576012.451468:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361334016:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788576012.451474:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361334144:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788576012.451494:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788576012.451504:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576012/real 1788576012]  req@ffff8dc006713480 x1875453361334144/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576037 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788576012.451515:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361334144/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576037 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576012.451529:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788576012.451531:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788576012.451533:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361334144:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788576012.451537:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361334272:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788576012.451550:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788576012.451557:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576012/real 1788576012]  req@ffff8dc006711c00 x1875453361334272/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576037 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788576012.451563:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361334272/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576037 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576012.451569:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788576012.451570:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788576012.451572:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361334272:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788576012.451575:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361334400:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788576012.451584:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788576012.451589:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576012/real 1788576012]  req@ffff8dc006710380 x1875453361334400/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576037 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788576012.451595:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453361334400/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576037 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576012.451600:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788576012.451602:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788576012.451604:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361334400:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788576012.451614:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361334528:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788576012.451624:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788576012.451629:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576012/real 1788576012]  req@ffff8dc006712300 x1875453361334528/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576037 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788576012.451635:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361334528/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576037 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576012.451640:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788576012.451641:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788576012.451643:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361334528:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788576012.451646:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361334656:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788576012.451654:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788576012.451659:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576012/real 1788576012]  req@ffff8dc006713800 x1875453361334656/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576037 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788576012.451665:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361334656/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576037 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576012.451700:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788576012.451702:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788576012.451704:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361334656:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788576012.834983:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788576012.834984:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576012.834984:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576012.834985:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788576012.835015:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788576012.835051:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576013.474997:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576013.858988:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788576013.858988:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788576013.858993:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788576013.859052:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788576013.859058:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576013.859061:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576014.499760:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576014.882975:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788576014.882975:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788576014.883013:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576014.883065:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576014.883076:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788576014.883091:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788576015.523028:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576015.906946:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788576015.907005:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788576015.907100:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576015.907132:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788576015.907142:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788576015.907153:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576016.546972:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576016.930973:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576016.930974:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788576016.930997:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788576016.931007:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788576016.931017:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788576016.931034:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576017.571009:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788576017.571082:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576017.571087:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788576017.571090:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576017.571098:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4363
00000100:00080000:1.0:1788576017.571106:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576017.571111:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788576017.571143:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361334784/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788576017.571167:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576017.571170:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788576017.571171:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576017.571173:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4363
00000100:00080000:1.0:1788576017.571175:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576017.571177:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788576017.571184:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788576017.571194:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361334912/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788576017.571207:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576017.571210:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788576017.571212:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576017.571216:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4363
00000100:00080000:1.0:1788576017.571219:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576017.571223:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788576017.571228:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576017.571241:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361334784:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788576017.571256:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361335040/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788576017.571268:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576017.571271:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788576017.571272:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576017.571275:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4363
00000100:00080000:1.0:1788576017.571279:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576017.571283:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788576017.571288:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788576017.571309:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361335168/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788576017.571317:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576017.571320:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788576017.571322:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576017.571325:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4363
00000100:00080000:1.0:1788576017.571328:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576017.571331:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788576017.571335:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788576017.571346:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361335296/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788576017.571354:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576017.571371:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788576017.571373:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576017.571377:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4363
00000100:00080000:1.0:1788576017.571381:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576017.571386:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788576017.571391:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576017.571392:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361334912:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788576017.571410:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361335424/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788576017.571420:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576017.571423:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788576017.571425:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576017.571428:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4363
00000100:00080000:1.0:1788576017.571432:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788576017.571434:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361335040:192.168.202.140@tcp:8:kworker.0
00000100:00080000:1.0:1788576017.571438:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788576017.571443:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788576017.571454:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361335552/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788576017.571478:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361335168:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788576017.571502:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361335296:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788576017.571525:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361335424:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788576017.571547:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361335552:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788576017.954955:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788576017.955055:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576017.955100:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788576017.955111:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788576017.956200:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788576017.956858:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576018.596025:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576018.979007:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788576018.979007:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788576018.979159:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576018.980328:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788576018.980335:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788576018.980387:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788576019.619096:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576020.003012:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576020.003016:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788576020.003150:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788576020.003174:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576020.003208:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788576020.003401:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576020.643117:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000400:00000100:1.0:1788576020.643214:0:2335:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.140:988
00000400:00000100:1.0:1788576020.643266:0:2335:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.140@tcp at host 192.168.202.140 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:1.0:1788576020.643291:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788576020.643322:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788576020.643330:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788576020.643339:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788576020.643347:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788576020.643358:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:1.0:1788576020.643367:0:2335:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:3.0:1788576020.643367:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576017/real 1788576020]  req@ffff8dc005dc1500 x1875453361335040/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576042 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576020.643394:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361335040/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576042 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576020.643406:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576020.643411:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576020.643415:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361335040:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788576020.643423:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576017/real 1788576020]  req@ffff8dc005dc0a80 x1875453361335168/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576042 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576020.643436:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361335168/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576042 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576020.643444:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576020.643460:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576020.643463:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361335168:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788576020.643470:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576017/real 1788576020]  req@ffff8dc005dc1c00 x1875453361335296/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576042 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576020.643484:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361335296/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576042 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576020.643492:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576020.643496:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576020.643499:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361335296:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788576020.643505:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576017/real 1788576020]  req@ffff8dc005dc0700 x1875453361335424/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576042 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576020.643517:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361335424/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576042 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576020.643524:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576020.643528:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576020.643531:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361335424:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788576020.643538:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576017/real 1788576020]  req@ffff8dc005dc2d80 x1875453361334784/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576042 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576020.643549:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361334784/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576042 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576020.643556:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576020.643559:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576020.643562:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361334784:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788576020.643568:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576017/real 1788576020]  req@ffff8dc005dc3800 x1875453361334912/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576042 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576020.643580:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361334912/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576042 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576020.643588:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576020.643591:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576020.643595:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361334912:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788576020.643625:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576017/real 1788576020]  req@ffff8dc005dc3b80 x1875453361335552/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576042 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576020.643638:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361335552/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576042 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576020.643645:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576020.643648:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576020.643651:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361335552:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788576021.027071:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576021.027071:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788576021.027699:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788576021.027701:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576021.027703:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788576021.028047:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788576021.667046:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576022.050990:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576022.050990:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788576022.051029:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576022.051118:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788576022.051129:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576022.051172:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788576022.691210:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788576022.695200:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576022.695210:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788576022.695214:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576022.695224:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4368
00000100:00080000:3.0:1788576022.695236:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576022.695243:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788576022.695286:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f100 x1875453361335680/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576022.695575:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576022.695579:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788576022.695580:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576022.695585:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4368
00000100:00080000:3.0:1788576022.695589:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576022.695593:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576022.695603:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576022.695616:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ed80 x1875453361335808/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576022.695624:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576022.695626:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788576022.695628:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576022.695632:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4368
00000100:00080000:3.0:1788576022.695635:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576022.695638:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576022.695643:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576022.695653:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644df80 x1875453361335936/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576022.695661:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576022.695664:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788576022.695666:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576022.695669:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4368
00000100:00080000:3.0:1788576022.695672:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576022.695676:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576022.695680:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576022.695690:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644fb80 x1875453361336064/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576022.695697:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576022.695700:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788576022.695702:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576022.695705:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4368
00000100:00080000:3.0:1788576022.695708:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576022.695711:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576022.695715:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576022.695726:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d880 x1875453361336192/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576022.695734:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576022.695737:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788576022.695738:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576022.695741:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4368
00000100:00080000:3.0:1788576022.695744:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576022.695748:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576022.695752:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576022.695761:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e300 x1875453361336320/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576022.695775:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576022.695778:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788576022.695779:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576022.695792:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4368
00000100:00080000:3.0:1788576022.695796:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576022.695800:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576022.695804:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576022.695823:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c700 x1875453361336448/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788576022.695952:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361335680:192.168.202.140@tcp:250:kworker.0
00000800:00000100:1.0:1788576022.696024:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788576022.696071:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576022/real 1788576022]  req@ffff8dc00644f100 x1875453361335680/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576047 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788576022.696088:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f100 x1875453361335680/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576047 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576022.696098:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788576022.696101:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788576022.696105:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361335680:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788576022.696114:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361335808:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788576022.696135:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788576022.696215:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576022/real 1788576022]  req@ffff8dc00644ed80 x1875453361335808/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576047 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788576022.696229:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ed80 x1875453361335808/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576047 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576022.696239:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788576022.696242:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788576022.696245:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361335808:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788576022.696250:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361335936:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788576022.696271:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788576022.696283:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576022/real 1788576022]  req@ffff8dc00644df80 x1875453361335936/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576047 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788576022.696294:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644df80 x1875453361335936/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576047 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576022.696312:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788576022.696316:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788576022.696319:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361335936:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788576022.696324:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361336064:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788576022.696344:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788576022.696355:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576022/real 1788576022]  req@ffff8dc00644fb80 x1875453361336064/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576047 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788576022.696372:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644fb80 x1875453361336064/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576047 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576022.696381:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788576022.696384:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788576022.696387:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361336064:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788576022.696393:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361336192:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788576022.696414:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788576022.696426:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576022/real 1788576022]  req@ffff8dc00644d880 x1875453361336192/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576047 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788576022.696437:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d880 x1875453361336192/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576047 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576022.696446:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788576022.696449:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788576022.696453:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361336192:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788576022.696460:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361336320:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788576022.696483:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788576022.696493:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576022/real 1788576022]  req@ffff8dc00644e300 x1875453361336320/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576047 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788576022.696504:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453361336320/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576047 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576022.696516:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788576022.696520:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788576022.696523:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361336320:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788576022.696528:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361336448:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788576022.696549:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788576022.696560:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576022/real 1788576022]  req@ffff8dc00644c700 x1875453361336448/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576047 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788576022.696572:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453361336448/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576047 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576022.696580:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788576022.696583:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788576022.696586:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361336448:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788576023.075034:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788576023.075061:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788576023.075070:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788576023.075109:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576023.075347:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788576023.075792:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576023.715053:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576024.098999:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788576024.099103:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788576024.099633:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788576024.099941:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788576024.103156:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576024.103203:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788576024.738985:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576025.122986:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576025.122987:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788576025.123032:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788576025.123068:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788576025.123102:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576025.123120:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788576025.763000:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576026.146979:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576026.146995:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788576026.147011:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788576026.148823:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788576026.148890:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788576026.149309:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576026.786995:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576027.170985:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576027.171013:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788576027.171072:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788576027.171072:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788576027.171287:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788576027.171336:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00080000:1.0:1788576027.810959:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576027.810967:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788576027.810971:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788576027.810976:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788576027.810980:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4373
00000100:00080000:1.0:1788576027.810990:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576027.810997:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788576027.811026:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361336576/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788576027.811046:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576027.811050:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788576027.811051:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576027.811055:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4373
00000100:00080000:1.0:1788576027.811058:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576027.811062:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788576027.811071:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576027.811081:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361336576:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788576027.811085:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361336704/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788576027.811093:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576027.811096:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788576027.811097:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576027.811100:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4373
00000100:00080000:1.0:1788576027.811103:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576027.811106:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788576027.811110:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788576027.811119:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361336832/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788576027.811126:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576027.811128:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788576027.811130:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576027.811150:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4373
00000100:00080000:1.0:1788576027.811153:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576027.811156:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788576027.811160:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788576027.811168:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788576027.811170:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361336960/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788576027.811178:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576027.811180:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788576027.811182:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576027.811185:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4373
00000100:00080000:1.0:1788576027.811188:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576027.811191:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788576027.811194:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788576027.811203:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361337088/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788576027.811204:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576027/real 1788576027]  req@ffff8dc005dc1180 x1875453361336576/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576052 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576027.811219:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788576027.811221:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361336576/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576052 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576027.811222:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788576027.811227:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576027.811231:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4373
00000100:00080000:1.0:1788576027.811234:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576027.811237:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788576027.811241:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788576027.811246:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576027.811250:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788576027.811251:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361337216/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788576027.811254:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361336576:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788576027.811259:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576027.811262:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788576027.811263:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576027.811266:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4373
00000100:00080000:1.0:1788576027.811268:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576027.811271:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788576027.811275:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576027.811277:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361336704:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788576027.811283:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361337344/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788576027.811298:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576027.811311:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576027/real 1788576027]  req@ffff8dc005dc3b80 x1875453361336704/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576052 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576027.811323:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361336704/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576052 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576027.811331:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576027.811333:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576027.811335:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361336704:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788576027.811340:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361336832:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788576027.811355:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576027.811362:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576027/real 1788576027]  req@ffff8dc005dc3800 x1875453361336832/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576052 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576027.811368:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361336832/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576052 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576027.811374:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576027.811376:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576027.811377:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361336832:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788576027.811382:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361336960:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788576027.811392:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576027.811397:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576027/real 1788576027]  req@ffff8dc005dc2d80 x1875453361336960/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576052 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576027.811403:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361336960/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576052 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576027.811408:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576027.811410:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576027.811412:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361336960:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788576027.811414:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361337088:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788576027.811423:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576027.811428:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576027/real 1788576027]  req@ffff8dc005dc0700 x1875453361337088/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576052 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576027.811434:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361337088/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576052 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576027.811439:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576027.811441:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576027.811442:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361337088:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788576027.811445:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361337216:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788576027.811454:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576027.811459:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576027/real 1788576027]  req@ffff8dc005dc1c00 x1875453361337216/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576052 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576027.811466:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361337216/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576052 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576027.811470:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576027.811472:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576027.811473:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361337216:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788576027.811484:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361337344:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788576027.811493:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576027.811498:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576027/real 1788576027]  req@ffff8dc005dc0a80 x1875453361337344/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576052 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576027.811504:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361337344/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576052 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576027.811509:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576027.811510:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576027.811512:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361337344:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788576028.194989:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576028.194994:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788576028.195023:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788576028.195141:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788576028.195163:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576028.195245:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788576028.835005:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576029.219048:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788576029.219052:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788576029.219055:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576029.219082:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788576029.219167:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788576029.219188:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788576029.858991:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576030.243011:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788576030.243085:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576030.243163:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788576030.243509:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788576030.244994:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788576030.245112:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788576030.883395:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576031.266971:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788576031.266974:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576031.267002:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788576031.267320:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788576031.267404:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788576031.267539:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576031.906997:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576032.290981:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576032.290990:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788576032.291095:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576032.291109:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788576032.291146:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788576032.293329:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1788576032.931129:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576032.931139:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788576032.931143:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788576032.931228:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788576032.931380:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4378
00000100:00080000:1.0:1788576032.931391:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576032.931399:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788576032.931438:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361337472/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788576032.931462:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576032.931466:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788576032.931468:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576032.931472:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4378
00000100:00080000:1.0:1788576032.931476:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576032.931481:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788576032.931491:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576032.931494:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361337472:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788576032.931507:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361337600/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788576032.931520:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576032.931523:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788576032.931526:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576032.931530:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4378
00000100:00080000:1.0:1788576032.931534:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576032.931538:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788576032.931544:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788576032.931549:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788576032.931559:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361337728/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788576032.931569:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576032.931572:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788576032.931574:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576032.931578:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4378
00000100:00080000:1.0:1788576032.931582:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788576032.931584:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576032/real 1788576032]  req@ffff8dc005dc1500 x1875453361337472/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576057 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576032.931589:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788576032.931599:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576032.931605:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361337472/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576057 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788576032.931614:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361337856/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576032.931614:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576032.931621:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576032.931628:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361337472:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788576032.931640:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576032.931645:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788576032.931647:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576032.931652:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4378
00000100:00080000:1.0:1788576032.931656:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788576032.931661:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361337600:192.168.202.140@tcp:38:kworker.0
00000100:00080000:1.0:1788576032.931662:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788576032.931671:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788576032.931685:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788576032.931687:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361337984/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788576032.931696:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576032/real 1788576032]  req@ffff8dc005dc0a80 x1875453361337600/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576057 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576032.931700:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576032.931706:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788576032.931710:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788576032.931711:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361337600/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576057 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576032.931719:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4378
00000100:00080000:3.0:1788576032.931723:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788576032.931725:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576032.931728:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788576032.931735:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788576032.931735:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361337600:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788576032.931742:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361337728:192.168.202.140@tcp:8:kworker.0
00000008:00100000:1.0:1788576032.931745:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788576032.931759:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788576032.931763:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361338112/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788576032.931770:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576032/real 1788576032]  req@ffff8dc005dc1c00 x1875453361337728/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576057 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576032.931780:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788576032.931784:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361337728/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576057 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576032.931786:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788576032.931790:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576032.931798:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4378
00000100:00080000:1.0:1788576032.931805:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576032.931806:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576032.931812:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00080000:1.0:1788576032.931814:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788576032.931817:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361337728:192.168.202.140@tcp:8:kworker.0
00000008:00100000:1.0:1788576032.931824:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576032.931824:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361337856:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788576032.931844:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361338240/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788576032.931844:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576032.931853:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576032/real 1788576032]  req@ffff8dc005dc0700 x1875453361337856/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576057 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576032.931918:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361337856/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576057 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576032.931928:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576032.931932:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576032.931935:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361337856:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788576032.931947:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361337984:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788576032.931962:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576032.931970:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576032/real 1788576032]  req@ffff8dc005dc2d80 x1875453361337984/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576057 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576032.931981:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361337984/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576057 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576032.931989:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576032.931993:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576032.931996:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361337984:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788576032.932002:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361338112:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788576032.932019:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576032.932029:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576032/real 1788576032]  req@ffff8dc005dc3800 x1875453361338112/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576057 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576032.932040:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361338112/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576057 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576032.932046:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576032.932049:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576032.932052:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361338112:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788576032.932056:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361338240:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788576032.932072:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576032.932081:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576032/real 1788576032]  req@ffff8dc005dc3b80 x1875453361338240/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576057 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576032.932090:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361338240/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576057 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576032.932097:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576032.932100:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576032.932102:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361338240:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788576033.314934:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788576033.314957:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576033.314958:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788576033.314996:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576033.315004:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788576033.315054:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788576033.955024:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576034.339034:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576034.339036:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788576034.339036:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788576034.339097:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788576034.339128:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788576034.339266:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788576034.979011:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576035.363015:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788576035.363015:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576035.363015:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788576035.363015:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788576035.363061:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788576035.365452:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788576036.002997:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576036.387027:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788576036.387028:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576036.387028:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576036.387161:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788576036.387175:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788576036.387247:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576037.027905:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576037.410984:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788576037.410984:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576037.410984:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788576037.411092:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576037.411097:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788576037.411163:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576038.051041:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788576038.051060:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576038.051067:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788576038.051071:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576038.051081:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4383
00000100:00080000:2.0:1788576038.051091:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576038.051098:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788576038.051134:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453361338368/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788576038.051158:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576038.051161:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788576038.051163:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576038.051167:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4383
00000100:00080000:2.0:1788576038.051170:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576038.051174:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788576038.051183:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788576038.051196:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361338496/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788576038.051201:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361338368:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788576038.051224:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576038.051228:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788576038.051230:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576038.051236:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4383
00000100:00080000:2.0:1788576038.051248:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576038.051253:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788576038.051258:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1788576038.051263:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788576038.051271:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361338624/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788576038.051281:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576038.051284:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788576038.051286:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576038.051289:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4383
00000100:00080000:2.0:1788576038.051292:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576038.051295:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788576038.051299:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788576038.051309:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453361338752/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788576038.051316:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576038/real 1788576038]  req@ffff8dc020496a00 x1875453361338368/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576063 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576038.051321:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576038.051328:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788576038.051331:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576038.051337:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4383
00000100:00080000:2.0:1788576038.051340:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788576038.051343:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453361338368/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576063 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576038.051347:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788576038.051355:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788576038.051359:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576038.051365:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788576038.051369:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453361338880/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788576038.051371:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361338368:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788576038.051384:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576038.051387:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788576038.051389:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576038.051394:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4383
00000100:00100000:3.0:1788576038.051397:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361338496:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788576038.051399:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576038.051407:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788576038.051413:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788576038.051426:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453361339008/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788576038.051431:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788576038.051453:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576038.051457:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788576038.051459:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576038.051463:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4383
00000100:00080000:2.0:1788576038.051467:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576038.051471:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788576038.051477:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576038.051477:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576038/real 1788576038]  req@ffff8dc020494000 x1875453361338496/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576063 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788576038.051492:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361339136/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788576038.051494:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361338496/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576063 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576038.051518:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576038.051522:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576038.051525:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361338496:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788576038.051532:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361338624:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788576038.051551:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576038.051560:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576038/real 1788576038]  req@ffff8dc020495880 x1875453361338624/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576063 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576038.051570:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361338624/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576063 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576038.051577:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576038.051579:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576038.051582:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361338624:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788576038.051587:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361338752:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788576038.051602:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576038.051611:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576038/real 1788576038]  req@ffff8dc020494e00 x1875453361338752/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576063 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576038.051620:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453361338752/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576063 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576038.051627:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576038.051630:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576038.051632:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361338752:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788576038.051648:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361338880:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788576038.051665:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576038.051676:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576038/real 1788576038]  req@ffff8dc020494a80 x1875453361338880/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576063 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576038.051692:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453361338880/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576063 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576038.051700:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576038.051703:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576038.051706:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361338880:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788576038.051729:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361339008:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788576038.051747:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576038.051757:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576038/real 1788576038]  req@ffff8dc020496a00 x1875453361339008/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576063 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576038.051766:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453361339008/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576063 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576038.051772:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576038.051775:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576038.051778:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361339008:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788576038.051783:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361339136:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788576038.051800:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576038.051809:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576038/real 1788576038]  req@ffff8dc020494700 x1875453361339136/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576063 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576038.051820:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361339136/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576063 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576038.051831:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576038.051834:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576038.051837:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361339136:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788576038.434981:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788576038.434981:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576038.434981:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788576038.434981:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576038.435012:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788576038.435108:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576039.074978:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576039.458987:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788576039.458987:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788576039.459019:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788576039.459191:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576039.459207:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788576039.459214:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788576040.098982:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576040.482972:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788576040.482972:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788576040.483053:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576040.484131:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576040.484188:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788576040.484226:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576041.122973:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576041.506980:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788576041.506981:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788576041.507019:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576041.507104:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788576041.507135:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788576041.507218:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576042.147026:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576042.530998:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788576042.530999:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788576042.531030:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788576042.531055:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788576042.531056:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788576042.531070:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576043.171024:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788576043.171038:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576043.171060:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788576043.171065:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576043.171078:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4388
00000100:00080000:3.0:1788576043.171091:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576043.171101:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788576043.171169:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e680 x1875453361339264/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576043.171210:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576043.171215:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788576043.171218:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576043.171222:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4388
00000100:00080000:3.0:1788576043.171226:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576043.171230:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576043.171247:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576043.171262:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d180 x1875453361339392/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788576043.171270:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361339264:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788576043.171289:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576043.171292:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788576043.171294:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576043.171300:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4388
00000100:00080000:3.0:1788576043.171304:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576043.171308:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576043.171314:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576043.171326:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f480 x1875453361339520/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576043.171334:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576043.171337:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788576043.171339:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576043.171342:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4388
00000100:00080000:3.0:1788576043.171346:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576043.171350:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576043.171354:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576043.171371:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c380 x1875453361339648/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576043.171380:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576043.171385:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788576043.171386:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576043.171390:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4388
00000100:00080000:3.0:1788576043.171394:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576043.171399:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576043.171404:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576043.171416:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d500 x1875453361339776/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576043.171424:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576043.171427:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788576043.171429:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576043.171434:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4388
00000100:00080000:3.0:1788576043.171437:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576043.171441:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576043.171446:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576043.171455:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ea00 x1875453361339904/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576043.171484:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576043.171488:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788576043.171490:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576043.171494:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4388
00000100:00080000:3.0:1788576043.171497:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576043.171502:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576043.171507:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576043.171518:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ca80 x1875453361340032/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788576043.171522:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788576043.171585:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576043/real 1788576043]  req@ffff8dc00644e680 x1875453361339264/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576068 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788576043.171608:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453361339264/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576068 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576043.171620:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788576043.171625:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788576043.171630:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361339264:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788576043.171657:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361339392:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788576043.171681:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788576043.171695:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576043/real 1788576043]  req@ffff8dc00644d180 x1875453361339392/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576068 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788576043.171707:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453361339392/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576068 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576043.171719:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788576043.171723:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788576043.171726:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361339392:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788576043.171737:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361339520:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788576043.171757:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788576043.171769:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576043/real 1788576043]  req@ffff8dc00644f480 x1875453361339520/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576068 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788576043.171781:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453361339520/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576068 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576043.171790:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788576043.171793:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788576043.171797:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361339520:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788576043.171804:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361339648:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788576043.171822:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788576043.171832:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576043/real 1788576043]  req@ffff8dc00644c380 x1875453361339648/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576068 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788576043.171843:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453361339648/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576068 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576043.171852:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788576043.171855:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788576043.171858:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361339648:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788576043.171864:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361339776:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788576043.171902:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788576043.171913:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576043/real 1788576043]  req@ffff8dc00644d500 x1875453361339776/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576068 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788576043.171924:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d500 x1875453361339776/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576068 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576043.171933:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788576043.171936:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788576043.171939:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361339776:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788576043.171944:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361339904:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788576043.171961:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788576043.171971:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576043/real 1788576043]  req@ffff8dc00644ea00 x1875453361339904/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576068 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788576043.171982:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ea00 x1875453361339904/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576068 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576043.171990:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788576043.171993:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788576043.171996:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361339904:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788576043.172002:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361340032:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788576043.172021:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788576043.172031:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576043/real 1788576043]  req@ffff8dc00644ca80 x1875453361340032/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576068 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788576043.172042:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ca80 x1875453361340032/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576068 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576043.172056:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788576043.172059:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788576043.172062:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361340032:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788576043.555011:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576043.555011:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788576043.555103:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788576043.555179:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788576043.555271:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788576043.555369:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788576044.195015:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576044.579002:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576044.579002:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788576044.579030:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788576044.579101:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576044.579117:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788576044.579119:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576045.219036:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576045.603003:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576045.603004:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576045.603004:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788576045.603150:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788576045.603183:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788576045.603331:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576046.243034:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576046.627011:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576046.627064:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788576046.627148:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788576046.627172:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576046.627622:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788576046.627644:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576047.267014:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576047.650986:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788576047.650986:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788576047.650987:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576047.651107:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576047.651117:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788576047.651458:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1788576048.290976:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788576048.290978:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788576048.290987:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788576048.290992:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576048.291002:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4393
00000100:00080000:3.0:1788576048.291011:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576048.291019:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788576048.291056:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f800 x1875453361340160/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576048.291081:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576048.291084:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788576048.291087:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576048.291091:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4393
00000100:00080000:3.0:1788576048.291095:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576048.291100:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788576048.291108:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361340160:192.168.202.140@tcp:250:kworker.0
00000008:00100000:3.0:1788576048.291110:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576048.291127:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c000 x1875453361340288/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576048.291137:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576048.291141:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788576048.291144:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576048.291148:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4393
00000100:00080000:3.0:1788576048.291152:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576048.291156:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576048.291162:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1788576048.291167:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576048.291178:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644dc00 x1875453361340416/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576048.291189:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576048.291193:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788576048.291195:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576048.291198:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4393
00000100:00080000:3.0:1788576048.291202:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576048.291206:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576048.291210:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788576048.291220:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576048/real 1788576048]  req@ffff8dc00644f800 x1875453361340160/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576073 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576048.291224:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ce00 x1875453361340544/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576048.291238:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576048.291243:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788576048.291246:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576048.291250:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4393
00000100:00080000:3.0:1788576048.291253:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576048.291257:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576048.291261:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788576048.291265:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f800 x1875453361340160/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576073 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576048.291276:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ca80 x1875453361340672/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788576048.291280:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576048.291288:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576048.291293:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788576048.291296:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576048.291298:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:3.0:1788576048.291303:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4393
00000100:00100000:1.0:1788576048.291308:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361340160:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788576048.291309:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576048.291317:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576048.291322:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576048.291334:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ea00 x1875453361340800/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788576048.291345:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361340288:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788576048.291345:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576048.291351:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788576048.291353:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576048.291360:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4393
00000100:00080000:3.0:1788576048.291364:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576048.291367:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576048.291372:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1788576048.291381:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576048.291386:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d500 x1875453361340928/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788576048.291397:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576048/real 1788576048]  req@ffff8dc00644c000 x1875453361340288/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576073 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788576048.291407:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c000 x1875453361340288/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576073 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576048.291415:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788576048.291417:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788576048.291419:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361340288:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788576048.291424:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361340416:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788576048.291448:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788576048.291460:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576048/real 1788576048]  req@ffff8dc00644dc00 x1875453361340416/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576073 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788576048.291471:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644dc00 x1875453361340416/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576073 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576048.291480:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788576048.291498:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788576048.291502:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361340416:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788576048.291508:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361340544:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788576048.291537:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788576048.291551:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576048/real 1788576048]  req@ffff8dc00644ce00 x1875453361340544/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576073 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788576048.291563:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ce00 x1875453361340544/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576073 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576048.291571:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788576048.291574:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788576048.291577:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361340544:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788576048.291582:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361340672:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788576048.291602:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788576048.291613:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576048/real 1788576048]  req@ffff8dc00644ca80 x1875453361340672/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576073 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788576048.291623:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ca80 x1875453361340672/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576073 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576048.291631:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788576048.291634:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788576048.291637:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361340672:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788576048.291654:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361340800:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788576048.291674:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788576048.291694:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576048/real 1788576048]  req@ffff8dc00644ea00 x1875453361340800/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576073 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788576048.291706:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ea00 x1875453361340800/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576073 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576048.291713:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788576048.291716:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788576048.291719:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361340800:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788576048.291725:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361340928:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788576048.291744:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788576048.291755:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576048/real 1788576048]  req@ffff8dc00644d500 x1875453361340928/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576073 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788576048.291766:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d500 x1875453361340928/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576073 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576048.291773:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788576048.291776:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788576048.291779:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361340928:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788576048.674983:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576048.674983:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788576048.675555:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788576048.675571:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576048.675630:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788576048.675664:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788576049.315001:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576049.698973:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576049.698973:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788576049.698973:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576049.698973:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788576049.699009:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788576049.699047:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576050.341047:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576050.722975:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788576050.722991:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576050.723066:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788576050.723094:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788576050.723104:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788576050.723153:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576051.362985:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576051.746981:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788576051.746981:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576051.746987:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788576051.747015:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576051.747016:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788576051.747062:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576052.386976:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576052.770932:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788576052.770938:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788576052.770946:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576052.770954:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576052.770970:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788576052.771019:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576053.410978:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788576053.410980:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576053.410987:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788576053.410991:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576053.411002:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4399
00000100:00080000:2.0:1788576053.411012:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576053.411020:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788576053.411061:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361341056/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788576053.411079:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576053.411082:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788576053.411084:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576053.411087:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4399
00000100:00080000:2.0:1788576053.411091:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576053.411095:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788576053.411106:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788576053.411115:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361341056:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788576053.411120:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361341184/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788576053.411132:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576053.411135:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788576053.411137:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576053.411141:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4399
00000100:00080000:2.0:1788576053.411151:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576053.411155:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788576053.411160:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788576053.411172:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453361341312/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1788576053.411181:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788576053.411186:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576053.411189:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788576053.411190:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576053.411194:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4399
00000100:00080000:2.0:1788576053.411197:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576053.411200:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788576053.411203:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788576053.411214:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453361341440/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788576053.411223:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576053.411226:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788576053.411228:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576053.411232:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4399
00000100:00080000:2.0:1788576053.411236:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1788576053.411249:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576053/real 1788576053]  req@ffff8dc020495180 x1875453361341056/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576078 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576053.411251:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788576053.411263:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788576053.411276:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361341056/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576078 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788576053.411286:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453361341568/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788576053.411288:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788576053.411297:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788576053.411304:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361341056:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788576053.411307:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576053.411312:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788576053.411315:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576053.411320:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4399
00000100:00080000:2.0:1788576053.411323:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576053.411328:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788576053.411332:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361341184:192.168.202.140@tcp:38:kworker.0
00000008:00100000:2.0:1788576053.411333:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788576053.411348:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453361341696/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788576053.411356:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576053.411359:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788576053.411360:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1788576053.411365:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788576053.411366:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4399
00000100:00080000:2.0:1788576053.411373:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576053.411375:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788576053.411379:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788576053.411386:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576053/real 1788576053]  req@ffff8dc020495500 x1875453361341184/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576078 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788576053.411391:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361341824/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788576053.411421:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361341184/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576078 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576053.411431:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788576053.411434:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788576053.411438:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361341184:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788576053.411444:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361341312:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788576053.411466:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788576053.411477:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576053/real 1788576053]  req@ffff8dc020494380 x1875453361341312/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576078 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788576053.411489:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453361341312/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576078 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576053.411512:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788576053.411516:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788576053.411519:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361341312:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788576053.411525:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361341440:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788576053.411543:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788576053.411554:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576053/real 1788576053]  req@ffff8dc020496d80 x1875453361341440/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576078 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788576053.411564:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453361341440/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576078 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576053.411572:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788576053.411575:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788576053.411578:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361341440:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788576053.411583:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361341568:192.168.202.140@tcp:38:kworker.0
00000800:00000100:1.0:1788576053.411600:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788576053.411609:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576053/real 1788576053]  req@ffff8dc020497480 x1875453361341568/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576078 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788576053.411626:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453361341568/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576078 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576053.411634:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788576053.411636:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788576053.411639:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361341568:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788576053.411656:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361341696:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788576053.411673:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788576053.411683:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576053/real 1788576053]  req@ffff8dc020497100 x1875453361341696/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576078 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788576053.411693:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453361341696/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576078 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576053.411699:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788576053.411702:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788576053.411705:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361341696:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788576053.411718:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361341824:192.168.202.140@tcp:8:kworker.0
00000800:00000100:1.0:1788576053.411735:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788576053.411745:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576053/real 1788576053]  req@ffff8dc020495180 x1875453361341824/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576078 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788576053.411755:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361341824/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576078 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576053.411767:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788576053.411769:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788576053.411772:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361341824:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788576053.794989:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576053.794989:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788576053.796291:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576053.796301:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788576053.796313:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788576053.796315:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788576054.434985:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576054.818945:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576054.818950:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788576054.818952:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788576054.818977:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788576054.818979:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788576054.818979:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576055.458991:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576055.842980:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576055.842980:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788576055.842980:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788576055.843063:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788576055.843101:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576055.843183:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788576056.483010:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576056.866981:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576056.866981:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576056.866981:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788576056.867010:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788576056.867013:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788576056.867025:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576057.506941:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576057.890976:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576057.891009:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788576057.891009:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788576057.891119:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788576057.891172:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576057.891248:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00080000:2.0:1788576058.531012:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788576058.531024:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788576058.531025:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788576058.531031:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576058.531043:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4404
00000100:00080000:2.0:1788576058.531058:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576058.531066:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788576058.531109:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361341952/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788576058.531145:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576058.531150:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788576058.531152:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576058.531157:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4404
00000100:00080000:2.0:1788576058.531161:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576058.531166:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788576058.531178:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576058.531181:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361341952:192.168.202.140@tcp:250:kworker.0
00000800:00000100:3.0:1788576058.531277:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788576058.531317:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453361342080/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788576058.531329:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576058.531333:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788576058.531335:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576058.531340:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4404
00000100:00100000:3.0:1788576058.531344:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576058/real 1788576058]  req@ffff8dc020494700 x1875453361341952/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576083 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576058.531346:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576058.531356:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788576058.531364:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576058.531373:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361341952/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576083 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788576058.531380:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453361342208/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576058.531393:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788576058.531395:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576058.531401:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788576058.531403:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788576058.531408:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1788576058.531409:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361341952:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788576058.531417:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4404
00000100:00080000:2.0:1788576058.531421:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576058.531425:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788576058.531431:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788576058.531442:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453361342336/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788576058.531444:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361342080:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788576058.531461:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576058.531465:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788576058.531468:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576058.531474:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4404
00000800:00000100:3.0:1788576058.531478:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788576058.531480:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576058.531487:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788576058.531493:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576058.531495:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576058/real 1788576058]  req@ffff8dc020496a00 x1875453361342080/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576083 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788576058.531523:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361342464/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788576058.531533:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576058.531537:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788576058.531540:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576058.531548:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4404
00000100:00080000:2.0:1788576058.531555:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788576058.531561:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453361342080/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576083 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576058.531562:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788576058.531569:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788576058.531584:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1788576058.531586:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361342592/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576058.531593:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00080000:2.0:1788576058.531602:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576058.531605:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788576058.531607:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576058.531610:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4404
00000100:00080000:2.0:1788576058.531614:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576058.531617:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788576058.531621:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788576058.531629:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361342720/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788576058.531668:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361342080:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788576058.531679:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361342208:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788576058.531702:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576058.531713:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576058/real 1788576058]  req@ffff8dc020494a80 x1875453361342208/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576083 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576058.531725:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453361342208/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576083 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576058.531735:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576058.531738:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576058.531741:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361342208:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788576058.531756:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361342336:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788576058.531773:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576058.531782:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576058/real 1788576058]  req@ffff8dc020494e00 x1875453361342336/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576083 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576058.531793:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453361342336/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576083 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576058.531802:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576058.531805:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576058.531808:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361342336:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788576058.531814:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361342464:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788576058.531828:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576058.531837:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576058/real 1788576058]  req@ffff8dc020495880 x1875453361342464/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576083 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576058.531848:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361342464/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576083 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576058.531857:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576058.531860:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576058.531864:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361342464:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788576058.531899:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361342592:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788576058.531919:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576058.531931:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576058/real 1788576058]  req@ffff8dc020494000 x1875453361342592/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576083 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576058.531943:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361342592/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576083 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576058.531951:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576058.531955:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576058.531958:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361342592:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788576058.531964:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361342720:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788576058.531981:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576058.531990:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576058/real 1788576058]  req@ffff8dc020494700 x1875453361342720/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576083 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576058.532001:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361342720/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576083 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576058.532016:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576058.532019:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576058.532022:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361342720:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788576058.914964:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576058.914964:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576058.914965:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788576058.914995:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788576058.915008:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788576058.915010:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788576059.556390:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576059.938984:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576059.938990:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788576059.939021:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788576059.940622:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788576059.940623:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576059.940630:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788576060.579006:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576060.962978:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576060.962978:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788576060.963042:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576060.963061:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788576060.963062:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576060.963175:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788576061.602966:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576061.986983:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788576061.986983:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788576061.987015:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788576061.987090:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788576061.987132:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576061.987172:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576062.627231:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576063.010998:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788576063.010998:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788576063.011044:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788576063.011046:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576063.011237:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576063.011258:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00080000:1.0:1788576063.650988:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576063.650999:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788576063.651004:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576063.651019:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4409
00000100:00080000:1.0:1788576063.651033:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576063.651039:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788576063.651078:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361342848/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788576063.651110:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576063.651114:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788576063.651116:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576063.651120:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4409
00000100:00080000:1.0:1788576063.651125:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576063.651129:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788576063.651138:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788576063.651154:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361342976/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788576063.651162:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361342848:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788576063.651167:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576063.651171:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788576063.651173:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576063.651178:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4409
00000100:00080000:1.0:1788576063.651181:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576063.651184:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788576063.651189:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788576063.651199:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361343104/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788576063.651238:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576063.651279:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576063/real 1788576063]  req@ffff8dc005dc1180 x1875453361342848/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576088 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576063.651310:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361342848/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576088 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576063.651321:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576063.651325:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576063.651329:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361342848:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788576063.651352:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361342976:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788576063.651373:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576063.651385:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576063/real 1788576063]  req@ffff8dc005dc3b80 x1875453361342976/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576088 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576063.651403:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361342976/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576088 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576063.651413:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576063.651416:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576063.651419:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361342976:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788576063.651579:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788576063.651656:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576063.651661:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788576063.651663:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576063.651681:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4409
00000100:00080000:1.0:1788576063.651686:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788576063.651687:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361343104:192.168.202.140@tcp:8:kworker.0
00000100:00080000:1.0:1788576063.651694:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788576063.651701:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788576063.651718:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361343232/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788576063.651723:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788576063.651735:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576063.651740:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:3.0:1788576063.651742:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576063/real 1788576063]  req@ffff8dc005dc3800 x1875453361343104/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576088 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576063.651743:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576063.651751:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4409
00000100:00080000:1.0:1788576063.651759:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788576063.651765:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361343104/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576088 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576063.651766:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788576063.651774:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788576063.651780:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576063.651786:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788576063.651790:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361343360/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788576063.651793:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361343104:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788576063.651808:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361343232:192.168.202.140@tcp:8:kworker.0
00000100:00080000:1.0:1788576063.651817:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576063.651822:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788576063.651824:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1788576063.651832:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788576063.651841:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4409
00000100:00100000:3.0:1788576063.651846:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576063/real 1788576063]  req@ffff8dc005dc2d80 x1875453361343232/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576088 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576063.651848:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576063.651857:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788576063.651886:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788576063.651897:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361343488/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788576063.651905:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576063.651908:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788576063.651910:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576063.651914:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4409
00000100:00080000:1.0:1788576063.651918:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576063.651922:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788576063.651927:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788576063.651937:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361343616/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788576063.652085:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361343232/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576088 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576063.652100:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576063.652103:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576063.652107:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361343232:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788576063.652120:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361343360:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788576063.652141:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576063.652151:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576063/real 1788576063]  req@ffff8dc005dc0700 x1875453361343360/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576088 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576063.652162:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361343360/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576088 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576063.652170:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576063.652173:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576063.652176:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361343360:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788576063.652182:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361343488:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788576063.652199:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576063.652209:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576063/real 1788576063]  req@ffff8dc005dc1c00 x1875453361343488/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576088 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576063.652219:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361343488/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576088 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576063.652227:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576063.652230:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576063.652233:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361343488:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788576063.652239:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361343616:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788576063.652256:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576063.652265:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576063/real 1788576063]  req@ffff8dc005dc0a80 x1875453361343616/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576088 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576063.652276:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361343616/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576088 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576063.652420:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576063.652426:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576063.652430:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361343616:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788576064.035487:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576064.035535:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576064.035556:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788576064.035615:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788576064.035759:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576064.042600:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788576064.676601:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576065.059021:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788576065.059074:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576065.059087:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788576065.059126:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576065.059194:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788576065.059242:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576065.699062:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576066.083006:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788576066.083009:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788576066.083682:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576066.083745:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576066.083822:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788576066.083931:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576066.723448:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576067.107007:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576067.107017:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788576067.107059:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576067.107905:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788576067.108833:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788576067.109832:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788576067.747038:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576068.130993:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788576068.130993:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788576068.131051:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576068.134691:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576068.134801:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788576068.138002:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00080000:1.0:1788576068.771295:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576068.771314:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788576068.771320:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576068.771337:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4414
00000100:00080000:1.0:1788576068.771352:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576068.771362:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788576068.771423:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361343744/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788576068.771427:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788576068.771464:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576068.771468:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788576068.771470:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576068.771475:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4414
00000100:00080000:1.0:1788576068.771478:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576068.771483:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788576068.771496:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788576068.771512:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361343872/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788576068.771521:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576068.771525:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788576068.771527:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576068.771531:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4414
00000100:00080000:1.0:1788576068.771564:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576068.771568:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788576068.771575:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788576068.771586:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361344000/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788576068.771596:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576068.771599:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788576068.771601:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576068.771604:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4414
00000100:00080000:1.0:1788576068.771607:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576068.771612:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788576068.771616:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788576068.771626:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361344128/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788576068.771634:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576068.771637:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788576068.771639:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576068.771642:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4414
00000100:00080000:1.0:1788576068.771646:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576068.771650:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788576068.771655:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788576068.771665:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361344256/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788576068.771675:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576068.771678:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788576068.771690:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576068.771696:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4414
00000100:00080000:1.0:1788576068.771700:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576068.771704:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788576068.771709:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788576068.771720:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361344384/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788576068.771729:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576068.771732:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788576068.771734:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576068.771737:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4414
00000100:00080000:1.0:1788576068.771740:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576068.771744:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788576068.771749:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788576068.771758:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361344512/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788576068.771903:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361343744:192.168.202.140@tcp:250:kworker.0
00000800:00000100:3.0:1788576068.772001:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576068.772064:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576068/real 1788576068]  req@ffff8dc005dc1500 x1875453361343744/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576093 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576068.772084:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361343744/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576093 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576068.772095:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576068.772099:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576068.772103:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361343744:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788576068.772111:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361343872:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788576068.772137:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576068.772149:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576068/real 1788576068]  req@ffff8dc005dc0a80 x1875453361343872/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576093 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576068.772161:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361343872/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576093 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576068.772172:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576068.772176:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576068.772179:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361343872:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788576068.772185:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361344000:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788576068.772210:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576068.772221:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576068/real 1788576068]  req@ffff8dc005dc1c00 x1875453361344000/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576093 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576068.772232:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361344000/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576093 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576068.772241:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576068.772245:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576068.772248:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361344000:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788576068.772254:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361344128:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788576068.772274:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576068.772286:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576068/real 1788576068]  req@ffff8dc005dc0700 x1875453361344128/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576093 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576068.772304:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361344128/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576093 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576068.772312:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576068.772316:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576068.772319:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361344128:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788576068.772324:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361344256:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788576068.772344:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576068.772355:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576068/real 1788576068]  req@ffff8dc005dc2d80 x1875453361344256/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576093 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576068.772366:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361344256/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576093 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576068.772375:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576068.772378:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576068.772381:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361344256:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788576068.772387:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361344384:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788576068.772407:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576068.772417:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576068/real 1788576068]  req@ffff8dc005dc3800 x1875453361344384/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576093 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576068.772428:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361344384/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576093 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576068.772441:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576068.772445:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576068.772448:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361344384:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788576068.772453:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361344512:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788576068.772475:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576068.772487:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576068/real 1788576068]  req@ffff8dc005dc3b80 x1875453361344512/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576093 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576068.772498:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361344512/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576093 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576068.772506:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576068.772509:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576068.772512:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361344512:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788576069.155009:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788576069.155050:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576069.155132:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576069.155225:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788576069.155276:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788576069.155321:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788576069.795053:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576070.179030:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576070.179030:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788576070.179132:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576070.179205:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788576070.179215:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788576070.179436:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788576070.819095:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576071.203007:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576071.203908:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788576071.204414:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788576071.204528:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788576071.206241:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788576071.206914:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788576071.844249:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576072.226975:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576072.226975:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788576072.226981:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788576072.227019:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576072.227021:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576072.227022:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788576072.867003:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576073.251015:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788576073.251018:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576073.251056:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788576073.251059:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788576073.251077:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576073.251079:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788576073.891035:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788576073.891168:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576073.891175:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788576073.891180:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576073.891192:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4419
00000100:00080000:2.0:1788576073.891206:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576073.891215:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788576073.891265:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361344640/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788576073.891297:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576073.891301:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788576073.891303:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576073.891307:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4419
00000100:00080000:2.0:1788576073.891311:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576073.891316:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788576073.891356:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361344640:192.168.202.140@tcp:250:kworker.0
00000008:00100000:2.0:1788576073.891386:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788576073.891408:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453361344768/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788576073.891420:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576073.891425:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788576073.891427:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1788576073.891433:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788576073.891434:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4419
00000100:00080000:2.0:1788576073.891444:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576073.891450:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788576073.891457:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576073.891476:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576073/real 1788576073]  req@ffff8dc020495180 x1875453361344640/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576098 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576073.891491:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361344640/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576098 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576073.891499:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576073.891502:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576073.891505:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361344640:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788576073.891523:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361344768:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788576073.891538:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453361344896/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788576073.891544:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576073.891576:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576073/real 1788576073]  req@ffff8dc020497100 x1875453361344768/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576098 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576073.891584:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576073.891589:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:3.0:1788576073.891594:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453361344768/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576098 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576073.891595:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576073.891606:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4419
00000100:00080000:2.0:1788576073.891616:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576073.891624:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:3.0:1788576073.891627:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:2.0:1788576073.891632:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1788576073.891634:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576073.891646:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361344768:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788576073.891653:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453361345024/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788576073.891662:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361344896:192.168.202.140@tcp:8:kworker.0
00000100:00080000:2.0:1788576073.891680:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576073.891687:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788576073.891689:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576073.891698:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4419
00000800:00000100:3.0:1788576073.891698:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:2.0:1788576073.891710:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788576073.891716:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576073/real 1788576073]  req@ffff8dc020497480 x1875453361344896/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576098 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576073.891721:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788576073.891738:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576073.891742:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453361344896/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576098 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576073.891750:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576073.891753:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576073.891755:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361344896:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788576073.891762:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361345024:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788576073.891774:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576073.891780:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576073/real 1788576073]  req@ffff8dc020496d80 x1875453361345024/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576098 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576073.891786:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453361345024/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576098 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576073.891792:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576073.891793:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576073.891795:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361345024:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788576073.892037:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453361345152/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788576073.892065:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576073.892070:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788576073.892072:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576073.892076:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4419
00000100:00080000:2.0:1788576073.892083:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576073.892087:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788576073.892094:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788576073.892108:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361345280/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788576073.892117:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576073.892120:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788576073.892122:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576073.892126:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4419
00000100:00080000:2.0:1788576073.892129:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576073.892133:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788576073.892138:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788576073.892149:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453361345408/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788576073.892436:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361345152:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788576073.892573:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576073.892599:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576073/real 1788576073]  req@ffff8dc020494380 x1875453361345152/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576098 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576073.892615:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453361345152/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576098 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576073.892626:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576073.892630:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576073.892634:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361345152:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788576073.892641:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361345280:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788576073.892663:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576073.892673:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576073/real 1788576073]  req@ffff8dc020495500 x1875453361345280/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576098 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576073.892685:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361345280/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576098 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576073.892693:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576073.892696:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576073.892699:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361345280:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788576073.892705:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361345408:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788576073.892725:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576073.892735:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576073/real 1788576073]  req@ffff8dc020496d80 x1875453361345408/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576098 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576073.892758:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453361345408/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576098 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576073.892766:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576073.892769:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576073.892772:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361345408:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788576074.275062:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788576074.275088:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788576074.275117:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788576074.275129:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788576074.275140:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576074.275252:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788576074.915014:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576075.299061:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788576075.299063:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576075.299064:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788576075.299105:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788576075.299135:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788576075.299161:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576075.938992:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576076.323030:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788576076.323067:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788576076.323070:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576076.323072:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576076.323095:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788576076.323156:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576076.963011:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576077.347001:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576077.347004:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576077.347048:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788576077.347067:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788576077.347199:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788576077.347359:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788576077.989850:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576078.371000:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788576078.371000:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788576078.371951:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788576078.372273:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788576078.372273:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788576078.372604:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00080000:1.0:1788576079.012376:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576079.012385:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788576079.012388:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576079.012398:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4424
00000100:00080000:1.0:1788576079.012408:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576079.012414:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788576079.012451:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361345536/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788576079.012485:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576079.012488:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788576079.012490:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576079.012494:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4424
00000100:00080000:1.0:1788576079.012497:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576079.012501:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788576079.012511:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788576079.012528:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361345664/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788576079.012537:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576079.012540:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788576079.012541:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576079.012545:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4424
00000100:00080000:1.0:1788576079.012549:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576079.012552:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788576079.012557:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788576079.012582:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361345792/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788576079.012591:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576079.012594:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788576079.012596:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576079.012599:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4424
00000100:00080000:1.0:1788576079.012603:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576079.012606:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788576079.012611:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788576079.012621:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361345920/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788576079.012630:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576079.012633:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788576079.012635:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576079.012639:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4424
00000100:00080000:1.0:1788576079.012642:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576079.012646:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788576079.012650:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788576079.012661:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361346048/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788576079.012670:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576079.012673:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788576079.012674:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576079.012678:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4424
00000100:00080000:1.0:1788576079.012681:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576079.012684:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788576079.012689:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788576079.012697:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361346176/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788576079.012706:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576079.012708:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788576079.012710:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576079.012713:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4424
00000100:00080000:1.0:1788576079.012716:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576079.012720:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788576079.012724:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788576079.012733:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361346304/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788576079.012832:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576079.012914:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361345536:192.168.202.140@tcp:250:kworker.0
00000800:00000100:3.0:1788576079.012979:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576079.013020:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576079/real 1788576079]  req@ffff8dc005dc1180 x1875453361345536/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576104 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576079.013050:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361345536/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576104 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576079.013060:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576079.013064:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576079.013068:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361345536:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788576079.013074:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361345664:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788576079.013097:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576079.013109:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576079/real 1788576079]  req@ffff8dc005dc3b80 x1875453361345664/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576104 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576079.013120:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361345664/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576104 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576079.013130:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576079.013133:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576079.013136:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361345664:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788576079.013142:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361345792:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788576079.013163:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576079.013174:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576079/real 1788576079]  req@ffff8dc005dc3800 x1875453361345792/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576104 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576079.013185:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361345792/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576104 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576079.013198:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576079.013202:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576079.013204:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361345792:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788576079.013209:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361345920:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788576079.013227:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576079.013238:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576079/real 1788576079]  req@ffff8dc005dc2d80 x1875453361345920/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576104 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576079.013249:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361345920/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576104 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576079.013258:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576079.013261:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576079.013264:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361345920:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788576079.013270:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361346048:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788576079.013288:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576079.013299:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576079/real 1788576079]  req@ffff8dc005dc0700 x1875453361346048/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576104 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576079.013310:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361346048/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576104 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576079.013319:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576079.013322:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576079.013325:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361346048:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788576079.013331:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361346176:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788576079.013350:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576079.013360:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576079/real 1788576079]  req@ffff8dc005dc1c00 x1875453361346176/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576104 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576079.013371:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361346176/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576104 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576079.013378:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576079.013380:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576079.013383:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361346176:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788576079.013388:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361346304:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788576079.013406:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576079.013416:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576079/real 1788576079]  req@ffff8dc005dc0a80 x1875453361346304/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576104 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576079.013427:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361346304/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576104 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576079.013433:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576079.013436:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576079.013439:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361346304:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788576079.395018:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788576079.395018:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576079.395043:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788576079.395047:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788576079.395056:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788576079.395087:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788576080.035027:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576080.419006:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576080.419108:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788576080.419190:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576080.419237:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788576080.419303:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788576080.419395:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788576081.059001:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576081.443158:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788576081.443246:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576081.443293:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788576081.443378:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788576081.443459:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788576081.443503:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788576082.083827:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576082.466994:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576082.466995:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788576082.467101:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788576082.467161:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576082.467167:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788576082.467652:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788576083.106995:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576083.490955:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788576083.490962:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576083.490979:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788576083.490985:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788576083.490989:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788576083.491034:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788576084.131016:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788576084.131908:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576084.131914:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788576084.131918:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576084.131927:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4429
00000100:00080000:3.0:1788576084.131938:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576084.131946:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788576084.131986:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c380 x1875453361346432/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576084.132017:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576084.132021:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788576084.132022:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576084.132027:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4429
00000100:00080000:3.0:1788576084.132030:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576084.132033:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576084.132043:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576084.132057:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f480 x1875453361346560/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576084.132065:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576084.132067:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788576084.132069:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576084.132072:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4429
00000100:00080000:3.0:1788576084.132076:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576084.132079:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576084.132085:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576084.132095:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d180 x1875453361346688/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576084.132103:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576084.132106:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788576084.132108:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576084.132111:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4429
00000100:00080000:3.0:1788576084.132114:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576084.132118:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576084.132122:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576084.132131:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e680 x1875453361346816/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576084.132139:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576084.132141:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788576084.132143:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576084.132146:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4429
00000100:00080000:3.0:1788576084.132149:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576084.132152:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576084.132155:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576084.132164:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c700 x1875453361346944/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576084.132171:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576084.132174:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788576084.132176:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576084.132180:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4429
00000100:00080000:3.0:1788576084.132183:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576084.132187:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576084.132191:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576084.132200:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e300 x1875453361347072/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576084.132208:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576084.132211:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788576084.132212:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576084.132215:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4429
00000100:00080000:3.0:1788576084.132218:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576084.132221:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576084.132225:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576084.132234:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d880 x1875453361347200/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788576084.132306:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361346432:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788576084.132400:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361346560:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788576084.132425:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361346688:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788576084.132441:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361346816:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788576084.132456:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361346944:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788576084.132472:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361347072:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788576084.132488:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361347200:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788576084.514981:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788576084.515017:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788576084.515022:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788576084.515160:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576084.516933:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576084.520969:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788576085.155145:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576085.538958:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576085.538977:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788576085.539554:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788576085.539912:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788576085.539946:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788576085.542003:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788576086.179123:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576086.562962:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788576086.563068:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788576086.563175:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788576086.563180:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576086.563882:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788576086.563898:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000400:00000100:2.0:1788576087.204728:0:2337:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.140:988
00000400:00000100:2.0:1788576087.204773:0:2337:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.140@tcp at host 192.168.202.140 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:2.0:1788576087.204791:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:2.0:1788576087.204837:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:2.0:1788576087.204847:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:2.0:1788576087.204856:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:2.0:1788576087.204864:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:3.0:1788576087.206034:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000800:00000100:2.0:1788576087.206624:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:2.0:1788576087.206634:0:2337:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:1.0:1788576087.207994:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576084/real 1788576087]  req@ffff8dc00644c380 x1875453361346432/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576109 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788576087.208037:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453361346432/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576109 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576087.208048:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788576087.208052:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788576087.208056:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361346432:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788576087.208063:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576084/real 1788576087]  req@ffff8dc00644f480 x1875453361346560/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576109 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788576087.208075:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453361346560/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576109 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576087.208084:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788576087.208087:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788576087.208090:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361346560:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788576087.208096:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576084/real 1788576087]  req@ffff8dc00644d180 x1875453361346688/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576109 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788576087.208106:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453361346688/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576109 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576087.208113:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788576087.208116:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788576087.208119:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361346688:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788576087.208125:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576084/real 1788576087]  req@ffff8dc00644e680 x1875453361346816/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576109 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788576087.208136:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453361346816/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576109 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576087.208144:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788576087.208147:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788576087.208149:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361346816:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788576087.208155:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576084/real 1788576087]  req@ffff8dc00644c700 x1875453361346944/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576109 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788576087.208165:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453361346944/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576109 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576087.208172:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788576087.208175:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788576087.208178:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361346944:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788576087.208184:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576084/real 1788576087]  req@ffff8dc00644e300 x1875453361347072/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576109 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788576087.208195:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453361347072/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576109 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576087.208202:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788576087.208206:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788576087.208209:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361347072:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788576087.208215:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576084/real 1788576087]  req@ffff8dc00644d880 x1875453361347200/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576109 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788576087.208227:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d880 x1875453361347200/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576109 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1788576087.208234:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1788576087.208237:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:1.0:1788576087.208240:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361347200:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788576087.586974:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788576087.587028:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788576087.587076:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788576087.587086:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788576087.587141:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576087.588258:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576088.227171:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576088.610978:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576088.610978:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788576088.611075:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576088.611140:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788576088.615923:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:0.0:1788576088.615978:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788576089.251016:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:1.0:1788576089.251151:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576089.251158:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788576089.251162:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576089.251171:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4434
00000100:00080000:1.0:1788576089.251181:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576089.251188:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788576089.251226:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361347328/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788576089.251286:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361347328:192.168.202.140@tcp:250:kworker.0
00000800:00000100:3.0:1788576089.251356:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788576089.251382:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576089.251385:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788576089.251387:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576089.251391:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4434
00000100:00080000:1.0:1788576089.251394:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576089.251398:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788576089.251407:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788576089.251420:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361347456/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788576089.251775:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576089/real 1788576089]  req@ffff8dc005dc1500 x1875453361347328/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576114 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576089.251792:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361347328/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576114 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576089.251801:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576089.251805:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576089.251809:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361347328:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788576089.251832:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361347456:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788576089.251850:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788576089.252005:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576089.252009:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788576089.252010:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576089.252014:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4434
00000100:00080000:1.0:1788576089.252017:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576089.252020:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788576089.252025:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788576089.252034:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361347584/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788576089.252041:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576089.252043:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788576089.252044:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576089.252046:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4434
00000100:00080000:1.0:1788576089.252048:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576089.252049:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788576089.252052:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788576089.252057:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361347712/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788576089.252062:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576089.252063:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788576089.252065:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576089.252067:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4434
00000100:00080000:1.0:1788576089.252069:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576089.252072:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788576089.252074:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788576089.252079:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361347840/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788576089.252084:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576089.252086:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788576089.252086:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576089.252089:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4434
00000100:00080000:1.0:1788576089.252091:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576089.252093:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788576089.252095:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788576089.252100:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361347968/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788576089.252105:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576089.252107:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788576089.252107:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576089.252109:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4434
00000100:00080000:1.0:1788576089.252111:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576089.252113:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788576089.252116:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788576089.252126:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361348096/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788576089.253446:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576089/real 1788576089]  req@ffff8dc005dc0a80 x1875453361347456/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576114 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576089.253469:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361347456/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576114 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576089.253482:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576089.253487:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576089.253491:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361347456:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788576089.253520:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361347584:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788576089.253568:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576089.253583:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576089/real 1788576089]  req@ffff8dc005dc1c00 x1875453361347584/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576114 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576089.254138:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361347584/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576114 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576089.254147:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576089.254151:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576089.254154:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361347584:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788576089.254161:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361347712:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788576089.254186:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576089.254199:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576089/real 1788576089]  req@ffff8dc005dc0700 x1875453361347712/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576114 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576089.254298:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361347712/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576114 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576089.254307:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576089.254310:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576089.254380:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361347712:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788576089.254388:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361347840:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788576089.254413:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576089.254425:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576089/real 1788576089]  req@ffff8dc005dc2d80 x1875453361347840/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576114 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576089.254435:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361347840/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576114 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576089.254447:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576089.254450:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576089.254453:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361347840:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788576089.254459:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361347968:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788576089.254479:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576089.254489:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576089/real 1788576089]  req@ffff8dc005dc3800 x1875453361347968/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576114 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576089.254500:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361347968/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576114 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576089.254507:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576089.254510:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576089.254513:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361347968:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788576089.254520:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361348096:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788576089.254539:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576089.254549:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576089/real 1788576089]  req@ffff8dc005dc3b80 x1875453361348096/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576114 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576089.254560:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361348096/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576114 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576089.254567:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576089.254569:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576089.254572:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361348096:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788576089.634983:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788576089.635013:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788576089.636253:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788576089.636464:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788576089.636626:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576089.636690:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788576090.275034:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576090.659007:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788576090.659681:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576090.659714:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788576090.660555:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576090.660659:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576090.660751:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788576091.299506:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576091.682983:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576091.683083:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788576091.683165:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788576091.683202:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576091.683429:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788576091.683454:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576092.323037:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576092.707016:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788576092.707106:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788576092.707366:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576092.707462:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788576092.707543:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576092.707588:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576093.347649:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576093.731005:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788576093.731153:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788576093.731190:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788576093.731675:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576093.731722:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788576093.731751:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788576094.370984:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788576094.371299:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576094.371304:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788576094.371308:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576094.371321:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4440
00000100:00080000:3.0:1788576094.371331:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576094.371338:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788576094.371377:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644fb80 x1875453361348224/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576094.371403:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576094.371406:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788576094.371407:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576094.371411:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4440
00000100:00080000:3.0:1788576094.371414:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576094.371418:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576094.371427:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576094.371439:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644df80 x1875453361348352/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576094.371448:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576094.371451:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788576094.371453:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1788576094.371455:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361348224:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788576094.371456:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4440
00000100:00080000:3.0:1788576094.371459:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576094.371462:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576094.371466:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576094.371474:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ed80 x1875453361348480/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576094.371482:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576094.371485:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788576094.371486:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576094.371489:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4440
00000100:00080000:3.0:1788576094.371491:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576094.371494:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576094.371497:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576094.371505:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f100 x1875453361348608/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1788576094.371510:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788576094.371513:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576094.371517:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788576094.371518:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576094.371521:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4440
00000100:00080000:3.0:1788576094.371523:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576094.371527:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576094.371531:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576094.371539:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d880 x1875453361348736/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788576094.371542:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576094/real 1788576094]  req@ffff8dc00644fb80 x1875453361348224/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576119 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576094.371547:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576094.371550:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788576094.371551:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576094.371555:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4440
00000100:00100000:0.0:1788576094.371557:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644fb80 x1875453361348224/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576119 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576094.371558:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576094.371561:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576094.371564:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1788576094.371567:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788576094.371571:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576094.371572:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e300 x1875453361348864/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788576094.371575:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361348224:192.168.202.140@tcp:250:kworker.0
00000100:00080000:3.0:1788576094.371580:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788576094.371582:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361348352:192.168.202.140@tcp:38:kworker.0
00000100:00080000:3.0:1788576094.371583:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788576094.371584:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576094.371587:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4440
00000100:00080000:3.0:1788576094.371589:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576094.371592:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576094.371596:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1788576094.371613:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576094.371616:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c700 x1875453361348992/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788576094.371624:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576094/real 1788576094]  req@ffff8dc00644df80 x1875453361348352/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576119 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788576094.371634:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644df80 x1875453361348352/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576119 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788576094.371654:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788576094.371657:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788576094.371659:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361348352:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788576094.371679:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361348480:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788576094.371698:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788576094.371708:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576094/real 1788576094]  req@ffff8dc00644ed80 x1875453361348480/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576119 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788576094.371717:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ed80 x1875453361348480/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576119 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788576094.371725:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788576094.371727:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788576094.371730:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361348480:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788576094.371735:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361348608:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788576094.371752:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788576094.371763:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576094/real 1788576094]  req@ffff8dc00644f100 x1875453361348608/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576119 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788576094.371773:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f100 x1875453361348608/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576119 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788576094.371782:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788576094.371784:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788576094.371787:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361348608:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788576094.371792:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361348736:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788576094.371821:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788576094.371832:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576094/real 1788576094]  req@ffff8dc00644d880 x1875453361348736/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576119 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788576094.371842:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d880 x1875453361348736/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576119 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788576094.371850:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788576094.371852:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788576094.371855:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361348736:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788576094.371860:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361348864:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788576094.372049:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788576094.372067:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576094/real 1788576094]  req@ffff8dc00644e300 x1875453361348864/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576119 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788576094.372079:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453361348864/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576119 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788576094.372088:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788576094.372091:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788576094.372094:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361348864:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788576094.372100:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361348992:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788576094.372119:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788576094.372128:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576094/real 1788576094]  req@ffff8dc00644c700 x1875453361348992/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576119 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788576094.372138:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453361348992/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576119 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788576094.372145:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788576094.372149:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788576094.372152:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361348992:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788576094.755051:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788576094.755138:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576094.755197:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576094.755206:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788576094.755641:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788576094.757997:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576095.395039:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576095.778981:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576095.779470:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788576095.779558:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788576095.779683:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788576095.784061:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576095.784376:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788576096.418993:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576096.803003:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576096.803168:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788576096.803227:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788576096.808779:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788576096.809224:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788576096.809297:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576097.442983:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576097.826999:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788576097.826999:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576097.827655:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576097.829372:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788576097.829462:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788576097.830014:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576098.469599:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576098.850981:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788576098.851088:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788576098.851142:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788576098.851164:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788576098.851562:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788576098.851653:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576099.491007:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788576099.491027:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788576099.491033:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788576099.491037:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788576099.491046:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4445
00000100:00080000:0.0:1788576099.491056:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788576099.491063:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788576099.491097:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361349120/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788576099.491157:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361349120:192.168.202.140@tcp:250:kworker.0
00000800:00000100:3.0:1788576099.491227:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788576099.491255:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788576099.491258:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788576099.491260:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788576099.491264:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4445
00000100:00080000:0.0:1788576099.491268:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788576099.491272:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788576099.491281:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788576099.491293:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361349248/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788576099.493270:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576099/real 1788576099]  req@ffff8dc006713b80 x1875453361349120/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576124 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576099.493295:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361349120/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576124 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576099.493306:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576099.493310:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576099.493313:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361349120:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788576099.493341:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361349248:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788576099.493387:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576099.494677:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576099/real 1788576099]  req@ffff8dc006710e00 x1875453361349248/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576124 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576099.494694:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361349248/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576124 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576099.494705:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576099.494709:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576099.494713:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361349248:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788576099.494809:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788576099.494814:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788576099.494816:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788576099.494821:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4445
00000100:00080000:0.0:1788576099.494827:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788576099.494833:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788576099.494842:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788576099.494878:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361349376/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788576099.494897:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788576099.494900:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788576099.494902:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788576099.494905:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4445
00000100:00080000:0.0:1788576099.494908:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788576099.494911:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788576099.494916:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788576099.494925:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361349504/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788576099.494933:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788576099.494936:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788576099.494938:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788576099.494941:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4445
00000100:00080000:0.0:1788576099.494944:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788576099.494947:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788576099.494951:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788576099.494959:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361349632/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788576099.494967:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788576099.494970:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788576099.494972:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788576099.494975:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4445
00000100:00080000:0.0:1788576099.494977:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788576099.494981:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788576099.494985:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788576099.494992:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361349760/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788576099.495000:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788576099.495003:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788576099.495005:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788576099.495007:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4445
00000100:00080000:0.0:1788576099.495010:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788576099.495012:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788576099.495016:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788576099.495024:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361349888/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788576099.495482:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361349376:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788576099.495523:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576099.495536:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576099/real 1788576099]  req@ffff8dc006712680 x1875453361349376/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576124 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576099.495548:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361349376/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576124 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576099.495556:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576099.495559:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576099.495563:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361349376:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788576099.495569:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361349504:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788576099.495585:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576099.495593:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576099/real 1788576099]  req@ffff8dc006711500 x1875453361349504/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576124 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576099.495604:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361349504/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576124 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576099.495623:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576099.495625:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576099.495628:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361349504:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788576099.495634:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361349632:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788576099.495654:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576099.495664:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576099/real 1788576099]  req@ffff8dc006711880 x1875453361349632/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576124 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576099.495681:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361349632/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576124 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576099.495689:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576099.495692:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576099.495695:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361349632:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788576099.495701:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361349760:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788576099.495716:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576099.495724:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576099/real 1788576099]  req@ffff8dc006713100 x1875453361349760/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576124 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576099.495735:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361349760/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576124 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576099.495742:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576099.495745:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576099.495748:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361349760:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788576099.495753:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361349888:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788576099.495766:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576099.495774:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576099/real 1788576099]  req@ffff8dc006710e00 x1875453361349888/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576124 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576099.495784:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361349888/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576124 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576099.495797:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576099.495799:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576099.495802:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361349888:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788576099.875024:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576099.875074:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788576099.875188:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576099.875231:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788576099.875343:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788576099.875391:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788576100.514988:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576100.898979:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788576100.898979:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788576100.899072:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576100.899100:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576100.899420:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:1.0:1788576100.899653:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576101.538987:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576101.922990:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576101.922990:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788576101.923100:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788576101.923207:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788576101.923310:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788576101.924671:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788576102.562979:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576102.947017:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788576102.947168:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788576102.947279:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788576102.948473:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788576102.949217:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576102.949751:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788576103.586971:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576103.971058:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788576103.971156:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788576103.971168:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788576103.971214:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788576103.971304:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576103.971355:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00080000:0.0:1788576104.611144:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788576104.611156:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788576104.611160:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788576104.611170:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4450
00000100:00080000:0.0:1788576104.611181:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788576104.611188:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788576104.611225:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361350016/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788576104.611257:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788576104.611261:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788576104.611263:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788576104.611266:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4450
00000100:00080000:0.0:1788576104.611270:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788576104.611274:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788576104.611284:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788576104.611296:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361350144/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788576104.611305:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788576104.611308:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788576104.611310:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788576104.611314:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4450
00000100:00080000:0.0:1788576104.611317:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788576104.611321:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788576104.611325:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788576104.611335:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361350272/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788576104.611345:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788576104.611348:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788576104.611349:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788576104.611353:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4450
00000100:00080000:0.0:1788576104.611355:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788576104.611359:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788576104.611363:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788576104.611372:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453361350400/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788576104.611379:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788576104.611382:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788576104.611384:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788576104.611388:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4450
00000100:00080000:0.0:1788576104.611391:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788576104.611395:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788576104.611399:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576104.611414:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361350016:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788576104.611422:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361350528/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788576104.611433:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788576104.611436:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788576104.611439:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788576104.611443:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4450
00000100:00080000:0.0:1788576104.611447:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788576104.611452:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788576104.611457:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788576104.611468:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361350656/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788576104.611478:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1788576104.611482:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788576104.611484:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788576104.611487:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788576104.611492:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4450
00000100:00080000:0.0:1788576104.611496:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788576104.611500:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788576104.611505:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788576104.611517:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361350784/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788576104.611528:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576104/real 1788576104]  req@ffff8dc006713b80 x1875453361350016/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576129 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576104.611548:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361350016/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576129 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576104.611559:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576104.611563:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576104.611566:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361350016:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788576104.611573:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361350144:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788576104.611594:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576104.611606:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576104/real 1788576104]  req@ffff8dc006713800 x1875453361350144/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576129 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576104.611622:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361350144/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576129 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576104.611644:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576104.611647:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576104.611650:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361350144:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788576104.611656:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361350272:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788576104.611678:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576104.611688:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576104/real 1788576104]  req@ffff8dc006712300 x1875453361350272/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576129 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576104.611699:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361350272/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576129 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576104.611707:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576104.611710:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576104.611712:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361350272:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788576104.611718:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361350400:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788576104.611736:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576104.611746:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576104/real 1788576104]  req@ffff8dc006710380 x1875453361350400/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576129 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576104.611757:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453361350400/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576129 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576104.611770:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576104.611772:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576104.611775:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361350400:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788576104.611799:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361350528:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788576104.611817:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576104.611826:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576104/real 1788576104]  req@ffff8dc006711c00 x1875453361350528/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576129 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576104.611836:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361350528/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576129 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576104.611845:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576104.611848:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576104.611851:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361350528:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788576104.611858:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361350656:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788576104.611904:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576104.611915:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576104/real 1788576104]  req@ffff8dc006713480 x1875453361350656/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576129 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576104.611926:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361350656/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576129 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576104.611933:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576104.611936:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576104.611939:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361350656:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788576104.611944:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361350784:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788576104.611960:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576104.611969:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576104/real 1788576104]  req@ffff8dc006712a00 x1875453361350784/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576129 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576104.611980:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361350784/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576129 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576104.611987:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576104.611990:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576104.611993:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361350784:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788576104.612760:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576104.995133:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788576104.995746:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576104.996075:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788576104.996202:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788576104.998157:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788576104.998245:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788576105.634999:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576106.019018:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576106.019168:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788576106.019232:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576106.021217:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788576106.021279:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788576106.021438:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788576106.659006:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576107.043030:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788576107.043037:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576107.043119:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788576107.043147:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788576107.043197:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576107.043217:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576107.683778:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576108.067005:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576108.068006:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788576108.068009:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788576108.071781:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788576108.071807:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788576108.071849:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576108.706980:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576109.091009:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788576109.091167:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576109.091233:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788576109.091519:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788576109.091563:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788576109.092370:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00080000:3.0:1788576109.731268:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576109.731280:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788576109.731285:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576109.731295:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4455
00000100:00080000:3.0:1788576109.731306:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576109.731313:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788576109.731350:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e680 x1875453361350912/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576109.731379:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576109.731383:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788576109.731385:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576109.731396:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4455
00000100:00080000:3.0:1788576109.731400:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576109.731404:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576109.731414:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576109.731428:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d180 x1875453361351040/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576109.731437:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576109.731440:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788576109.731441:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576109.731446:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4455
00000100:00080000:3.0:1788576109.731449:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576109.731452:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576109.731457:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576109.731467:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f480 x1875453361351168/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576109.731475:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576109.731478:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788576109.731480:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576109.731484:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4455
00000100:00080000:3.0:1788576109.731488:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576109.731492:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576109.731496:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576109.731509:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c380 x1875453361351296/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576109.731524:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576109.731527:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788576109.731529:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576109.731533:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4455
00000100:00080000:3.0:1788576109.731537:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576109.731541:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576109.731546:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576109.731557:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d500 x1875453361351424/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576109.731565:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576109.731569:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788576109.731571:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576109.731575:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4455
00000100:00080000:3.0:1788576109.731579:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576109.731583:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576109.731587:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576109.731595:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ea00 x1875453361351552/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576109.731604:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1788576109.731607:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788576109.731607:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788576109.731610:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576109.731615:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4455
00000100:00080000:3.0:1788576109.731619:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576109.731623:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576109.731628:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576109.731670:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ca80 x1875453361351680/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788576109.731858:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361350912:192.168.202.140@tcp:250:kworker.0
00000800:00000100:0.0:1788576109.731934:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788576109.731970:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576109/real 1788576109]  req@ffff8dc00644e680 x1875453361350912/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576134 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788576109.731985:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453361350912/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576134 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788576109.731995:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788576109.731998:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788576109.732002:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361350912:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788576109.732009:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361351040:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788576109.732033:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788576109.732045:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576109/real 1788576109]  req@ffff8dc00644d180 x1875453361351040/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576134 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788576109.732056:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453361351040/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576134 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788576109.732066:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788576109.732069:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788576109.732072:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361351040:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788576109.732078:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361351168:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788576109.732098:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788576109.732109:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576109/real 1788576109]  req@ffff8dc00644f480 x1875453361351168/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576134 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788576109.732126:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453361351168/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576134 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788576109.732134:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788576109.732137:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788576109.732140:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361351168:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788576109.732146:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361351296:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788576109.732165:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788576109.732176:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576109/real 1788576109]  req@ffff8dc00644c380 x1875453361351296/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576134 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788576109.732188:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453361351296/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576134 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788576109.732197:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788576109.732200:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788576109.732203:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361351296:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788576109.732209:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361351424:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788576109.732227:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788576109.732237:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576109/real 1788576109]  req@ffff8dc00644d500 x1875453361351424/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576134 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788576109.732263:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d500 x1875453361351424/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576134 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788576109.732279:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788576109.732282:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788576109.732285:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361351424:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788576109.732291:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361351552:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788576109.732309:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788576109.732320:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576109/real 1788576109]  req@ffff8dc00644ea00 x1875453361351552/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576134 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788576109.732329:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ea00 x1875453361351552/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576134 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788576109.732337:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788576109.732339:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788576109.732342:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361351552:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788576109.732348:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361351680:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788576109.732363:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788576109.732372:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576109/real 1788576109]  req@ffff8dc00644ca80 x1875453361351680/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576134 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788576109.732383:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ca80 x1875453361351680/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576134 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788576109.732400:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788576109.732404:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788576109.732407:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361351680:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788576110.114981:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788576110.115009:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788576110.115099:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788576110.115152:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788576110.116348:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576110.117339:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576110.755974:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576111.138984:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788576111.138984:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576111.138984:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788576111.139049:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576111.139150:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788576111.139201:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788576111.779412:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576112.162984:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788576112.163090:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788576112.163132:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788576112.163236:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788576112.165153:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576112.165214:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576112.803377:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576113.186990:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788576113.186991:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788576113.186992:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788576113.187059:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788576113.188150:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788576113.188646:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576113.826978:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576114.210996:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788576114.211008:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788576114.211060:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788576114.211219:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788576114.211766:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576114.212222:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00080000:3.0:1788576114.850998:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788576114.851002:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788576114.851010:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788576114.851016:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576114.851025:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4460
00000100:00080000:3.0:1788576114.851035:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576114.851043:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788576114.851079:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ce00 x1875453361351808/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576114.851106:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576114.851111:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788576114.851113:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576114.851117:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4460
00000100:00080000:3.0:1788576114.851121:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576114.851126:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576114.851136:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788576114.851143:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361351808:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788576114.851151:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644dc00 x1875453361351936/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576114.851167:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576114.851170:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788576114.851172:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576114.851176:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4460
00000100:00080000:3.0:1788576114.851180:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576114.851184:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576114.851190:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576114.851201:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c000 x1875453361352064/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1788576114.851216:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788576114.851218:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576114.851223:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788576114.851225:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576114.851230:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4460
00000100:00080000:3.0:1788576114.851234:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576114.851238:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576114.851243:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576114.851255:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f800 x1875453361352192/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788576114.851265:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576114/real 1788576114]  req@ffff8dc00644ce00 x1875453361351808/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576139 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576114.851267:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576114.851274:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788576114.851277:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576114.851285:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4460
00000100:00080000:3.0:1788576114.851290:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1788576114.851295:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ce00 x1875453361351808/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576139 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788576114.851305:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576114.851358:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00080000:0.0:1788576114.851359:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788576114.851368:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361351808:192.168.202.140@tcp:250:kworker.0
00000008:00100000:3.0:1788576114.851368:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788576114.851394:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361351936:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788576114.851395:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ce00 x1875453361352320/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576114.851409:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576114.851412:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788576114.851414:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576114.851417:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4460
00000100:00080000:3.0:1788576114.851421:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576114.851426:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000800:00000100:0.0:1788576114.851431:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000008:00100000:3.0:1788576114.851433:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576114.851442:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ca80 x1875453361352448/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576114.851449:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1788576114.851450:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576114/real 1788576114]  req@ffff8dc00644dc00 x1875453361351936/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576139 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576114.851453:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788576114.851456:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576114.851462:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4460
00000100:00080000:3.0:1788576114.851467:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576114.851473:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576114.851477:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788576114.851482:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644dc00 x1875453361351936/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576139 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576114.851487:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ea00 x1875453361352576/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788576114.851513:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788576114.851518:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788576114.851522:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361351936:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788576114.851530:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361352064:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788576114.851550:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788576114.851560:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576114/real 1788576114]  req@ffff8dc00644c000 x1875453361352064/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576139 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788576114.851570:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c000 x1875453361352064/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576139 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788576114.851579:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788576114.851582:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788576114.851585:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361352064:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788576114.851590:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361352192:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788576114.851607:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788576114.851617:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576114/real 1788576114]  req@ffff8dc00644f800 x1875453361352192/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576139 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788576114.851627:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f800 x1875453361352192/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576139 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788576114.851635:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788576114.851637:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788576114.851640:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361352192:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788576114.851675:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361352320:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788576114.851695:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788576114.851706:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576114/real 1788576114]  req@ffff8dc00644ce00 x1875453361352320/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576139 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788576114.851716:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ce00 x1875453361352320/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576139 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788576114.851724:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788576114.851727:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788576114.851730:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361352320:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788576114.851736:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361352448:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788576114.851751:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788576114.851760:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576114/real 1788576114]  req@ffff8dc00644ca80 x1875453361352448/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576139 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788576114.851805:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ca80 x1875453361352448/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576139 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788576114.851812:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788576114.851815:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788576114.851818:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361352448:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788576114.851823:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361352576:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788576114.851840:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788576114.851851:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576114/real 1788576114]  req@ffff8dc00644ea00 x1875453361352576/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576139 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788576114.851989:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ea00 x1875453361352576/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576139 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788576114.851997:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788576114.852000:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788576114.852003:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361352576:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788576115.234966:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788576115.234966:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576115.236472:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788576115.236487:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576115.236503:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576115.236564:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788576115.875116:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576116.259002:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788576116.259026:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788576116.259082:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576116.259109:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576116.259132:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788576116.260326:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576116.898992:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576117.283032:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576117.283069:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788576117.283113:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576117.283160:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788576117.285007:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576117.285072:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788576117.924786:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576118.306979:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576118.306979:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576118.307083:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788576118.307095:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788576118.307103:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788576118.307706:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788576118.947992:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576119.330993:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788576119.330993:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576119.331022:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788576119.331033:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576119.331080:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788576119.332487:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1788576119.971034:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576119.971044:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788576119.971048:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576119.971058:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4465
00000100:00080000:2.0:1788576119.971068:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576119.971075:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788576119.971109:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453361352704/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788576119.971132:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576119.971135:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788576119.971136:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576119.971140:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4465
00000100:00080000:2.0:1788576119.971143:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576119.971146:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788576119.971155:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788576119.971165:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453361352832/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788576119.971174:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576119.971177:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788576119.971178:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576119.971181:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4465
00000100:00080000:2.0:1788576119.971184:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576119.971187:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788576119.971191:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788576119.971200:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361352960/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788576119.971208:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576119.971211:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788576119.971213:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576119.971216:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4465
00000100:00080000:2.0:1788576119.971219:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576119.971222:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788576119.971226:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788576119.971236:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361353088/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788576119.971244:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576119.971247:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788576119.971249:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576119.971252:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4465
00000100:00080000:2.0:1788576119.971255:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576119.971258:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788576119.971263:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788576119.971273:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361353216/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788576119.971282:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576119.971285:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788576119.971287:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576119.971290:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4465
00000100:00080000:2.0:1788576119.971294:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576119.971296:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788576119.971301:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788576119.971311:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361353344/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788576119.971319:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576119.971322:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788576119.971335:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576119.971339:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4465
00000100:00080000:2.0:1788576119.971342:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576119.971345:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788576119.971350:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788576119.971361:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453361353472/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788576119.971562:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361352704:192.168.202.140@tcp:250:kworker.0
00000800:00000100:0.0:1788576119.971624:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788576119.971675:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576119/real 1788576119]  req@ffff8dc020497480 x1875453361352704/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576144 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788576119.971695:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453361352704/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576144 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788576119.971706:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788576119.971711:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788576119.971716:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361352704:192.168.202.140@tcp:250:kworker.0
00000100:00100000:1.0:1788576119.971718:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576119.971725:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361352832:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788576119.971749:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788576119.971761:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576119/real 1788576119]  req@ffff8dc020497100 x1875453361352832/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576144 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788576119.971773:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453361352832/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576144 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788576119.971783:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788576119.971786:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788576119.971790:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361352832:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788576119.971795:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361352960:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788576119.971816:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788576119.971827:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576119/real 1788576119]  req@ffff8dc020495180 x1875453361352960/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576144 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788576119.971837:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361352960/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576144 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788576119.971845:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788576119.971848:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788576119.971851:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361352960:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788576119.971856:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361353088:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788576119.971890:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788576119.971901:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576119/real 1788576119]  req@ffff8dc020494700 x1875453361353088/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576144 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788576119.971910:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361353088/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576144 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788576119.971918:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788576119.971921:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788576119.971923:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361353088:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788576119.971929:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361353216:192.168.202.140@tcp:38:kworker.0
00000800:00000100:0.0:1788576119.971944:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788576119.971952:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576119/real 1788576119]  req@ffff8dc020494000 x1875453361353216/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576144 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788576119.971962:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361353216/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576144 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788576119.971969:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788576119.971972:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788576119.971974:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361353216:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788576119.971979:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361353344:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788576119.971994:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788576119.972002:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576119/real 1788576119]  req@ffff8dc020495880 x1875453361353344/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576144 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788576119.972017:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361353344/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576144 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788576119.972024:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788576119.972027:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788576119.972030:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361353344:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788576119.972035:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361353472:192.168.202.140@tcp:8:kworker.0
00000800:00000100:0.0:1788576119.972049:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:0.0:1788576119.972057:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576119/real 1788576119]  req@ffff8dc020494e00 x1875453361353472/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576144 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1788576119.972067:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453361353472/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576144 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1788576119.972074:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1788576119.972077:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:0.0:1788576119.972080:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361353472:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788576120.355020:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788576120.355264:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788576120.355305:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576120.358561:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788576120.358641:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788576120.358777:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788576120.997521:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576121.378998:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788576121.379194:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788576121.379298:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788576121.379351:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788576121.379707:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788576121.379727:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576122.019003:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576122.402995:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576122.403003:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576122.403025:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788576122.403045:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788576122.403076:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576122.403546:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788576123.042991:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576123.426991:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788576123.427030:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788576123.427082:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788576123.427097:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788576123.427136:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788576123.427147:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576124.067312:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576124.450997:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788576124.451002:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576124.454845:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576124.455507:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788576124.455616:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:1.0:1788576124.455660:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1788576125.091408:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788576125.091420:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788576125.091425:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788576125.091435:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4470
00000100:00080000:0.0:1788576125.091448:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788576125.091456:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788576125.091495:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712a00 x1875453361353600/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788576125.091544:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576125.091576:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361353600:192.168.202.140@tcp:250:kworker.0
00000800:00000100:3.0:1788576125.091628:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:0.0:1788576125.091654:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788576125.091657:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788576125.091658:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788576125.091661:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4470
00000100:00080000:0.0:1788576125.091664:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788576125.091667:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788576125.091675:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788576125.091702:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713480 x1875453361353728/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788576125.091742:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576125/real 1788576125]  req@ffff8dc006712a00 x1875453361353600/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576150 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576125.091760:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712a00 x1875453361353600/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576150 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576125.091770:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576125.091774:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00080000:0.0:1788576125.091778:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1788576125.091778:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361353600:192.168.202.140@tcp:250:kworker.0
00000100:00080000:0.0:1788576125.091782:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788576125.091783:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788576125.091786:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4470
00000100:00080000:0.0:1788576125.091790:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788576125.091793:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788576125.091799:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576125.091799:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361353728:192.168.202.140@tcp:38:kworker.0
00000100:00100000:0.0:1788576125.091810:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711c00 x1875453361353856/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788576125.091822:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576125.091834:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576125/real 1788576125]  req@ffff8dc006713480 x1875453361353728/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576150 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576125.091844:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713480 x1875453361353728/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576150 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576125.091853:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576125.091857:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576125.091860:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361353728:192.168.202.140@tcp:38:kworker.0
00000100:00080000:0.0:1788576125.091977:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788576125.091981:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788576125.091983:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788576125.091988:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4470
00000100:00080000:0.0:1788576125.091992:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788576125.091995:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788576125.092001:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788576125.092013:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710380 x1875453361353984/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788576125.092021:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788576125.092025:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788576125.092027:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788576125.092030:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4470
00000100:00100000:3.0:1788576125.092032:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361353856:192.168.202.140@tcp:8:kworker.0
00000100:00080000:0.0:1788576125.092034:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788576125.092037:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788576125.092042:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788576125.092051:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712300 x1875453361354112/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788576125.092060:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788576125.092063:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788576125.092065:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788576125.092068:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4470
00000100:00080000:0.0:1788576125.092072:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788576125.092075:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788576125.092079:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788576125.092088:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361354240/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788576125.092096:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788576125.092099:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788576125.092101:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788576125.092104:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4470
00000100:00080000:0.0:1788576125.092107:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788576125.092111:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788576125.092114:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788576125.092285:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361354368/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1788576125.092361:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576125.092375:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576125/real 1788576125]  req@ffff8dc006711c00 x1875453361353856/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576150 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576125.092387:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711c00 x1875453361353856/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576150 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576125.092393:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576125.092395:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576125.092397:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361353856:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788576125.092401:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361353984:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788576125.092416:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576125.092422:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576125/real 1788576125]  req@ffff8dc006710380 x1875453361353984/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576150 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576125.092428:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710380 x1875453361353984/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576150 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576125.092434:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576125.092436:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576125.092438:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361353984:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788576125.092446:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361354112:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788576125.092456:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576125.092461:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576125/real 1788576125]  req@ffff8dc006712300 x1875453361354112/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576150 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576125.092467:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712300 x1875453361354112/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576150 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576125.092476:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576125.092478:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576125.092480:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361354112:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788576125.092483:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361354240:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788576125.092491:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576125.092496:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576125/real 1788576125]  req@ffff8dc006713800 x1875453361354240/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576150 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576125.092502:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361354240/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576150 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576125.092507:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576125.092508:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576125.092510:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361354240:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788576125.092513:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361354368:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788576125.092522:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576125.092527:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576125/real 1788576125]  req@ffff8dc006713b80 x1875453361354368/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576150 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576125.092533:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361354368/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576150 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576125.092537:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576125.092538:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576125.092540:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361354368:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788576125.475404:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576125.475537:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788576125.475607:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576125.475674:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788576125.479512:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788576125.479644:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576126.115039:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576126.498991:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788576126.499009:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788576126.499021:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788576126.499122:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576126.499134:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788576126.499183:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788576127.139000:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576127.522990:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576127.522990:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788576127.523017:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788576127.523036:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788576127.523047:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576127.523063:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788576128.163002:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576128.547262:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788576128.547273:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788576128.547893:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788576128.547907:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576128.549387:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788576128.549452:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576129.187019:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576129.570981:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576129.570981:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788576129.570981:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788576129.571050:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788576129.571918:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576129.571928:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00080000:1.0:1788576130.211050:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576130.211057:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788576130.211061:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576130.211069:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4475
00000100:00080000:1.0:1788576130.211077:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576130.211083:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788576130.211114:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1180 x1875453361354496/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788576130.211136:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576130.211138:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788576130.211140:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576130.211143:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4475
00000100:00080000:1.0:1788576130.211145:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576130.211148:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788576130.211156:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788576130.211167:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361354624/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788576130.211174:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361354496:192.168.202.140@tcp:250:kworker.0
00000100:00080000:1.0:1788576130.211178:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576130.211185:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788576130.211186:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576130.211191:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4475
00000100:00080000:1.0:1788576130.211194:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576130.211199:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788576130.211204:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788576130.211217:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361354752/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788576130.211227:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576130.211231:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788576130.211233:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576130.211246:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4475
00000100:00080000:1.0:1788576130.211255:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1788576130.211259:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:1.0:1788576130.211264:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788576130.211271:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788576130.211286:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361354880/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788576130.211294:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576130.211297:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788576130.211298:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576130.211302:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4475
00000100:00080000:1.0:1788576130.211305:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576130.211309:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788576130.211313:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788576130.211322:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361355008/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788576130.211330:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576130.211333:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788576130.211335:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576130.211339:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4475
00000100:00080000:1.0:1788576130.211343:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576130.211347:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788576130.211352:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788576130.211361:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361355136/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788576130.211375:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576130.211379:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788576130.211381:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576130.211385:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4475
00000100:00080000:1.0:1788576130.211388:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576130.211392:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788576130.211397:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788576130.211401:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576130/real 1788576130]  req@ffff8dc005dc1180 x1875453361354496/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576155 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1788576130.211410:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361355264/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788576130.211449:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1180 x1875453361354496/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576155 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576130.211460:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788576130.211465:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788576130.211469:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361354496:192.168.202.140@tcp:250:kworker.0
00000100:00100000:0.0:1788576130.211492:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576130.211497:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361354624:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788576130.211528:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788576130.211544:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576130/real 1788576130]  req@ffff8dc005dc3b80 x1875453361354624/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576155 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788576130.211557:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361354624/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576155 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576130.211567:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788576130.211570:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788576130.211573:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361354624:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788576130.211579:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361354752:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788576130.211599:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788576130.211610:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576130/real 1788576130]  req@ffff8dc005dc3800 x1875453361354752/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576155 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788576130.211621:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361354752/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576155 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576130.211635:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788576130.211640:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788576130.211643:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361354752:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788576130.211648:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361354880:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788576130.211665:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788576130.211674:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576130/real 1788576130]  req@ffff8dc005dc2d80 x1875453361354880/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576155 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788576130.211704:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361354880/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576155 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576130.211714:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788576130.211718:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788576130.211721:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361354880:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788576130.211726:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361355008:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788576130.211743:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788576130.211753:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576130/real 1788576130]  req@ffff8dc005dc0700 x1875453361355008/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576155 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788576130.211764:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361355008/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576155 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576130.211773:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788576130.211776:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788576130.211779:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361355008:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788576130.211785:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361355136:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788576130.211803:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788576130.211812:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576130/real 1788576130]  req@ffff8dc005dc1c00 x1875453361355136/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576155 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788576130.211823:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361355136/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576155 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576130.211831:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788576130.211834:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788576130.211838:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361355136:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788576130.211844:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361355264:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788576130.211862:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788576130.211908:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576130/real 1788576130]  req@ffff8dc005dc0a80 x1875453361355264/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576155 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788576130.211921:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361355264/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576155 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576130.211929:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788576130.211931:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788576130.211934:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361355264:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788576130.594982:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576130.594993:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788576130.595145:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576130.599629:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788576130.599714:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788576130.599789:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788576131.234988:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576131.618992:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576131.618998:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788576131.619003:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576131.619032:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:2.0:1788576131.619045:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576131.619046:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788576132.259039:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576132.642998:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788576132.642998:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576132.643907:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576132.643915:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788576132.643977:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788576132.644039:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788576133.282967:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576133.667038:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788576133.667224:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788576133.667225:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788576133.667386:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576133.667803:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788576133.667846:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788576134.307044:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576134.691044:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788576134.691116:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788576134.691149:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576134.695136:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788576134.695307:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788576134.697032:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576135.331042:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:0.0:1788576135.331043:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788576135.331057:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1788576135.331062:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788576135.331076:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4480
00000100:00080000:0.0:1788576135.331089:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788576135.331099:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:0.0:1788576135.331150:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006710e00 x1875453361355392/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788576135.331184:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788576135.331188:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788576135.331190:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788576135.331195:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4480
00000100:00080000:0.0:1788576135.331199:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788576135.331203:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788576135.331215:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788576135.331227:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713100 x1875453361355520/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788576135.331238:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788576135.331241:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788576135.331243:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788576135.331248:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4480
00000100:00080000:0.0:1788576135.331251:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788576135.331256:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788576135.331261:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788576135.331273:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711880 x1875453361355648/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788576135.331282:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788576135.331285:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788576135.331287:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788576135.331291:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4480
00000100:00080000:0.0:1788576135.331295:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788576135.331299:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788576135.331304:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788576135.331314:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006711500 x1875453361355776/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788576135.331323:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788576135.331327:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1788576135.331329:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788576135.331333:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4480
00000100:00080000:0.0:1788576135.331337:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788576135.331341:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788576135.331346:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788576135.331356:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006712680 x1875453361355904/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788576135.331365:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788576135.331368:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1788576135.331370:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788576135.331373:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4480
00000100:00080000:0.0:1788576135.331377:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788576135.331380:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788576135.331385:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788576135.331397:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713b80 x1875453361356032/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1788576135.331406:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1788576135.331409:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1788576135.331411:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1788576135.331414:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4480
00000100:00080000:0.0:1788576135.331418:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1788576135.331422:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:0.0:1788576135.331427:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1788576135.331439:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc006713800 x1875453361356160/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788576135.331547:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361355392:192.168.202.140@tcp:250:kworker.0
00000800:00000100:2.0:1788576135.331629:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788576135.331685:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576135/real 1788576135]  req@ffff8dc006710e00 x1875453361355392/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576160 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788576135.331716:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006710e00 x1875453361355392/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576160 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576135.331727:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788576135.331731:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788576135.331735:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361355392:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788576135.331743:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361355520:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788576135.331768:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788576135.331781:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576135/real 1788576135]  req@ffff8dc006713100 x1875453361355520/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576160 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788576135.331793:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713100 x1875453361355520/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576160 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576135.331804:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788576135.331808:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788576135.331811:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361355520:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788576135.331818:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361355648:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788576135.331840:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788576135.331851:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576135/real 1788576135]  req@ffff8dc006711880 x1875453361355648/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576160 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788576135.331863:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711880 x1875453361355648/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576160 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576135.331897:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788576135.331901:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788576135.331904:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361355648:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788576135.331910:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361355776:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788576135.331931:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788576135.331942:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576135/real 1788576135]  req@ffff8dc006711500 x1875453361355776/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576160 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788576135.331953:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006711500 x1875453361355776/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576160 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576135.331962:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788576135.331966:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788576135.331969:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361355776:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788576135.331975:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361355904:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788576135.331994:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788576135.332005:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576135/real 1788576135]  req@ffff8dc006712680 x1875453361355904/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576160 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788576135.332016:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006712680 x1875453361355904/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576160 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576135.332024:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788576135.332028:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788576135.332031:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361355904:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788576135.332037:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361356032:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788576135.332057:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788576135.332068:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576135/real 1788576135]  req@ffff8dc006713b80 x1875453361356032/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576160 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788576135.332079:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713b80 x1875453361356032/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576160 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576135.332086:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788576135.332089:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788576135.332092:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361356032:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788576135.332098:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361356160:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788576135.332117:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788576135.332128:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576135/real 1788576135]  req@ffff8dc006713800 x1875453361356160/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576160 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788576135.332140:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc006713800 x1875453361356160/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576160 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576135.332154:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788576135.332158:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788576135.332161:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc006713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361356160:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788576135.715017:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788576135.715017:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788576135.715260:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788576135.721299:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788576135.721511:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576135.721530:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576136.356446:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576136.739002:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788576136.739030:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788576136.739051:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788576136.739067:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576136.741007:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788576136.741034:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788576137.379736:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576137.762984:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788576137.762985:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576137.763783:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788576137.763808:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788576137.763818:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788576137.763859:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788576138.403419:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576138.786993:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788576138.786993:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576138.787107:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:3.0:1788576138.787162:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788576138.787769:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788576138.788043:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576139.427035:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576139.811018:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788576139.811018:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576139.811159:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576139.811179:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788576139.811208:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788576139.818302:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1788576140.451120:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576140.451136:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1788576140.451143:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576140.451158:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4486
00000100:00080000:1.0:1788576140.451171:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576140.451182:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:1.0:1788576140.451235:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1500 x1875453361356288/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788576140.451266:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576140.451270:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788576140.451272:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576140.451277:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4486
00000100:00080000:1.0:1788576140.451280:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576140.451285:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788576140.451298:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788576140.451315:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0a80 x1875453361356416/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788576140.451326:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576140.451329:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788576140.451332:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576140.451336:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4486
00000100:00080000:1.0:1788576140.451340:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576140.451344:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788576140.451350:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788576140.451360:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc1c00 x1875453361356544/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788576140.451375:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576140.451379:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788576140.451380:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576140.451384:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4486
00000100:00080000:1.0:1788576140.451387:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576140.451391:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788576140.451395:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788576140.451407:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc0700 x1875453361356672/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788576140.451416:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576140.451419:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1788576140.451421:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576140.451425:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4486
00000100:00080000:1.0:1788576140.451428:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576140.451432:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788576140.451437:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788576140.451449:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc2d80 x1875453361356800/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788576140.451458:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576140.451461:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1788576140.451462:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576140.451466:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4486
00000100:00080000:1.0:1788576140.451470:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576140.451474:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788576140.451478:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788576140.451488:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3800 x1875453361356928/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1788576140.451498:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1788576140.451501:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1788576140.451503:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1788576140.451506:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4486
00000100:00080000:1.0:1788576140.451510:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1788576140.451513:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:1.0:1788576140.451518:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1788576140.451528:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc005dc3b80 x1875453361357056/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1788576140.451780:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576140.451797:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361356288:192.168.202.140@tcp:250:kworker.0
00000800:00000100:2.0:1788576140.453049:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788576140.453120:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576140/real 1788576140]  req@ffff8dc005dc1500 x1875453361356288/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576165 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788576140.453143:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1500 x1875453361356288/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576165 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576140.453155:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788576140.453161:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788576140.453165:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361356288:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788576140.453176:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361356416:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788576140.453215:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788576140.453228:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576140/real 1788576140]  req@ffff8dc005dc0a80 x1875453361356416/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576165 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788576140.453241:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0a80 x1875453361356416/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576165 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576140.453251:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788576140.453255:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788576140.453258:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361356416:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788576140.453265:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361356544:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788576140.453288:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788576140.453300:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576140/real 1788576140]  req@ffff8dc005dc1c00 x1875453361356544/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576165 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788576140.453309:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc1c00 x1875453361356544/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576165 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576140.453318:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788576140.453322:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788576140.453325:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361356544:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788576140.453332:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361356672:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788576140.453351:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788576140.453362:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576140/real 1788576140]  req@ffff8dc005dc0700 x1875453361356672/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576165 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788576140.453373:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc0700 x1875453361356672/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576165 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576140.453381:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788576140.453384:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788576140.453387:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361356672:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788576140.453393:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361356800:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788576140.453411:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788576140.453422:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576140/real 1788576140]  req@ffff8dc005dc2d80 x1875453361356800/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576165 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788576140.453432:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc2d80 x1875453361356800/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576165 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576140.453441:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788576140.453444:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788576140.453447:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361356800:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788576140.453454:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361356928:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788576140.453474:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788576140.453486:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576140/real 1788576140]  req@ffff8dc005dc3800 x1875453361356928/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576165 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788576140.453496:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3800 x1875453361356928/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576165 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576140.453510:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788576140.453513:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788576140.453516:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361356928:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788576140.453523:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361357056:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788576140.453543:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788576140.453554:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576140/real 1788576140]  req@ffff8dc005dc3b80 x1875453361357056/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576165 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788576140.453567:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc005dc3b80 x1875453361357056/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576165 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576140.453574:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788576140.453578:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788576140.453580:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc005dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361357056:192.168.202.140@tcp:8:kworker.0
00000100:00100000:0.0:1788576140.835013:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788576140.835013:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788576140.835102:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576140.835111:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576140.835536:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:3.0:1788576140.844043:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576141.475405:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576141.859047:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788576141.859338:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576141.860901:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788576141.861547:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788576141.861613:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788576141.861760:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576142.501936:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576142.882964:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788576142.883044:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788576142.883105:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788576142.883152:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788576142.883188:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576142.883248:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576143.523051:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576143.907064:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576143.907197:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788576143.907327:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788576143.907743:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788576143.907845:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788576143.910769:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576144.547033:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576144.931035:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788576144.931065:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576144.932488:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788576144.932721:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788576144.933018:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788576144.933043:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788576145.570984:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788576145.571175:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576145.571180:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788576145.571184:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576145.571193:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4491
00000100:00080000:3.0:1788576145.571204:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576145.571211:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788576145.571249:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d500 x1875453361357184/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576145.571279:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576145.571283:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788576145.571284:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576145.571288:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4491
00000100:00080000:3.0:1788576145.571291:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576145.571295:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576145.571304:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576145.571315:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c380 x1875453361357312/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576145.571323:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576145.571326:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788576145.571328:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576145.571331:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4491
00000100:00080000:3.0:1788576145.571333:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576145.571336:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576145.571341:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576145.571349:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f480 x1875453361357440/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576145.571357:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576145.571360:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788576145.571361:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576145.571364:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4491
00000100:00080000:3.0:1788576145.571366:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576145.571369:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576145.571373:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576145.571380:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d180 x1875453361357568/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576145.571388:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576145.571391:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788576145.571392:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576145.571396:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4491
00000100:00080000:3.0:1788576145.571399:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576145.571402:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576145.571406:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576145.571413:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e680 x1875453361357696/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576145.571420:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576145.571424:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788576145.571426:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576145.571429:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4491
00000100:00080000:3.0:1788576145.571432:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576145.571435:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576145.571439:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576145.571446:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c700 x1875453361357824/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576145.571453:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576145.571456:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788576145.571458:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576145.571460:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4491
00000100:00080000:3.0:1788576145.571463:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576145.571466:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576145.571470:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576145.571477:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e300 x1875453361357952/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788576145.571548:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361357184:192.168.202.140@tcp:250:kworker.0
00000800:00000100:2.0:1788576145.571608:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788576145.571643:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576145/real 1788576145]  req@ffff8dc00644d500 x1875453361357184/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576170 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788576145.571659:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d500 x1875453361357184/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576170 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576145.571668:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788576145.571671:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788576145.571674:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361357184:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788576145.571680:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361357312:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788576145.571699:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788576145.571709:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576145/real 1788576145]  req@ffff8dc00644c380 x1875453361357312/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576170 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788576145.571719:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453361357312/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576170 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576145.571728:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788576145.571744:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788576145.571747:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361357312:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788576145.571753:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361357440:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788576145.571774:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788576145.571786:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576145/real 1788576145]  req@ffff8dc00644f480 x1875453361357440/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576170 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788576145.571804:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453361357440/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576170 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576145.571812:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788576145.571815:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788576145.571818:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361357440:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788576145.571827:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361357568:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788576145.571843:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788576145.571852:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576145/real 1788576145]  req@ffff8dc00644d180 x1875453361357568/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576170 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788576145.571862:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453361357568/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576170 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576145.571890:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788576145.571893:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788576145.571896:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361357568:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788576145.571900:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361357696:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788576145.571920:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788576145.571930:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576145/real 1788576145]  req@ffff8dc00644e680 x1875453361357696/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576170 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788576145.571940:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453361357696/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576170 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576145.571964:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788576145.571968:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788576145.571970:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361357696:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788576145.571975:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361357824:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788576145.571992:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788576145.572001:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576145/real 1788576145]  req@ffff8dc00644c700 x1875453361357824/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576170 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788576145.572010:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453361357824/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576170 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576145.572017:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788576145.572019:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788576145.572022:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361357824:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788576145.572127:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361357952:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788576145.572147:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788576145.572156:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576145/real 1788576145]  req@ffff8dc00644e300 x1875453361357952/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576170 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788576145.572166:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453361357952/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576170 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576145.572173:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788576145.572176:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788576145.572179:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361357952:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788576145.955062:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788576145.959175:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788576145.959364:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788576145.960428:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788576145.960503:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576145.965199:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576146.595013:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576146.979049:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788576146.979113:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788576146.979268:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788576146.979285:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576146.979613:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788576146.979634:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788576147.619912:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576148.002984:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576148.002984:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576148.003070:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788576148.003071:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788576148.004178:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788576148.004290:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788576148.644184:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576149.027027:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576149.027035:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788576149.027156:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788576149.027363:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788576149.032979:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788576149.033861:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576149.667035:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576150.050944:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788576150.051239:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576150.051473:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576150.051535:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788576150.051655:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788576150.057931:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1788576150.691110:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576150.691122:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788576150.691127:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576150.691137:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4496
00000100:00080000:2.0:1788576150.691148:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576150.691156:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788576150.691193:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453361358080/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788576150.691258:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361358080:192.168.202.140@tcp:250:kworker.0
00000100:00080000:2.0:1788576150.691376:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576150.691380:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788576150.691382:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576150.691387:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4496
00000100:00080000:2.0:1788576150.691391:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576150.691395:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788576150.691414:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788576150.691429:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453361358208/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1788576150.691567:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576150.695576:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361358208:192.168.202.140@tcp:38:kworker.0
00000100:00080000:2.0:1788576150.696654:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576150.696661:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788576150.696665:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576150.696673:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4496
00000100:00080000:2.0:1788576150.696689:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576150.696697:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788576150.696709:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788576150.696741:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453361358336/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788576150.696767:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576150.696770:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788576150.696772:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576150.696776:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4496
00000100:00080000:2.0:1788576150.696780:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576150.696784:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788576150.696788:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788576150.696799:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361358464/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788576150.696808:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576150.696811:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788576150.696813:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576150.696816:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4496
00000100:00080000:2.0:1788576150.696819:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576150.696822:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788576150.696827:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788576150.696836:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361358592/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788576150.696844:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576150.696848:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788576150.696849:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576150.696853:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4496
00000100:00080000:2.0:1788576150.696856:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576150.696859:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788576150.696863:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788576150.696889:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361358720/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788576150.696897:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576150.696900:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788576150.696902:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576150.696906:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4496
00000100:00080000:2.0:1788576150.696909:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576150.696911:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788576150.696915:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788576150.696923:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361358848/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788576150.697396:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361358336:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788576150.697515:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361358464:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788576150.697538:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361358592:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788576150.697561:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361358720:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788576150.697580:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361358848:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788576151.075040:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788576151.075041:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576151.075093:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576151.075530:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788576151.075717:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788576151.075792:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576151.716191:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576152.099003:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576152.099015:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788576152.099112:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788576152.099143:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788576152.099972:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576152.099972:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788576152.739127:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576153.123002:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:3.0:1788576153.123043:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788576153.123050:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576153.123058:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576153.123089:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788576153.123107:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788576153.764353:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000400:00000100:3.0:1788576153.768996:0:2336:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.140:988
00000400:00000100:3.0:1788576153.769076:0:2336:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.140@tcp at host 192.168.202.140 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:3.0:1788576153.769097:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788576153.769172:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788576153.769184:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788576153.769193:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788576153.769201:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788576153.769209:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000800:00000100:3.0:1788576153.769217:0:2336:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.140@tcp
00000100:00100000:2.0:1788576153.769323:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576150/real 1788576153]  req@ffff8dc020494e00 x1875453361358336/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576175 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788576153.769364:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453361358336/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576175 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576153.769381:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788576153.769388:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788576153.769394:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361358336:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788576153.769404:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576150/real 1788576153]  req@ffff8dc020495880 x1875453361358464/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576175 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788576153.769417:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361358464/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576175 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576153.769426:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788576153.769430:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788576153.769434:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361358464:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788576153.769441:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576150/real 1788576153]  req@ffff8dc020494000 x1875453361358592/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576175 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788576153.769454:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361358592/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576175 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576153.769463:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788576153.769467:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788576153.769470:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361358592:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788576153.769489:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576150/real 1788576153]  req@ffff8dc020494700 x1875453361358720/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576175 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788576153.769501:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361358720/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576175 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576153.769509:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788576153.769512:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788576153.769516:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361358720:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788576153.769523:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576150/real 1788576153]  req@ffff8dc020495180 x1875453361358848/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576175 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788576153.769542:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361358848/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576175 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576153.769551:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788576153.769555:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788576153.769558:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361358848:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788576153.769565:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576150/real 1788576153]  req@ffff8dc020496a00 x1875453361358208/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576175 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788576153.769577:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453361358208/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576175 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576153.769588:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788576153.769591:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788576153.769594:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361358208:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788576153.769602:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576150/real 1788576153]  req@ffff8dc020494a80 x1875453361358080/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576175 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788576153.769614:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453361358080/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576175 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576153.769621:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788576153.769624:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788576153.769628:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361358080:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788576154.147102:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788576154.147110:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788576154.147288:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788576154.147349:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576154.147495:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576154.147547:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788576154.787106:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576155.171028:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788576155.171029:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576155.171043:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788576155.171106:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788576155.172015:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788576155.172497:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788576155.811098:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:2.0:1788576155.811201:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576155.811205:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788576155.811209:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576155.811219:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4501
00000100:00080000:2.0:1788576155.811231:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576155.811238:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788576155.811273:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494a80 x1875453361358976/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788576155.811303:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576155.811305:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788576155.811307:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576155.811310:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4501
00000100:00080000:2.0:1788576155.811312:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576155.811315:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788576155.811325:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788576155.811335:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496a00 x1875453361359104/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788576155.811345:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576155.811348:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788576155.811350:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576155.811354:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4501
00000100:00080000:2.0:1788576155.811357:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576155.811360:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788576155.811366:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788576155.811376:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495180 x1875453361359232/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788576155.811385:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576155.811387:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788576155.811388:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576155.811391:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4501
00000100:00080000:2.0:1788576155.811393:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576155.811395:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788576155.811399:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788576155.811405:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494700 x1875453361359360/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788576155.811410:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576155.811413:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788576155.811414:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576155.811417:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4501
00000100:00080000:2.0:1788576155.811419:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576155.811421:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788576155.811424:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788576155.811429:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494000 x1875453361359488/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788576155.811434:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576155.811436:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788576155.811437:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576155.811440:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4501
00000100:00080000:2.0:1788576155.811442:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576155.811443:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788576155.811446:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788576155.811450:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361359616/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788576155.811455:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576155.811457:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788576155.811457:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576155.811459:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4501
00000100:00080000:2.0:1788576155.811461:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1788576155.811568:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361358976:192.168.202.140@tcp:250:kworker.0
00000800:00000100:3.0:1788576155.811635:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576155.811675:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576155/real 1788576155]  req@ffff8dc020494a80 x1875453361358976/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576180 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576155.811699:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494a80 x1875453361358976/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576180 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576155.811707:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576155.811710:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576155.811713:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361358976:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788576155.811718:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361359104:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788576155.811733:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576155.811741:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576155/real 1788576155]  req@ffff8dc020496a00 x1875453361359104/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576180 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576155.811748:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496a00 x1875453361359104/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576180 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576155.811766:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576155.811770:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576155.811773:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361359104:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788576155.811779:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361359232:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788576155.811802:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576155.811813:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576155/real 1788576155]  req@ffff8dc020495180 x1875453361359232/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576180 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576155.811826:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495180 x1875453361359232/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576180 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576155.811831:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576155.811833:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576155.811835:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361359232:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788576155.811839:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361359360:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788576155.811852:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576155.811858:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576155/real 1788576155]  req@ffff8dc020494700 x1875453361359360/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576180 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576155.811884:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494700 x1875453361359360/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576180 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576155.811890:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576155.811892:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576155.811894:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361359360:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788576155.811898:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361359488:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788576155.811910:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576155.811917:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576155/real 1788576155]  req@ffff8dc020494000 x1875453361359488/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576180 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576155.811923:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494000 x1875453361359488/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576180 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576155.811933:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576155.811935:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576155.811937:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361359488:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788576155.811940:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361359616:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788576155.811949:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576155.811954:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576155/real 1788576155]  req@ffff8dc020495880 x1875453361359616/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576180 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576155.811960:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361359616/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576180 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576155.811965:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576155.811966:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576155.811968:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361359616:192.168.202.140@tcp:8:kworker.0
00000100:00080000:2.0:1788576155.812055:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788576155.812061:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788576155.812071:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453361359744/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788576155.814039:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361359744:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788576155.814154:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576155.814193:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576155/real 1788576155]  req@ffff8dc020494e00 x1875453361359744/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576180 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576155.814214:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453361359744/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576180 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576155.814226:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576155.814230:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576155.814236:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361359744:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788576156.195056:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788576156.195330:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576156.195645:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788576156.197197:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788576156.197403:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576156.198791:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788576156.835200:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576157.219050:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788576157.219234:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788576157.219397:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788576157.219543:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:3.0:1788576157.219914:0:38330:0:(ldlm_pool.c:1330:ldlm_pools_recalc_task()) Negative interval(0)
00010000:00010000:3.0:1788576157.219929:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788576157.220702:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576157.858996:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576158.243352:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576158.243458:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788576158.243605:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788576158.243661:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788576158.243881:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576158.243933:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788576158.883832:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576159.266990:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576159.267201:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788576159.267311:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576159.267364:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788576159.267504:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788576159.267603:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576159.907465:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576160.291017:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788576160.291124:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576160.291218:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788576160.291310:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576160.292684:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788576160.292732:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1788576160.931060:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576160.931070:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788576160.931074:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576160.931244:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4506
00000100:00080000:3.0:1788576160.931255:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576160.931262:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788576160.931300:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d880 x1875453361359872/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788576160.931359:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361359872:192.168.202.140@tcp:250:kworker.0
00000800:00000100:2.0:1788576160.931544:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00080000:3.0:1788576160.931946:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576160.931951:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788576160.931952:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576160.931957:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4506
00000100:00080000:3.0:1788576160.931961:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576160.931966:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576160.931975:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576160.931990:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f100 x1875453361360000/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788576160.932061:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576160/real 1788576160]  req@ffff8dc00644d880 x1875453361359872/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576185 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788576160.932089:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d880 x1875453361359872/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576185 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576160.932100:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788576160.932104:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788576160.932108:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361359872:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788576160.932132:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361360000:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788576160.932155:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788576160.932167:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576160/real 1788576160]  req@ffff8dc00644f100 x1875453361360000/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576185 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788576160.932178:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f100 x1875453361360000/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576185 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576160.932194:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788576160.932197:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788576160.932200:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361360000:192.168.202.140@tcp:38:kworker.0
00000100:00100000:1.0:1788576160.932739:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788576160.936357:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576160.936368:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788576160.936372:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576160.936514:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4506
00000100:00080000:3.0:1788576160.936524:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576160.936531:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576160.936543:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576160.936577:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644ed80 x1875453361360128/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576160.936602:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576160.936606:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788576160.936608:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576160.936611:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4506
00000100:00080000:3.0:1788576160.936615:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576160.936618:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576160.936623:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576160.936635:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644df80 x1875453361360256/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576160.936643:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576160.936646:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788576160.936648:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576160.936651:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4506
00000100:00080000:3.0:1788576160.936654:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576160.936658:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576160.936663:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576160.936673:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644fb80 x1875453361360384/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576160.936682:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576160.936685:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788576160.936686:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576160.936690:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4506
00000100:00080000:3.0:1788576160.936692:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576160.936696:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576160.936700:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576160.936710:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f100 x1875453361360512/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576160.936718:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576160.936721:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788576160.936723:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576160.936726:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4506
00000100:00080000:3.0:1788576160.936729:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576160.936733:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576160.936737:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576160.936745:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d880 x1875453361360640/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788576160.936935:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361360128:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788576160.936998:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788576160.937027:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576160/real 1788576160]  req@ffff8dc00644ed80 x1875453361360128/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576185 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788576160.937044:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644ed80 x1875453361360128/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576185 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576160.937055:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788576160.937059:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788576160.937063:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361360128:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788576160.937070:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361360256:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788576160.937102:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788576160.937113:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576160/real 1788576160]  req@ffff8dc00644df80 x1875453361360256/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576185 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788576160.937125:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644df80 x1875453361360256/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576185 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576160.937134:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788576160.937137:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788576160.937140:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361360256:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788576160.937146:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361360384:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788576160.937164:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788576160.937174:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576160/real 1788576160]  req@ffff8dc00644fb80 x1875453361360384/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576185 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788576160.937185:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644fb80 x1875453361360384/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576185 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576160.937194:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788576160.937197:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788576160.937200:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361360384:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788576160.937205:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361360512:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788576160.937224:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788576160.937234:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576160/real 1788576160]  req@ffff8dc00644f100 x1875453361360512/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576185 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788576160.937245:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f100 x1875453361360512/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576185 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576160.937252:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788576160.937255:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788576160.937258:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361360512:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788576160.937264:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361360640:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788576160.937280:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788576160.937292:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576160/real 1788576160]  req@ffff8dc00644d880 x1875453361360640/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576185 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788576160.937303:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d880 x1875453361360640/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576185 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576160.937310:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788576160.937313:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788576160.937316:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361360640:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788576161.314996:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788576161.314996:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576161.315038:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788576161.316116:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788576161.316214:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576161.316221:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788576161.955185:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576162.339031:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788576162.339203:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576162.339252:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576162.339352:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00010000:00010000:0.0:1788576162.339366:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788576162.339505:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788576162.979008:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576163.362992:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788576163.362992:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788576163.362992:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788576163.363092:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576163.363095:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:0.0:1788576163.363603:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576164.003598:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576164.387332:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788576164.388000:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788576164.389826:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788576164.390084:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788576164.390139:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576164.390199:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788576165.026988:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576165.411005:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788576165.411133:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788576165.411143:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788576165.411185:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:2.0:1788576165.411277:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576165.411317:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576166.050936:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00080000:3.0:1788576166.051942:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576166.051948:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1788576166.051952:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576166.051961:0:23464:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4511
00000100:00080000:3.0:1788576166.051970:0:23464:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576166.051977:0:23464:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:3.0:1788576166.052006:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e300 x1875453361360768/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576166.052032:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576166.052036:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788576166.052038:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576166.052042:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4511
00000100:00080000:3.0:1788576166.052046:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576166.052050:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576166.052059:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576166.052071:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c700 x1875453361360896/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576166.052079:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576166.052083:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788576166.052085:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576166.052088:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4511
00000100:00080000:3.0:1788576166.052091:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576166.052095:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576166.052100:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576166.052111:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644e680 x1875453361361024/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576166.052122:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576166.052125:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788576166.052127:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576166.052130:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4511
00000100:00080000:3.0:1788576166.052134:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576166.052138:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576166.052142:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576166.052152:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d180 x1875453361361152/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576166.052161:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576166.052164:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1788576166.052166:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576166.052169:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4511
00000100:00080000:3.0:1788576166.052173:0:23464:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576166.052177:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576166.052181:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576166.052191:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644f480 x1875453361361280/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576166.052207:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576166.052210:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1788576166.052212:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576166.052216:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4511
00000100:00080000:3.0:1788576166.052220:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576166.052223:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576166.052227:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576166.052237:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644c380 x1875453361361408/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1788576166.052258:0:23464:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1788576166.052262:0:23464:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1788576166.052264:0:23464:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1788576166.052268:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4511
00000100:00080000:3.0:1788576166.052271:0:23464:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1788576166.052276:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:3.0:1788576166.052280:0:23464:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1788576166.052289:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc00644d500 x1875453361361536/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1788576166.052356:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361360768:192.168.202.140@tcp:250:kworker.0
00000800:00000100:2.0:1788576166.052414:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788576166.052447:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576166/real 1788576166]  req@ffff8dc00644e300 x1875453361360768/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576191 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788576166.052463:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e300 x1875453361360768/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576191 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576166.052473:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788576166.052477:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788576166.052480:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361360768:192.168.202.140@tcp:250:kworker.0
00000100:00100000:2.0:1788576166.052486:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361360896:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788576166.052503:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788576166.052515:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576166/real 1788576166]  req@ffff8dc00644c700 x1875453361360896/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576191 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788576166.052526:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c700 x1875453361360896/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576191 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576166.052534:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788576166.052549:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788576166.052553:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361360896:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788576166.052559:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361361024:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788576166.052578:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788576166.052589:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576166/real 1788576166]  req@ffff8dc00644e680 x1875453361361024/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576191 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788576166.052600:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644e680 x1875453361361024/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576191 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576166.052608:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788576166.052611:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788576166.052614:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361361024:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788576166.052619:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361361152:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788576166.052636:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788576166.052647:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576166/real 1788576166]  req@ffff8dc00644d180 x1875453361361152/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576191 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788576166.052665:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d180 x1875453361361152/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576191 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576166.052673:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788576166.052676:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788576166.052679:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361361152:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788576166.052684:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361361280:192.168.202.140@tcp:38:kworker.0
00000800:00000100:2.0:1788576166.052702:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788576166.052713:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576166/real 1788576166]  req@ffff8dc00644f480 x1875453361361280/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576191 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788576166.052724:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644f480 x1875453361361280/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576191 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576166.052732:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788576166.052735:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788576166.052738:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361361280:192.168.202.140@tcp:38:kworker.0
00000100:00100000:2.0:1788576166.052744:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361361408:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788576166.052762:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788576166.052772:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576166/real 1788576166]  req@ffff8dc00644c380 x1875453361361408/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576191 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788576166.052782:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644c380 x1875453361361408/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576191 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576166.052824:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788576166.052827:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788576166.052830:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361361408:192.168.202.140@tcp:8:kworker.0
00000100:00100000:2.0:1788576166.052835:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361361536:192.168.202.140@tcp:8:kworker.0
00000800:00000100:2.0:1788576166.052854:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:2.0:1788576166.052910:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576166/real 1788576166]  req@ffff8dc00644d500 x1875453361361536/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576191 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1788576166.052924:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc00644d500 x1875453361361536/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576191 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1788576166.052932:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1788576166.052934:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:2.0:1788576166.052937:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc00644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361361536:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788576166.435171:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788576166.437896:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:1.0:1788576166.438047:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1788576166.438125:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576166.438177:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576166.438288:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788576167.075003:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576167.458988:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576167.459096:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788576167.459826:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788576167.459988:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576167.460018:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788576167.460103:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576168.099113:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576168.483097:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788576168.483319:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576168.483737:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576168.483823:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788576168.484301:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1788576168.484433:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:1.0:1788576169.123054:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576169.506981:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576169.506989:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:0.0:1788576169.507021:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576169.507075:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576169.507091:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788576169.507117:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:1.0:1788576170.148805:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:0.0:1788576170.531056:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:2.0:1788576170.531056:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576170.531218:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:0.0:1788576170.531369:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:3.0:1788576170.531396:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:2.0:1788576170.534239:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1788576171.172583:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576171.172599:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1788576171.172604:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576171.172619:0:37911:0:(import.c:545:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 192.168.202.140@tcp last attempt 4516
00000100:00080000:2.0:1788576171.172633:0:37911:0:(import.c:630:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576171.172644:0:37911:0:(import.c:665:import_select_connection()) MGC192.168.202.140@tcp: import ffff8dc0052f9800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000100:00100000:2.0:1788576171.172706:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497100 x1875453361361664/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788576171.172742:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576171.172746:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788576171.172748:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576171.172752:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4516
00000100:00080000:2.0:1788576171.172756:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576171.172771:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc01049b800: import ffff8dc0186f7000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788576171.172785:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788576171.172800:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020497480 x1875453361361792/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788576171.172808:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576171.172811:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788576171.172813:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576171.172817:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4516
00000100:00080000:2.0:1788576171.172821:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576171.172825:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc01049b800: import ffff8dc0186f5800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788576171.172831:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788576171.172840:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020496d80 x1875453361361920/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788576171.172852:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) a73dcc9b-61e8-4b8a-971c-1141da788d66->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576171.172854:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788576171.172855:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576171.172858:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: connect to NID 192.168.202.140@tcp last attempt 4516
00000100:00080000:2.0:1788576171.172861:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576171.172864:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc01049b800: import ffff8dc0186f3800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788576171.172901:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788576171.172913:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495500 x1875453361362048/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788576171.172921:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576171.172924:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1788576171.172926:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576171.172929:0:37911:0:(import.c:545:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4516
00000100:00080000:2.0:1788576171.172933:0:37911:0:(import.c:630:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576171.172938:0:37911:0:(import.c:665:import_select_connection()) lustre-MDT0000-mdc-ffff8dc0032d2800: import ffff8dc0052fe000 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788576171.172942:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788576171.172952:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494380 x1875453361362176/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788576171.172961:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576171.172964:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1788576171.172966:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576171.172970:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4516
00000100:00080000:2.0:1788576171.172973:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576171.172977:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-ffff8dc0032d2800: import ffff8dc0060df800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788576171.172981:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788576171.172994:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020494e00 x1875453361362304/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1788576171.173002:0:37911:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d61336c-09bb-48c3-938e-9c469fbceb0d->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1788576171.173005:0:37911:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1788576171.173006:0:37911:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1788576171.173010:0:37911:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: connect to NID 192.168.202.140@tcp last attempt 4516
00000100:00080000:2.0:1788576171.173013:0:37911:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1788576171.173016:0:37911:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-ffff8dc0032d2800: import ffff8dc018256800 using connection 192.168.202.140@tcp/192.168.202.140@tcp
00000008:00100000:2.0:1788576171.173020:0:37911:0:(osc_request.c:3830:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683396 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1788576171.173029:0:37911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8dc020495880 x1875453361362432/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1788576171.173283:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361361664:192.168.202.140@tcp:250:kworker.0
00000800:00000100:3.0:1788576171.173375:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576171.173428:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576171/real 1788576171]  req@ffff8dc020497100 x1875453361361664/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576196 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576171.173448:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497100 x1875453361361664/t0(0) o250->MGC192.168.202.140@tcp@192.168.202.140@tcp:26/25 lens 520/544 e 0 to 1 dl 1788576196 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576171.173459:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052f9800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576171.173463:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576171.173467:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5ae0868-1fdf-4cd5-a61f-2f9ccc0c273d:2346:1875453361361664:192.168.202.140@tcp:250:kworker.0
00000100:00100000:3.0:1788576171.173475:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361361792:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788576171.173499:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576171.173512:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576171/real 1788576171]  req@ffff8dc020497480 x1875453361361792/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576196 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576171.173523:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020497480 x1875453361361792/t0(0) o38->lustre-MDT0000-mdc-ffff8dc01049b800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576196 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576171.173533:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576171.173537:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576171.173540:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361361792:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788576171.173546:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361361920:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788576171.173568:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576171.173579:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576171/real 1788576171]  req@ffff8dc020496d80 x1875453361361920/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576196 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576171.173596:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020496d80 x1875453361361920/t0(0) o8->lustre-OST0000-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576196 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576171.173606:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576171.173609:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576171.173612:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361361920:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788576171.173619:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361362048:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788576171.173639:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576171.173650:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576171/real 1788576171]  req@ffff8dc020495500 x1875453361362048/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576196 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576171.173675:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495500 x1875453361362048/t0(0) o8->lustre-OST0001-osc-ffff8dc01049b800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576196 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576171.173684:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0186f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576171.173687:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576171.173691:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a73dcc9b-61e8-4b8a-971c-1141da788d66:2346:1875453361362048:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788576171.173697:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361362176:192.168.202.140@tcp:38:kworker.0
00000800:00000100:3.0:1788576171.173719:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576171.173730:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576171/real 1788576171]  req@ffff8dc020494380 x1875453361362176/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576196 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576171.173742:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494380 x1875453361362176/t0(0) o38->lustre-MDT0000-mdc-ffff8dc0032d2800@192.168.202.140@tcp:12/10 lens 520/544 e 0 to 1 dl 1788576196 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576171.173758:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0052fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576171.173774:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576171.173778:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361362176:192.168.202.140@tcp:38:kworker.0
00000100:00100000:3.0:1788576171.173784:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361362304:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788576171.173804:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:3.0:1788576171.173815:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576171/real 1788576171]  req@ffff8dc020494e00 x1875453361362304/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576196 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576171.173826:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020494e00 x1875453361362304/t0(0) o8->lustre-OST0000-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576196 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576171.173834:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc0060df800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576171.173837:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576171.173839:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361362304:192.168.202.140@tcp:8:kworker.0
00000100:00100000:3.0:1788576171.173845:0:2346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361362432:192.168.202.140@tcp:8:kworker.0
00000800:00000100:3.0:1788576171.173863:0:2346:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.140@tcp
00000100:00100000:1.0:1788576171.173893:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576171.173905:0:2346:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788576171/real 1788576171]  req@ffff8dc020495880 x1875453361362432/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576196 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1788576171.173916:0:2346:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8dc020495880 x1875453361362432/t0(0) o8->lustre-OST0001-osc-ffff8dc0032d2800@192.168.202.140@tcp:28/4 lens 520/544 e 0 to 1 dl 1788576196 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1788576171.173924:0:2346:0:(import.c:65:import_set_state_nolock()) ffff8dc018256800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1788576171.173927:0:2346:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.140@tcp failed (-110)
00000100:00100000:3.0:1788576171.173931:0:2346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dc020495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d61336c-09bb-48c3-938e-9c469fbceb0d:2346:1875453361362432:192.168.202.140@tcp:8:kworker.0
00000100:00100000:1.0:1788576171.555042:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:3.0:1788576171.555929:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00010000:00010000:1.0:1788576171.556461:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1788576171.557051:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788576171.557079:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576171.557211:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:1.0:1788576172.195048:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576172.579070:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:0.0:1788576172.579226:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00000100:00100000:2.0:1788576172.579301:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:3.0:1788576172.579424:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00010000:00010000:2.0:1788576172.579646:0:37903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576172.579697:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576173.219069:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576173.603032:0:6050:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0012edcc0 going to sleep for 0 seconds
00000100:00100000:2.0:1788576173.603033:0:14038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc019aedcc0 going to sleep for 0 seconds
00000100:00100000:1.0:1788576173.603260:0:5591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a7d80 going to sleep for 0 seconds
00000100:00100000:0.0:1788576173.603344:0:5590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0127f6240 going to sleep for 0 seconds
00000100:00100000:3.0:1788576173.604939:0:14037:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc005747180 going to sleep for 0 seconds
00010000:00010000:2.0:1788576173.605194:0:37938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1788576174.243046:0:37856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dc0204a70c0 going to sleep for 0 seconds
Debug log: 83601 lines, 83601 kept, 0 dropped, 0 bad.